Yes you can.
I've one account with Dresdner Bank, soon to be part of Commerzbank, held one in the past with Deutsche Bank while living in Ireland. Just recently opened a trading account, which included other banking options including a savings account (5.5% up to €30.000) with DAB, Deutsche Aktien Bank.
Your biggest problem might be that all documentation might be provided in German!
cologneboy