In addition to the MSN conversation…
Every bank (AFAIK) gives you an ATM PIN card which you can use to pay in about any store and with which you can draw cash from any ATM machine (though you might be limited to one or more times a day when the ATM machine is not from the same bank). Additionally, some will include a chipknip, which is like a digital wallet, i.e. when it is supported you can use it to pay for stuff without needing to enter a code. You do need to load some money on to it first, though.
As for the expenses: only a few stores (mostly small ones) will charge you for using it for small amounts of cash, which is a relic of old times when using such a card was still more expensive than cash for the store.