As with almost everything else, a short walk around the harbour will aquaint you with all the services including the bank and ATM machine.
It is possible for the ATM to run out of money on the weekend or when there is a power and communications error on the island.