How do I find out which banks operated in my town/village etc?

Look in contemporary records or publications. The local studies library and/or local authority archive should have postal directories and/or valuation rolls, and these should confirm the name of the bank(s) that operated within the location you are interested.