It's a contraction of the phrase 'St Botolph's Town'.
Lincolnshire is a very flat county, and St Botolph was able to invent Battenburg while out for a stroll without hindrance from the peaks and troughs of say, the East Ridings. By sheer coincidence, Battenburg is made up of squares, much like other things that are too.
HTH.