I recently drove round the country my the very first time, and found the most adorable little town four hours north of Reykjavik, called Hofsos. They have a community pool (common in all Icelandic communities) that overlooks the Atlantic Ocean — it was incredible. I felt like I was swimming on the edge of the world. There aren’t many tourists there, either. I recommend it!