Ya, when you start talking about Cl, Br, and I then it's more about their size and how they can delocalize a negative charge better b/c they're bigger. In the case that you stated though, the main difference between O and N is that O is more electronegative. F is super electronegative but small, so it can't delocalize its negative charge as well as Cl, Br, or I.