Oh wow ok this is much more confusing than I expected it to be.
So it appears in the solid part of the magnet, the magnetic field points one direction but even just .000000000000000000001mm above the solid magnet, it points in the opposite direction?