Shadowing is about realizing what you are getting into being a doc, so do it any time you get a chance. My premed advisor said most people shadow around 40 hrs or so, but from other people I heard from, that is pretty low and 80-100 is more likely. Starting shadowing early won't hurt you as long as you are consistent throughout your college career