To throw in a different opinion, first year neuroscience was by far my favorite class of med school and I hated my neurology rotation. I loved learning about the theories of how memories form, how consciousness works, which areas of the brain control which parts of cognition and motor or sensory function, I even enjoyed learning the neurophysiology and anatomical tracts. However clinical neurology is pretty detached from this stuff. I remember starting my second year neurology block and the professor the first day said something like "well you can go ahead and forget 90% of what they taught you in neuroscience, it doesn't matter anymore". In my experience this was true. The basic neuroscience principles used in clinical neurology are only the ones known to be completely essential to the pathophys and treatment of specific diseases, all other basic stuff is gone. If it's hypothetical or just cool neuroscience it's gone. Further training in neurology didn't seem to focus on learning more cool basic neuroscience that doesn't apply to disease, but more clinical science like which drugs and which doses work best, sens and specs of exams, etc. Beyond being disappointed a lot of basic neuroscience is irrelevant, people either love or hate clinical neurology. Despite the major advancements in a lot of areas of neuro, a ton of patients still either just get better on their own without us doing much, don't get better at all, or get better with the help of a team of therapists and neurologists just coordinate that care (e.g. ALS, dementias).
I still find neuroscience so interesting neuro is my first choice at this point, but I was really disappointed with what type of neuroscience knowledge is used in clinical medicine. I actually found that psychiatry, especially more basic or neuroimaging psych research fit more with my neuroscience interests so I am also considering that.