Yeah, the only reason to declare yourself pre-med is so that you are paired with an advisor to get you where you need to go.
It isn't necessary though. I completed a music degree before researching which classes I needed to complete before applying to med school. I was never assigned an advisor beyond the admissions department my second time around, but I had experience on how everything worked.
Basically, a pre-med advisor will help you choose a major (usually Biology) that will get you a bachelor's degree and ensure you take all the courses required by most med schools.