For the sake of opening the blinders a little bit, there are certainly areas in which diagnosis depends in part on clinical and/or imaging findings, falling in the category of clinicopathologic diagnoses. It's pretty easy to pat ourselves on the back and call ourselves the end-all be-all of diagnosis in pathology, and certainly medicine as we currently know it couldn't function without pathology. But for the most part it seems we've been talking about anatomic pathology and diagnosis of presence/absence of tumor. There's also, of course, clinical pathology and the myriad of related testing...which by volume is primarily interpreted by clinicians, not pathologists. Obviously there's a lot more to it than just that, but still generally the further one drifts from tumor pathology the more important history, clinical findings, and often CP labs become (not that most people would want to diagnose tumor without some history either). Most people don't go to the doctor because they have cancer or a mass -- maybe at one point in their lives, but most of the time no.
As for any doctor thinking they can read imaging while none think they can read path.. this is perhaps mostly true, but certainly some renal folks would like to read medical renal, respiratory medical lung, GI's medical GI, and of course derm has already made huge strides in cornering that particular market.
But no matter what, I'm in the boat that you should try to do what you most enjoy. If you're not sure, then do everything you can to get more experience in/exposure to your favorite options -- rotations, reading, observation, discussion, etc.