I definitely hear you about EVMS vs. UVA. I can tell you that when I visited the schools, I got a completely different feeling from the students at each place. At EVMS, I felt like the students were very happy and excited about the fact that they were going to be doctors. At UVA I felt a little of that, but I also met several students who had a real chip on their shoulder about not getting in to Hopkins. Admittedly, I could have just met bad students, but that's at least the impression that I got.
I also had a doctor at UVA tell me that the clinical exposure students get at VCU or EVMS is actually better than what they get at UVA (due to the larger population base in Richmond or Norfolk vs. the tertiary care given at UVA). He said that at UVA they have to try hard to get students away from Charlottesville so that they can get the real world exposure they need to understand how medicine is really practiced. (Of course, I actually want to practice, which is why he said this to me... if you are interested in going into academic medicine, I'd say you ought to pick UVA hands-down.).
If you look at residency match lists for EVMS, you can still get ENT or ortho or derm if you want to... you just need to be in the top ~15% of your class or so. Which, if you're happy, you should be able to do.
You've got to do what's right for you, but I'd say just go with your gut feeling. If that's EVMS, don't let the U.S. News rankings tell you otherwise.
Just my opinion!