I agree to go with which one you feel you found to be the most confortable environment for you.
Having had some experience at both schools now, I can honestly say I like GW a lot better. But some people really like Gtown, so it depends on the person. They are both about the same price, are located only about 15-20 city blocks apart (though Gtown med is a little more isolated), and you would probably get a quality education at either.
Gtown seems more competitive amongst the students, and the school seems to encourage this by grading on a curve. There is also less diversity in the class than at GW, for whatever that is worth. Gtown's board scores do tend to be a bit higher than GW's. I've heard Georgetown has good connections for matching into surgery (esp. ortho), so that's something to consider if you want to do surgery. Georgetown University as a whole also probably has the better "name", at least among lay people. The schools itself, as you probably noticed, is in a very residential area that is not near the metro (Gtown does provide shuttles to the metro, but it is still inconvenient).
GW seems like the "friendlier" of the two schools, and there is a lot of emphasis on good clinical training. They also have a variety of summer opportunities available for students to participate in between 1st and 2nd years. Overall, I just think GW focuses more on making sure their students succeed vs. Gtown where it's more of a sink or swim vibe (at least I thought so during my year there in the SMP). GW also feels much more a part of DC because it is on the metro.
edit: Just wanted to add that an option for your "track" at GW (which are optional, about 50% of students do one) is community medicine, and GW definitely has connections in places that work to help the underserved community. Furthermore, 1st and 2nd year students also do a community service day each year that specifically involves working at a needy site in DC.