Tufts definitely has a much better reputation. Just look at the two schools' matchlists. In terms of location, it's tough to beat Boston. Boston's such a beautifully laid out city with lots of great places to hang out. It has a very international population of students and researchers, including a world-class medical community. In Boston, you'll almost certainly be assured of living in a cool neighborhood as long as you live in Boston, Cambridge, Brookline, Brighton or Allston. In Philly, you're more likely to go wrong than not. I've heard some people on this board raving about Philly. I've visited Philadelphia twice this year, but both times it just didn't do it for me. It's a flat city that's dominated by rundown areas in every which direction. And, although Philly does have a small Chinatown and other enclaves, Boston has a lot more diverse population with more things that cater to different ethnicities.
The students at both schools seemed very happy when I visited. The students at Temple seemed more laidback. When you compare Tufts' primary teaching hospital with Temple's, I think you'd have to definitely hand it to Temple's. Everyone raves about Temple University Hospital, while I've heard a few negative things about rotation experiences at New England Medical Center. But don't forget that there are other hospitals in Tufts network that are supposed to be very good. I think the cost factor is a big negative for Tufts. Even if you're a non-PA resident, the overall per-year cost will run you nearly $10,000 more at Tufts. That's because of Tufts' higher tuition (about $6K more than Temple's out-of-state) and Boston apartments' outrageous rent. For $800/month, you can get a nice, fully-equipped studio in Philly, whereas you'll spend $1000/month to get a mediocre place in Boston.