Houston is pretty hot and muggy. Due to the big industrial base in east Houston and on the bay, the pollution is bad. The ozone level is 6th worst in the U.S. On the bright side, Baylor is located in the best part of Houston and in one of the biggest (if not the) medical centers in the country. Having UTH, Rice, and St Thomas in the immediate vicinity and UH not so far away makes for a young and vibrant atmosphere.
Personally, I'm not a big fan of Houston, and location weighs in heavily in my preference for Southwestern over Baylor.