You did not specify which Baylor... there is a program in Dallas, and THE program in Houston. If future success was based solely upon which program one trained at, then your chances for future success look bright if you trained in Houston.
Fortunately, your fate will be influenced by YOUR effort, motivation, and desire to learn. An excellent physiatry residency training program provides a greater "learning coefficient" (in other words, the product of your effort to learn x greater learning exposure[clinical, research, administrative, academic] =more knowledge by the time of your graduation). However, even in a mediocre program, or even on a suboptimal learning rotation in an otherwise strong program, your educational fate is primarily in YOUR hands (or brain). If you take a hands-on approach to lifelong learning, you will certainly succeed. If you take a passive approach, expecting that your education is the primary responsibility of your attendings/chairman/residency program director, then your future success is in doubt.
Bottom line: Whether you are at Baylor-Dallas, Baylor-Houston, or anywhere else, aggressively pursue each of your future learning opportunities and you will do well.