When you apply for fellowship, they evaluate you based on where you did your residency. Meaning if you coming from a super strong residency that is what they will care about not where you did medical school (granted some PDs will always have the bias which you cannot do anything about).