What do you mean by "learn about these health disparities"? What do you want to learn? While academic medical centers generally care for a broad swath of patients including those who are referred for specialty care, there are also community-based health clinics in marginalized communities that also serve as a safety net and see disparities day after day.
If you are a primary care provider, you are going to see obesity, hypertension, diabetes, peripheral arterial disease, chronic obstructive pulmonary disease, asthma, etc every day. You are going to have learned to care for people with these diseases, and many others, in residency. What do you want to learn and what are you going to do with what you learn? Do you want to do research and use that to inform efforts at changing health policy? Do you want to develop programs and test whether they work to decrease incidence or improve outcomes for people with these conditions, or to help people change behaviors that lead to poor outcomes? I guess we need to know more about "why medicine" from your perspective to be able to advise you.