I cannot imagine anytime in the near future that a PCP would have a tough time locating a job, particularly in or near a midsized city.
The issue likely would be more about the financial side; will you as a PCP be able to see sufficient paying patients to take home enough to pay those student loans? Doing so will likely mean setting some rules regarding # of patients with no insurance (presuming limited ability to pay) and with medicare or other types of insurance that may not pay enough to cover your office expenses (again, presuming you have a nurse, front office admin, rent expense, and similar costs that must be paid).
If I were going this route, I'd look seriously at what different healthcare professionals (nurse practioner, physician assistant, medical assistant, etc) can do, and likely hire several in my office. This would be just so you as the PCP are not the first one in to see the kid with a runny nose or splinter. May make sense oversee a number of PAs and others as the provider who sees the most complicated cases rather than see everyone as the first point of contact, PAs in our area earn upper 60's to start, if you had a few on staff your office could see more low-reimbursement patients and depending on how you structure things, your salary could be higher. High salary is not the endall, but it's essential to your patients that you earn enough to make it worth your while to continue your practice.