I think people tend to undervalue the merits of their PharmD, and if they were to look around, they'd find that breaking out is easier than they think. You have a medical doctorate in a sea of bachelors and masters degree graduates. There would be many firms that would at least take a look at you if you were to present your resume in the right way and build up a requisite skillset on the side.
A primary barrier to doing this is information assymmetry. It's hard to know what you don't know, and if someone or something were to clue you in on how to look and how to prepare it becomes much easier.
Case in point: I worked for a grocery store manager in his mid-50s who had never worked outside retail. For all intents and purposes, his career was in twilight. When the pharmacy chain closed, he was beside himself because he didn't find another pharmacy willing to hire him, especially in the tri-state's saturated market. He asked around for advice from people who knew and deep dove all the resources he could about reconfiguring his resume/cover letter, contacting people, etc and landed a job in a small pharma company doing clinical trial development (recently had his one year anniversary there). If he can do it, so can anyone else.
Another case: I knew another pharmacist who was fed up with working in retail. What he did was look at pages like these:
http://biopharmguy.com/index.php and these:
http://biopharmguy.com/links/company-by-location-clinical-research.php, looked at job requirements and responsibilities, tailored his activities outside work (volunteering) and modified his resume accordingly to fit job specifications. Then, he drew up an Excel sheet and hammered away, eventually joining a CRO.
I just want to put this out there for those who are looking desperately, in case it helps or encourages. Find resources that will point you to the right direction, and be determined to search high and low for openings - easier said than done, but certainly reasonable and definitely possible. People may say these stories aren't the norm - and they aren't - though I argue that it's not for lack of ability, but for lack of information.