Keep in mind that many programs do not contact their applicants at all after the interview, so if you don't hear anything from a program, it does not necessarily mean they don't like you. As an example, I got no such letters from my 1st-choice programs for either my residency or fellowship match, but I still matched at both those programs. I found out later that those programs have a policy where they do not contact any applicants after the interview.
While it's nice to hear something from a PD, I agree that you should rank places based on where you want to go, not based on who you get feedback from. If I would have ranked my programs based more on my perception of a program's level of interest or how I thought I would be ranked on their list, I would have done myself a huge disservice.
Besides, even if you get nice feedback, it doesn't necessarily mean anything. Verbal comments in the match process are non-binding, and you should take them with a grain of salt. A PD can easily change their mind after they've told you that they'll rank you highly.