I honestly think you're reading too much into it, just one interview day at one program is not representative of any sort of norm. The gender distribution may depend largely on the type of program (eg pediatrics tends to be more female heavy), but currently I believe more women are applying for residencies than men. I also am not sure how a program would really go about having a "type" just for interviews, unless they required a photo or something (but this would be an extremely dumb reason to accept/deny someone IMO). Then when it comes to fit with the program, surely the "type" is primarily based on personality and fit with the program.
I personally had many varied interview days and have had two years of diverse residency classes, even within a specific subspecialty. And I never really looked like the other candidates but who the heck cares.
tdlr worry more about the fit of your personality with a program than the fit of your physical appearance. and maybe look out for the pharmacy dept itself to see how diverse it is.
