Perhaps, but probably not in the way you're thinking. I definitely slanted my selection of letter writers to those who could comment positively on my character, personality, thoughtfulness etc., as opposed to intellectual abilities. There is one letter that may have been problematic, however, and that is my former PI in graduate school. Unfortunately, he actually was the stereotype of a physicist--Sheldon and then some, basically a savant. Very awkward communication skills and affect. I was very wary of using a letter from him (even though he thought highly of me) but I have a lot of research experience and I think it would have been an obvious red flag if I didn't use him for a letter writer and multiple pre-health advisors told me it would look terrible not to use him since we worked together for so long. It's quite possible he said some downright weird stuff that rubbed off on me, perception-wise. But for what it's worth, one interviewer I had at another school commented at one point that my letters "were all glowing" so who knows.