I agree with the underdog. If others at your school often get Honors on their AI's, and you did not, then it could hurt you definitely. I think it could hurt anyway, as at a lot of places there tends to be grade inflation in 4th year and so people may expect to see Honors on a subI. Particularly if grading is pass/HP/Honors then that would be bad to get a Pass. What's done is done, however. Your board scores are quite strong for an IM applicant. It sounds like you go to a solid/well known med school. My suggestions at this time would be:
1) pick out two or three places that you've applied and really want an interview, but haven't yet heard from r.e. an interview. Get a friendly faculty member(s) to make a phone call or send an email on your behalf to try to see if he/she can get you an interview. This may work better if the person is a full professor and/or has some connection to that particular hospital or residency program. Personal connections can matter. Trust me on this. Now is a good time to swallow your pride...may want to wait a few weeks, though, as many interview invites probably haven't gone out yet.
2) I agree with warning other 3rd year students off of the particular attending(s) or AI that you did. If students start never taking this rotation then maybe your school will realize there is a problem.
3) Finally, introspection is always in order whenever you get a low grade or bad evaluation. It sounds like these attending(s) may just be particularly harsh graders, but it never hurts to go back and think about what you maybe could have done better. Sometimes it's also interesting, if you can stomach it, to get some feedback from people who have trashed you on an evaluation; it usually needs to be taken with a grain of salt, but sometimes you can still get some interesting and helpful insights.