Its an honors society for medical students/residents. I think they give it out to the top 10% of students. Its supposedly a big deal for gaining prestigious residencies.
at most pass/fail schools, your grades are still recorded. Those are used for AOA. AOA though, as I understand it, is a mixture of your grades and write-ups from your profressors.