Article: Ethical and Professional Decision-Making Capabilities of Artificial Intelligence Chatbots: Evaluating ChatGPT’s Professional Competencies in

This forum made possible through the generous support of SDN members, donors, and sponsors. Thank you.

Mr.Smile12

Admissions advisor
Staff member
Lifetime Donor
10+ Year Member
Joined
Oct 14, 2011
Messages
26,056
Reaction score
19,209
Ethical and Professional Decision-Making Capabilities of Artificial Intelligence Chatbots: Evaluating ChatGPT’s Professional Competencies in Medicine

We examined the performance of artificial intelligence chatbots on the PREview Practice Exam (1), an online situational judgment test for professionalism and ethics.


Please let me know if you can access this article behind the pay wall. I would like a copy.

Members don't see this ad.
 
Last edited:
Results: GPT-3.5 and GPT-4 scored 6/9 (76th percentile) and 7/9 (92nd percentile), respectively, higher than medical school applicant averages of 5/9 (56th percentile). Both models answered 95 + % of questions correctly.

So consequently, it's possible to use chatbots to instruct/train test-takers on potential issues presented on PREview. Please confirm if you have access to the article.
 
Top