Article: Ethical and Professional Decision-Making Capabilities of Artificial Intelligence Chatbots: Evaluating ChatGPT’s Professional Competencies in

[Mr.Smile12]

Advertisement - Members don't see this ad

Ethical and Professional Decision-Making Capabilities of Artificial Intelligence Chatbots: Evaluating ChatGPT’s Professional Competencies in Medicine

We examined the performance of artificial intelligence chatbots on the PREview Practice Exam (1), an online situational judgment test for professionalism and ethics.

Ethical and Professional Decision-Making Capabilities of Artificial Intelligence Chatbots: Evaluating ChatGPT’s Professional Competencies in Medicine - Medical Science Educator

Purpose We examined the performance of artificial intelligence chatbots on the PREview Practice Exam, an online situational judgment test for professionalism and ethics. Methods We used validated methodologies to calculate scores and descriptive statistics, χ2 tests, and Fisher’s exact tests to...

link.springer.com

Please let me know if you can access this article behind the pay wall. I would like a copy.

 

[Mr.Smile12]

Results: GPT-3.5 and GPT-4 scored 6/9 (76th percentile) and 7/9 (92nd percentile), respectively, higher than medical school applicant averages of 5/9 (56th percentile). Both models answered 95 + % of questions correctly.

So consequently, it's possible to use chatbots to instruct/train test-takers on potential issues presented on PREview. Please confirm if you have access to the article.