ESCRS - PO031 - PERFORMANCE OF CHATGPT 4.0 ON OPHTHALMOLOGY BOARD EXAM PRACTICE QUESTIONS

PERFORMANCE OF CHATGPT 4.0 ON OPHTHALMOLOGY BOARD EXAM PRACTICE QUESTIONS

Published 2025 - 29th ESCRS Winter Meeting

Reference: PO031 | Type: Free Paper | DOI: 10.82333/g81r-fm51

Authors: Pelin Kiyat* 1 , Hazan Gul Kahraman 1

1Department of Ophthalmology,İzmir Democracy University, Buca Seyfi Demirsoy Training and Research Hospital,İzmir,Türkiye

Purpose

To evaluate the performance of ChatGPT 4.0 in answering ophthalmology questions from two popular board preperation question resources

Setting

İzmir Democracy University, Buca Seyfi Demirsoy Training and Research Hospital Department of Ophthalmology, İzmir, Turkey.

Methods

Of 398 available questions in https://ebodtraining.com/ question bank 345 (86.6%), text-based questions were selected and organized in order to provide 35 questions in each subspecialty. Questions from https://www.eyedocs.co.uk/ were selected randomly in order to provide the same amount in each subspecialty and the other resource. Responses and percantages of correct answers were recorded in addition to the performances regarding to the subspecialties.

Results

In https://ebodtraining.com/, ChatGpt 4.0 answered 81.4% options correctly. ChatGPT-4.0 was detected weakest in ‘Neuroopthalmology’ and ‘Glaucoma, cataract and refractive surgery’ sections (68.57% and 69.71% correct answer rates respectively.) The best performances were generated in ‘General medicine relevant to ophthalmology’ and ‘Ophthalmic pathology, microbiology’ sections. (95.42%, 91.42% correct answer rates respectively.) In https://www.eyedocs.co.uk/, ChatGpt 4.0 answered 67.53% questions correctly. The weakest performance was in ‘Glaucoma and cataract’ and ‘External eye and cornea’ sections (54.28% and 57.14% correct answer rates respectively) and the best was received from ‘Pathology and microbiology’ section (94.28% correct answer rate).

Conclusion

ChatGPT can be a valuable tool in getting prepared for board examinations with its unique practice opportunities for students. In modern world, time is getting more precious every day, and with the help of AI models, students can receive information and explanation rapidly. In addition, with the advantage of asking further questions, students can access personalised answers which can reduce time consumption and results in tailored learning experience.