Transform Your Assessment Quality
AI-Powered Exam Analysis for Health Professions Educators
Eliminate item-writing flaws, increase assessment reliability, and improve student learning outcomes with our expert AI system.
Why Choose ExamEval?
ExamEval is an AI-powered platform designed specifically for health professions educators. Our mission is to help you create valid and reliable assessments to accurately measure student learning.
Easy Upload
Securely upload multiple-choice exam files in various formats for analysis
AI-Powered Review
An AI-powered model reviews detects item-writing flaws that impact exam validity and reliability
Learning Levels
Each question's learning level (application of knowledge vs. recall of fact) are categorized for your review
Map Content Areas
Each question is mapped to 1-3 primary content areas using AI analysis to identify major themes and topics
Key Metrics
Calculate key metrics such as an overall exam quality score, reading grade level, and average estimated reading time for question text
Detailed Report
A comprehensive report provides specific recommendations to improve question quality and exam reliability
Research-Backed Solutions
Item-writing flaws are errors in multiple choice questions that undermine their validity, clarity, or fairness in assessing a student's understanding of course content.1
Item writing flaws are incredibly common50% to 75%
of multiple-choice questions in healthcare education (in nursing, pharmacy, and medical education) have item writing flaws.2-5
The Problem
- Most health professions faculty do not receive formal training in writing high-quality, reliable multiple choice exam questions
- Summative assessments in health sciences degrees heavily rely on multiple choice assessments to assess student knowledge of curricular content
- Item-writing flaws lead to inaccurate assessment of student knowledge and increase the difficulty of exams, leading to more worse exam scores and student performance 2,5
- Faculty peer review of exam questions to identify item-writing flaws is time-consuming and often ineffective due to late submissions and inconsistent reviewer expertise
Our Solution
- ExamEval uses an AI model specifically trained to detect more than 15 types of item-writing flaws that impact exam quality and reliability
- Specific recommendations to improve the question wording or structure are provided for questions with flaws
- ExamEval is available for immediate exam review and provides unbiased, consistent feedback
- Haladyna TM, et al. Applied Measurement in Education. 2002;15(3):309-333. doi: 10.1207/S15324818AME1503_5.
- Downing SM. Adv Health Sci Educ Theory Pract. 2005;10(2):133-43. doi: 10.1007/s10459-004-4019-5.
- Dell KA, Wantuch GA. Curr Pharm Teach Learn. Jan-Feb 2017;9(1):137-144. doi: 10.1016/j.cptl.2016.08.036.
- Tarrant M, et al. Nurse Educ Today. 2006 Dec;26(8):662-71. doi: 10.1016/j.nedt.2006.07.006.
- Caldwell DJ, Pate AN. Am J Pharm Educ. 2013 May 13;77(4):71. doi: 10.5688/ajpe77471.
How It Works
Upload Your Exam
Upload your multiple-choice exam document in any standard format, such as Word or PDF. ExamEval will securely processes your exam questions.
AI Analysis
Our advanced AI examines each question, identifying item-writing flaws and quality issues based on educational best practices.
Detailed report
Review a comprehensive report that pinpoints issues and provide actionable recommendations for improvement.
Valid, Reliable Summative Assessments
Improve your exam quality and assessment of student learning by identifying and removing item-writing flaws.