Frequently Asked Questions
What is ExamEval?
ExamEval is an AI-powered platform that analyzes multiple-choice exams for item-writing flaws, question complexity, and content coverage. It provides actionable feedback to health professions educators to improve the quality of their assessments.
How should my uploaded exams be formatted? What file types are supported?
For best results, upload your exam as a DOCX (Word document), PDF file, or copy/paste the exam directly into the textbox. Exams can be formatted in any way, but we recommend including the question (with question number), answer choices (with letter choices), and correct answer (with asterisk or other marker). Text formatting, such as highlighting, bold, italics, underline, and coloring is not preserved or read by AI as part of the exam analysis. Additionally, images or attachments are not included during processing and are not part of the exam analysis. Note that some .doc files, such as those exported from ExamSoft, may not process as well as a DOCX or PDF file.
What happens after I upload my exam?
Your exam is processed through a series of AI tasks. Some results appear quickly, while others may take a few minutes.
What kind of feedback will I receive?
ExamEval highlights questions with potential item-writing flaws, classifies each question by learning level, and maps the exam content to major topic areas. This helps ensure alignment with your learning objectives and content blueprint.
What are common item-writing flaws?
Common item-writing flaws include:
- Spelling or grammatical errors
- Ambiguous or confusing wording
- Negative question stem phrasing
- Unfocused or vague question stem lead-in
- "All of the above" as an answer choice
- Heterogeneous answer choices
- Test-wise cues in wording that hint at the correct answer
- Too many or too few answer choices
- Duplicate questions in the same exam
- Multiple potentially correct answers
Can I re-upload a revised version of the same exam?
Yes, you're welcome to re-upload an edited version, but it will use additional credits each time you do so.
Is my exam content private and secure?
Your exam questions are used only to generate feedback and are deleted after 30 days. Content is shared with third parties only for processing and is never used to train AI models.
Who is ExamEval designed for?
ExamEval is designed for health professions educators, including faculty in pharmacy, nursing, medicine, physician assistant (PA), physical therapy (PT), occupational therapy (OT), and related healthcare fields. However, anyone who writes multiple-choice questions can benefit from using ExamEval.
Can I use ExamEval for quizzes or formative assessments?
Yes! ExamEval works well for both summative exams and formative quizzes to help improve item quality at any stage of assessment development.