Frequently Asked Questions

ExamEval is an AI-powered platform that analyzes multiple-choice exams for item-writing flaws, question complexity, content coverage, and psychometric quality. It delivers actionable feedback to educators and assessment creators, helping improve exam validity, reliability, and overall quality.

ExamEval uses a credit system for exam analysis. Each question consumes a certain number of credits, depending on its complexity and the number of detected flaws. On average, 1,000 credits is enough to analyze 15-20 standard multiple-choice questions. More complex or flawed questions may require additional credits. You can monitor your credit usage on your dashboard.

Credits can also be used for the ExamEval Rewrite tool, which lets you submit a single question for instant AI-powered feedback and improvement suggestions.

ExamEval offers a free plan and flexible paid options for individuals and organizations. You can purchase additional credits (which never expire) or subscribe to a monthly plan. See our Pricing page for full details.

The Free Plan is ideal for trying out ExamEval or for users with occasional exam review needs. It includes 1,000 credits per month, which is typically enough to analyze about 15-20 questions monthly.

The Pro Subscription is designed for instructors with multiple exams per semester or longer assessments. It provides 12,000 credits per month, typically enough to analyze 200+ questions monthly.

ExamEval supports PDF, Word (DOC, DOCX, ODF), rich text (RTF), and plain text (TXT) formats. You can also copy and paste your exam directly into the textbox on the upload page. For best results, include question numbers, answer choices (with letter labels), and optionally mark the correct answer (e.g., with an asterisk). Text formatting (highlight, bold, italics, underline, color) is not preserved or analyzed. Images and attachments are not processed.

Your exam is processed through a series of AI-powered analysis tasks. Most results are available within a few minutes. You will receive an email notification when your analysis is complete, and you can also check the status on your ExamEval dashboard.

ExamEval highlights questions with potential item-writing flaws, classifies each question by learning level, and maps exam content to major topic areas. This helps ensure alignment with your learning objectives and content blueprint. For a sample report, see the Demo Exam Analysis Report.

For a comprehensive overview of common item-writing flaws, see our Item-Writing Flaws article. Here are some highlights:

1. Spelling or grammatical errors
2. Ambiguous or confusing wording
3. Negative question stem phrasing
4. Unfocused or vague question stem lead-in
5. "All of the above" as an answer choice
6. Heterogeneous answer choices
7. Test-wise cues in wording that hint at the correct answer
8. Too many or too few answer choices
9. Duplicate questions in the same exam
10. Multiple potentially correct answers

Yes! While ExamEval is designed for full exams, our Rewrite tool lets you submit a single question and receive instant AI-generated feedback and suggestions for improvement. This is especially helpful during the drafting process for creating high-quality questions.

Yes! ExamEval works well for both summative exams and formative quizzes, helping you improve item quality at any stage of assessment development. You can analyze a single question, a short quiz, or a full-length exam.

Yes, you can print or download the full analysis as a PDF to share with colleagues or keep for your records.

Yes, you can re-upload an edited version of your exam at any time. Each upload uses additional credits. AI analysis results may differ slightly with each upload due to the nature of AI processing.

Yes. Your data is private, secure, and permanently deleted after 30 days. See our Terms of Service for more information. Exam questions are used only to generate feedback and are never used to train AI models.

ExamEval is designed for health professions educators, including faculty in pharmacy, nursing, medicine, physician assistant (PA), physical therapy (PT), occupational therapy (OT), and related healthcare fields. However, anyone who writes or reviews multiple-choice questions can benefit from using ExamEval.

You can contact our support team anytime via the Contact page. We also offer onboarding and training for organizations.