Documentation

User Tools

Site Tools

Trace:
emis_user_manual

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
emis_user_manual [2025/09/27 21:54] – [Managing duplicate teacher data] ghacheyemis_user_manual [2025/09/27 22:31] (current) – [Test Analysis] ghachey
Line 456: Line 456:
  
 More on test analysis can be found [[https://www.washington.edu/assessment/scanning-scoring/scoring/reports/item-analysis/|here]] [UWItemAnalysis] More on test analysis can be found [[https://www.washington.edu/assessment/scanning-scoring/scoring/reports/item-analysis/|here]] [UWItemAnalysis]
 +
 +
 +=== Verifying Item Answer Keys  ===
 +
 +One area that can affect test results is the incorrect loading of metadata for test items. MIEMIS provides a robust set of features to help analyze item quality, as discussed in the previous sub-sections. It also offers a way to verify that the loaded metadata is correct. While this process can be somewhat laborious, it should be performed every time a new test data file is loaded.
 +
 +The process can be summarized as follows:
 +
 +  * Review the actual test administered, item by item. At a minimum, identify the correct answer (and ideally also the difficulty level, as well as the standard, benchmark, and indicator from the curriculum that the item should be classified under). These are all considered the item’s metadata.
 +  * Verify that this metadata matches what has been loaded into MIEMIS (or any other system).
 +
 +You can do this easily by logging into MIEMIS and following the steps below:
 +
 +  - Find the exam of interest by clicking on "Exam -> List," then either filter or sort to locate the exam quickly. Click on the Exam ID to open its record.{{ :user-manual:exam-items-verification-1.png?nolink |}}
 +  - You will see the tabs (Exam Info, Structure, Results, Table, and Test Analysis). Click on **Test Analysis**.{{ :user-manual:exam-items-verification-2.png?nolink |}}
 +  - Optionally, review the theoretical statistics that measure the strength of the test (these are discussed in the previous sub-sections).
 +  - Scroll down through the "Question by Question" section. The most important metadata to verify is the answer key, highlighted in green. Compare it with the administered test to ensure it matches expectations.{{ :user-manual:exam-items-verification-3.png?nolink |}}
  
 ==== Dashboard Analysis ==== ==== Dashboard Analysis ====
emis_user_manual.txt · Last modified: 2025/09/27 22:31 by ghachey