Documentation

User Tools

Site Tools

Trace:
emis_exams_module

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
emis_exams_module [2022/08/18 08:31] – [Candidate Count] ghacheyemis_exams_module [2022/08/22 04:04] (current) – [By benchmarks] ghachey
Line 37: Line 37:
 ==== Subject Areas, Standards and Benchmarks ==== ==== Subject Areas, Standards and Benchmarks ====
  
-Exams (aka. assessments) are typically given at various stages of a student's education life cycle (e.g. Grade 3, Grade 6, Grade 8, Grade 12, etc.) and on various subject areas (e.g. English, Local Language, Mathematics, Sciences). The subjects are then broken down further into standards which are broken down into benchmarks and finally broken down into indicators all of which students are assessed on. A simplified version of this hierarchical structure is depicted below in the Grade 3 Mathematics subject area.+Exams (aka. assessments) are typically given at various stages of a student's education life cycle (e.g. Grade 3, Grade 6, Grade 8, Grade 12, etc.) and on various subject areas (e.g. English, Local Language, Mathematics, Sciences). The subjects are then organized down further into standards which are organized down into benchmarks and finally organized down into indicators all of which students are assessed on. A simplified version of this hierarchical structure is depicted below in the Grade 3 Mathematics subject area.
  
   * Standard 3.1: Number Sense   * Standard 3.1: Number Sense
Line 54: Line 54:
 ==== Exam Items ==== ==== Exam Items ====
  
-To assess students a number of items (questions) make up an exam. This can be anywhere from 40 items to 100 items. There is no hard rule on the number of items but typically it will be a multiple of 4 since the results are usually compiled into 4 levels of achievement discussed in the next section. And since the analysis is possible all the way down to indicators it is usually required to have 4 items minimum to assess a particular indicator. So for the simplified example above the whole test could have 20 items (a small exam).+To assess students a number of items (questions) make up an exam. This can be anywhere from 40 items to 72 items, but it could be more or less. There is no hard rule on the number of items but typically it will be a multiple of 4 since the results are usually compiled into 4 levels of achievement discussed in the next section. And since the analysis is possible all the way down to indicators it is usually required to have 4 items minimum to assess a particular indicator. So for the simplified example above the whole test could have 20 items (a small exam).
  
   * Standard 3.1: Number Sense   * Standard 3.1: Number Sense
Line 88: Line 88:
  
 For simplicity, the levels of achievement will be referred to as simply Level 1, Level 2, Level 3 and Level 4 for the remaining of this document. For simplicity, the levels of achievement will be referred to as simply Level 1, Level 2, Level 3 and Level 4 for the remaining of this document.
-===== Candidate Count =====+===== Analysis Method - Candidate Count =====
  
 The candidate count analysis can be done at various levels including: The candidate count analysis can be done at various levels including:
Line 126: Line 126:
  
 {{ :exams-module:exams-module-items-candidatecount-by-candidates.png?nolink |}} {{ :exams-module:exams-module-items-candidatecount-by-candidates.png?nolink |}}
 +
 +==== By exam ====
 +
 +From our original example we have the exam for Math Grade 3. This exam as 20 items. Therefore the cut-offs are as below:
 +
 +    * 0 to 5 items correct out of 20 => Level 1
 +    * 6 to 10 items correct out of 20 => Level 2
 +    * 11 to 15 items correct out of 20 => Level 3
 +    * 16 to 20 items correct out of 20 => Level 4
 +
 +What follows is a illustration of how this analysis would be produced. The items for the whole exams are highlighted in blue (all exam items).
 +
 +{{ :exams-module:exams-module-items-candidatecount-by-exam.png?nolink |}}
 +
 +And the resulting chart analysis.
 +
 +{{ :exams-module:exams-module-items-candidatecount-by-exam-chart.png?nolink |}}
  
 ==== By standards ==== ==== By standards ====
Line 155: Line 172:
 ==== By benchmarks ==== ==== By benchmarks ====
  
-From our original example we have three benchmarks. And based on the benchmarks' indicators and their items on the exams we know how many items for each of our benchmark.+From our original example we have three benchmarks. And based on the benchmarks' indicators and their items on the exam we know how many items for each of our benchmark.
  
   * Benchmark 3.1.1: Use place value understanding and properties of operations to perform … [12 ITEMS] with the cut-offs as:   * Benchmark 3.1.1: Use place value understanding and properties of operations to perform … [12 ITEMS] with the cut-offs as:
Line 207: Line 224:
  
  
-===== Indicator Count =====+===== Analysis Method - Indicator Count =====
  
 Candidate count is the simpler more natural way to analyze the results. However, it is not the only way. The indicator count traditionally used in SOE Assessment does it differently. Instead of counting students performing at each levels of achievement for benchmarks, standards and whole exams this methods count the indicators performing at the levels of achievement for benchmarks, standards and whole exams. Candidate count is the simpler more natural way to analyze the results. However, it is not the only way. The indicator count traditionally used in SOE Assessment does it differently. Instead of counting students performing at each levels of achievement for benchmarks, standards and whole exams this methods count the indicators performing at the levels of achievement for benchmarks, standards and whole exams.
Line 213: Line 230:
 <note important>While both the candidate count and indicator count end up with similar results they are not the same analysis!</note> <note important>While both the candidate count and indicator count end up with similar results they are not the same analysis!</note>
  
-How exactly does this work? First, the analysis on indicators must be done and it is done just like in the candidate count method shown above. That is the starting point.+How exactly does this work? First, the analysis on indicators must be done and it is done just like in the candidate count method shown above. That is the starting point and everything else is based on the indicators results. 
 + 
 +==== By exam (whole test) ==== 
 + 
 +Since every single indicator is part of the exam. For the analysis of the whole we count all the Level 1, Level 2, Level 3 and Level 4 for all indicators. Totalling them up should equal the number of student (i.e. i our example  10) multiplied by the number of indicators (i.e. in our example 5), therefore 50. 
 + 
 +{{ :exams-module:exams-module-items-indicatorcount-by-exam.png?nolink |}} 
 + 
 +This then translates into the following analysis. 
 + 
 +{{ :exams-module:exams-module-items-indicatorcount-by-exam-chart.png?nolink |}} 
 + 
 +==== By standards ==== 
 + 
 +For standards, we need to group the indicators into their respective standards as shown in the following figure. And we do a count on those. 
 + 
 +{{ :exams-module:exams-module-items-indicatorcount-by-standards.png?nolink |}} 
 + 
 +This will then translate into the following. 
 + 
 +{{ :exams-module:exams-module-items-indicatorcount-by-standards-chart.png?nolink |}} 
 + 
 +==== By benchmarks ==== 
 + 
 +Similarly to standards, for benchmarks we also group the indicators into their respective benchmarks and count from there.
  
-By exam (whole test)+{{ :exams-module:exams-module-items-indicatorcount-by-benchmarks.png?nolink |}}
  
-By standards+Resulting in the following analysis.
  
-By benchmarks+{{ :exams-module:exams-module-items-indicatorcount-by-benchmarks-charts.png?nolink |}}
  
  
emis_exams_module.1660811500.txt.gz · Last modified: 2022/08/18 08:31 by ghachey