Learn: Quiz and Item Analysis

Quiz and Item Analysis

Overview

The Quiz and Item Analysis Reports provide information about how students performed on a New Quizzes quiz, overall, and on each question.

To access the reports, open the quiz builder and click the Reports tab.

Animated gif showing how to find the Quiz and Item Analysis by going to the quiz options, choosing Builder, and then clicking on the Reports tab

Quiz Analysis

The Quiz Analysis includes statistics for overall quiz scores for students who have submitted the quiz.

Quiz Analysis chart in New Quizzes

In addition to the grade distribution graph [a], the following statistics are available:

  • High Score [1]: displays highest percentage score
  • Low Score [2]: displays lowest percentage score
  • Mean Score [3]: displays average percentage score
  • Standard Deviation [4]: represents the amount of variation from the mean score
  • Mean Elapsed Time [5]: displays average time to complete quiz
  • Cronbach’s Alpha [6]: measures internal consistency of how closely related a set of items are as a group. Recommended reading: Cronbach’s Alpha: Definition, Calculations & Example Links to an external site.

Item Analysis

Item Analysis is provides the statistics of student responses to individual quiz questions with the intention of evaluating quiz quality. It is a tool that can be used to uphold quiz effectiveness and fairness.Statistics that are available in New Quizzes Item Analysis

The following item analysis statistics are available:

  • Difficulty Index [1]: measures the proportion of students who answered the question correctly. Calculated by dividing the number of correct answers by the number of times the item was included in the quiz.
  • Discrimination Index [2]: measures how well a question can tell the difference between students who do well on the exam and those who do not. True/False and Multiple Choice question types include the discrimination index. It determines how well a single question can tell the difference between those groups of students. Calculated by subtracting the bottom 27% of difficulty index scores from the top 27% of difficulty index scores.
  • RPB (Point-Biserial Correlation Coefficient) [3]: measures the correlation between a given item and the total score.
  • Mean Earned Score [4]: displays average point score.
  • Answer Frequency Summary [5]: displays the number and percentage of students who selected each answer choice. Note: This number is based on the number of students who have taken the quiz at the time the data was updated, which could be up to 48 hours from the time it is being viewed.
  • Performance by Quintile bar chart [6]: displays the number of students who scored within each percentage quintile.

To expand or collapse the Item Analysis for each question, click the arrow icon [a].

COMPARE: Quiz Statistics in Classic vs. Quiz and Item Analysis in New Quizzes

Practice

If you would like access to a sandbox course with demo quizzes and student submissions in order to view and test the New Quizzes Reports functionality, please send an email to bruinlearn-support@it.ucla.edu with the following message:

Please add me to the New Quizzes Sandbox with the Teacher role. My UID is [add your UID here].

Please allow up to 24 hours for processing. Once you are added, you will receive an email invitation with a link to join the sandbox. 

Resources