The following quiz reports are available in FLO. Generating and interpreting these reports can help you refine your quiz and question bank for the next cohort/overtime.
Grades report: Shows all the students' quiz attempts, the overall grade, and the grade for each question. There are links to review all the details of a student's attempt, just as the student would see it (student view)Useful for tracking student progress, identifying students at risk, identifying problem questions (either difficult or badly designed) or easy/difficult questions (by time taken)
Responses report: Similar to the Grades report, except that it shows the responses the students gave, rather than the marks they earned. It is also possible to show the question text or the right answer, to compare with the student's response. This is helpful when the question is randomised Useful for identifying student misunderstandings (individual and common), gaps in their knowledge
Statistics report: Gives a statistical (psychometric) analysis of the quiz, and the questions within it. The front page gives a summary of the whole quiz. Links drill down to a detailed analysis of specific questions Useful for analysing individual questions and question behaviours (e.g. random guess score) but you will need to understand statistical terminology
Manual grading report: Allows the marker to manually grade questions in the quiz Useful for online marking of essay questions (more a marking facility than a report) – these can't be automated like other formats for questions (eg multiple choice). You can also mark short answer questions if required
Access the Quiz reports
In the topic, click on the Quiz activity
Click the Actions menu (cog icon) in the top-right corner of the page
Under Results choose from the four report options: Grades | Responses |Statistics |Manual grading
Grades report
The Grades report tells you about student quiz attempts, displaying the overall grade, and a summary of each correct/incorrect answer. It also reports on the State (student progress through a quiz), the time the quiz was started/completed and the total
time the student took to complete it. You can regrade quiz attempts by selecting Regrade selected attempts. A bar graph summarises the grade range and frequency.
What to include in the report settings
Setting
Description
Attempts from
Select from:
enrolled users who have attempted the quiz (default)
enrolled users who have not attempted the quiz
enrolled users who have, or have not, attempted the quiz
all users who have attempted the quiz
Attempts that are
Tick the checkboxes as required to include in the report attempts that are:
In progress
Overdue
Finished
Never submitted
If the quiz has been set up to allow multiple attempts, you can choose to show at most one finished attempt per user (tick the checkbox).
Show only attempts
Tick the checkbox to show only attempts that have been regraded / are marked as needing regrading.
Display options settings
Setting
Description
Page size
Specify the number to user attempts to display per page
Marks for each question
Yes – show marks for each question in the report
No – hide marks for each question in the report
Show average marks
Enables the display of question average marks in the last row of the report
Graph marks distribution
Enables the display of the marks distribution graph at the end of the report
After selecting the required options, click Show report
You can download the results in a variety of formats (Comma-separated values text file, Excel spreadsheet etc)
Checkboxes allow you to individually regrade or delete the selected attempts. Before regrading attempts, you would edit the quiz question(s) first.
Each question's marks is hyperlinked to allow you to view the student's response
To review responses made by a particular student, click Review attempt under that student's name in the table.
Responses report
The Responses report is visually similar to the Grades report, but it shows the responses students gave to quiz questions, not the marks they earned. You can view the question text/correct answer to compare students' responses.
Click the Quiz link > Actions menu (cog icon) > Results > Responses
Use the setting form (What to include in the report) at the top of the page to control what is displayed (enrolled users who have attempted the quiz; enrolled users who have not attempted the quiz etc)
Click Show report
You can download the results in a variety of formats (Comma-separated values text file, Excel spreadsheet etc)
Checkboxes allow you to delete the selected attempts
Statistics report
The Statistics report provides a statistical ('psychometric') analysis of the quiz and the questions. The report has three sections:
a summary of the whole quiz
an analysis showing all questions in table format
a bar graph of the percentage of correct answers (the 'Facility index') and the 'Discriminative efficiency'.
To get the report:
Click the Quiz link> Actions menu (cog icon) > Results > Statistics
In the Preferences just for this page, choose whether you want to calculate statistics from the highest graded attempt, all attempts, first attempt or last attempt.
Click Show report
You can download the full report in a variety of formats (Comma-separated values (.csv) file, Microsoft Excel (.xlsx) spreadsheet etc)
Click on a question in the Question name column. In the Preferences just for this page, choose whether you want to calculate statistics from the first attempt or all attempts, and click Show report to go to a detailed report for that question, as shown below.
The last section of this report is a bar graph of the percentage of correct answers (Facility index) and the Discriminative efficiency.
Facility index (F): The mean score of students on the question (see table below for interpretation)
Discrimination efficiency: This statistic attempts to estimate how good the discrimination index is relative to the difficulty of the question.