Monday, 25 October 2021, 9:00 PM
Site: Flinders Learning Online
Topic: FLO Staff Support (FLO_Staff_Support)
Glossary: How-to glossary
Andrea Rankin

Quiz - create a drag and drop question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.


Create a drag and drop into text question

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 10: Drag and drop into text question (Colour quiz)
Steps
  1. In the question bank (Administration > Question bank), click Questions, then Create a new question… (You can also do this in Quiz administration > Edit quiz)
    Question bank

  2. Select Drag and drop into text and click Add
    Select drag and drop into text

  3. Supply your question with a Question name (required field) and Question text (required field):  
    In your question text, leaves 'gaps' indicated by two sets of square brackets with a number inside.  This number will indicate the correct choice for that gap
    Type question text
    Type question text
  4. Provide the question a default mark and enter any general feedback (shown to the student after they have completed the question)  
    enter a default mark and type general feedback

  5. Enter Choices:
    Decide whether to shuffle the choices (tick the box or leave unticked).  Shuffling is recommended to prevent student's from surmising the correct answer based on choice order.

    The choice with the same number as the numbered text gap is the correct answer for that gap:
    type choices

  6. To add additional 'incorrect' drag and drop answers, add additional choices that do not correspond to a numbered text gap. (in this example there is no text gap labelled [[4]], thus 'green' will be an additional option that is not the correct answer to any question)
    additional choice

  7. If using multiple choices for each question, it may be useful to Group the choices.  
    Each group will be represented by a different colour, which will apply to both the relevant gap(s) in the text and to the choices for that group. 
    select groups


    select groups
    Avoid using groups in simple questions with only as many choices as correct answers.  In this scenario the use of groups will give away the answers.
    select groups

  8. You can preview the question to check that it works correctly before clicking the Save changes button: 
    Preview

  9. Click Save changes (you can now preview the question by choosing it in the question bank list and clicking the preview icon
     preview icon

Create a drag and drop onto image question

For this question type, you will need to have an image to drag and drop text/images onto. If you source an image from the internet, but be careful about copyright/usage (eg use Creative Commons and check the licensing).

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 2: Drag and drop onto image (Colour quiz) 

Steps

  1. In the question bank (Administration > Question bank), click Questions, then Create a new question…


  2. Select Drag and drop onto image and click Add


  3. Give the question a Category, a Question name (required field) and enter Question text (required field)
  4. Category, Question name and Question text

  5. Decide on the default mark for the question (required field)


  6. Fill in General feedback (students will see this once they have answered the question). You could include the correctly labelled image in this box. Students can then see if/where they made an error. This box is seen by all students regardless of whether their response was correct or incorrect
    General feedback
  7. Select a Background image file and drag and drop it into the box provided, or Choose a file... by searching on your computer (the image should not be larger than 600 pixels width so you may have to resize it). If you are searching the web (eg Google images), for an image be careful about copyright and usage
    background image

  8. Under Draggable items (scroll down), for the Type choose either Draggable image or Draggable text (most likely you will use text). Upload an image, or type text into the textbox that you want dragged to an area of the background image you have uploaded. Choose a Group to give each image or text item (eg 1, 2, 3...). Do this for as many items as are relevant.
    You can also tick the box Shuffle drag items each time question is attempted.
    If you tick the Infinite box, this means choices may be used in multiple locations. 
    Note: within draggable text items, limited formatting of text is possible using <sub> (subscript), <sup> (superscript), <b> or <strong> (bold), <i> or <em> (italics) and <br/> (line break)
    draggable image or text

     If Draggable image is selected:
    Draggable image selection

     If Draggable text is selected:
    draggable text option

  9. In the Drop zones section (scroll up), for Drop zone 1, choose the Draggable item from the pull-down menu (this will be whatever you have entered in the Draggable items section). These items should now appear below the background image you placed in the question.
    drop zones populated
  10. Drag the images/text onto the background image – this will populate the drop zone boxes in the Drop zones section with coordinates
    draggable items dragged to drop zone

  11. Click Save changes (if you miss one of the steps, you will stay in the editing screen and a red highlight will tell you what you have missed)  

  12. In the Question bank screen, the new question should be highlighted. Click on the magnifying glass icon preview iconto the right of the question name to preview the question. Click on the cog icon to edit the question

    preview the question

Quiz - create a fill-in-the-blanks (missing words) question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.


Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic 
  2. View question 1: Select missing words (Colour quiz)

Steps

  1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question
    create a new question button

  2. Choose Select missing words and click Add
    select missing words

  3. Give the question a category

  4. Give the question a name (required field) (this is only seen by teachers – make it something meaningful so when you view the questions in a list, you know what they are about) 

  5. Enter some question text. Where you would like the student to choose the missing word, enter a number on double square brackets, for example [[1]]. Number each gap sequentially starting at [[1]] – that is, [[1]], [[2]], [[3]] etc (required field)
    category, question name, question text

  6. Give the question a default mark (required field)
    default mark

  7. Fill in the choices. Choice 1 is the correct answer for the gap indicated by [[1]], choice 2 is the correct answer for the gap indicated by [[2]], and so on. 
    how to enter the 'correct' asnwers

    Choices with the same value for Group appear in the same drop-down lists (Shuffle)
    Choices - Shuffle boxes

  8. Fill in General feedback for the quiz question

  9. Click Save changes

Quiz - create a matching question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 6: Matching (Colour quiz)

Steps

For this question type, you must provide at least two questions and three answers. You can provide extra wrong answers by giving an answer with a blank question. Entries where both the question and the answer are blank will be ignored.

  1. Under Topic administration > Question bank > Questions, click Create a new question
     create a new question button

  2. Select Matching and click Add
    matching    

  3. Give the question a Category

  4. Give the question a Question Name (required field)

  5. Enter question text (required field)

  6. Decide on the default mark for the question (required field)
    select category, question name, question text, and default mark

  7. Fill in General feedback (students will see this once they have answered the question)
    enter general feedback

  8. Add the text for Question 1 and the answer 
    question 1 - question and answer

  9. Add the text for Question 2 and the answer 
    question 1 - question and answer

  10. Continue adding text for questions and the answer. You can provide extra wrong answers by giving an answer with a blank question

  11. Click Save changes

Quiz - create a multiple choice question (MCQ)

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.


Create an MCQ

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 3: Multiple choice (Colour quiz)
Steps
  1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question
    create a new question

  2. Select Multiple choice and click Add
    multiple choice    

  3. Give the question a category

  4. Give the question a name (this will only be shown to teachers) (required field)

  5. Fill in question text (required field)

  6. Give the question a default mark (required field)
    multiple choice - enter category, question name, question text, default mark
    multiple choice - enter category, question name, question text, default mark
  7. Enter some general question feedback
    general feedback
  8. Choose whether the question has one answer only or multiple correct answers. 'One answer only' means users will only be able to select one box; 'Multiple answers allowed' means users will be able to select more than one box (if there is a specific number of correct answers, you may want to say this in the stem/lead-in sentence: 'Please select two of the following.')
    One or multiple answers

  9. Select whether you want to shuffle the question answers
    Shuffle the choices

  10. Under Answers, fill in the choices
    answers
    If you selected multiple correct answers for the MCQ (see step 8 above), you are advised to give wrong answers negative scores, to discourage students from selecting all options (you should say that they will be penalised for wrong answers in the question stem)
    negative score multiple correct answers

  11. For the correct answer, change Grade to be 100%. If there are multiple correct answers (see step 8 where you would need to have selected 'Multiple answers allowed'), allocate the 100% across all correct options; for example, if there are 2 correct responses allocate them 50% each. (Note: they do not need to have equal weightings)

     incorrect answer    Assign to an incorrect answer  

    correct - one answer only     Assign to a correct answer in a question with one correct answer  

     correct answer in a quiz with multiple correct answers    Assign to a correct answer in a question with multiple correct answers

  12. Click Save settings


Tips for creating MCQs

Bloom's level/s of taxonomy, what the item is testing (descriptor), and distracter plausibility:

Question number x Correct answer (key)
Learning objective  
Bloom's level of taxonomy  
Descriptor What the item is testing
Distracter plausibility A....
B....
C....
Question tips
  • Use a consistent style
  • Use clear and concise wording (can be complex but not complicated)
  • Make the question 'stem' either a direct question or an incomplete statement 
  • Avoid double negatives

You may want to use a 'stimulus' prior to the question – this could include introductory text/context, an image etc.

Answer tips
  • Make the key (right answer) and distracters (wrong answers) approximately the same length, and use similar wording to avoid obvious standouts
  • Keep answers consistent in grammar and logical to the stem (question)
  • 3, 4 or 5 options per answer? There is no set preference, but the more options the harder it is to think up a plausible 'distracter'
  • Avoid using 'none of the above' or 'all of the above' (especially if answers are shuffled!)
  • Use a logical pattern but don't always put the correct answer in the same position
  • Provide good feedback for all options (where relevant)
  • Where possible, ensure that wrong answers represent a common misconception
Open response items
  • Provide information to markers on full credit, partial credit and no credit
  • If not marking for grades, provide good feedback on likely responses 
References and resources

The Centre for University Teaching ran two workshops in 2013 with invited speakers from the Australian Council for Educational Research (ACER):
MacKinnon, Philip, MCQ assessment workshop 24 June 2013
Khoo, Siek Toon, Introduction to measurement concepts and assessment in education
"Bloom" search results (eLearning literature and resources collection) 

   

Quiz - create an embedded answers (Cloze) question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 8: Embedded answers (Cloze) (Colour quiz)

Steps

To set up this question type, you need to generate cloze text. This means that where an answer is required, you will need to generate bracketed instructions so the answer can be marked automatically, and feedback generated. For example:

{1:SHORTANSWER:%0%tertiary#Sorry, that's incorrect~%100%primary#That's correct!~%0%secondary#Not quite, read the question carefully}

This can be a complex process if you are not familiar with it, and it is easy to make a mistake. You could try the Moodle Cloze editor (external resource) which can generate cloze from your text. Once generated, you can copy and paste it into the Question text area in this question.

  1. Open the quiz and either:
    1. Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    2. Open the question bank and click on the Create a new question button

  2. Select Embedded answers (Cloze) and click Add   

  3. Give the question a Category and Question name (required field)
    enter category and question name

  4. Enter question text (this will include Cloze text – see note above) (required field)
    enter question text

  5. Fill in General feedback (students will see this once they have answered the question)
    general feedback

  6. Give a penalty and hint for each incorrect try
    Penalty and hints

  7. Click Save changes

Quiz - create a new question (question types)

1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.


Create in the question bank or in the quiz

NOTE: Before creating questions, you should set up categories in the question bank. Then use one of the two methods below to create questions in those question banks.

1. Create from within the question bank
  1. Navigate to the question bank from your topic’s Topic management menu

  2. Select the category you want the question to be in.

  3. Click on the Create new question button and choose the desired question type

  4. Enter the details of your question.

  5. Save your question. You'll then be taken back to the question bank category where the question is

  6. Click on the Edit link to the right of your question and select Preview to test if it is working as expected

     

    Tip: If you want a series of similar questions, you can duplicate then edit questions

2. Create from within the quiz
  1. Open your quiz
  2. Click on the cog in the top right corner and select Edit quiz


  3. Click on one of the Add links on right side of the page, then select a new question

  4. Enter the details of your question, making sure you choose an appropriate question bank category* for your question

  5. Save your question. You'll then be taken back to your edit quiz page.

  6. Click on Edit to the right of your question and select Preview from the dropdown list to test if it is working as expected
     

    *Note: We strongly recommend that you do not use the category "default for your quiz name" as this category is segregated from the question bank. Questions in that category can't be used in other quizzes and can't be viewed with the main question bank. Storing questions in this segregated category can lead to confusion.


Create a new question (from question types)

Choose a question type and follow the instructions for creating under a category:


Import/export questions

You could also import questions from a file, or export questions to a file – talk to your eLearning support team.

import/export questions


Provide question/quiz feedback


Duplicate (copy) a question

  1. Open the question bank you want to duplicate a question in

  2. Find the question you want to duplicate

  3. Click on the Edit link next to the question and select Duplicate from the menu that appears.
    Duplicate a question (icon)

  4. The question will open in an editing screen, where you can make the changes you want (eg to the Question name) and continue editing

  5. Click Save changes when you have finished editing the question duplicate

  6. The duplicated question will now appear on your list of questions.

Quiz - create a numerical question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

If you are interested in this question type, you may also be interested in Calculated, Calculated multichoice and Calculated simple. To create one of these types, at step 2 (below) select one of these options instead of Numerical. 

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 9: Numerical (Colour quiz)

Steps

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Numerical and click the Add button.

  3. Give the question a Category

  4. Give the question a Category Name (required field)

  5. Enter question text (required field)

  6. Decide on the default mark for the question (required field)
    adding a numerical question - input category, question name, question text, default mark

  7. Fill in General feedback (students will see this once they have answered the question)
    general feedback text box

  8. Select answer 1, the error for getting it wrong, and the grade. Do this for all other correct/incorrect answers
    answer field, error, and grade

  9. Provide feedback for the answer (whether right or wrong)
    answer feedback

  10. Under Unit handling and Units, decide on the configuration (this will only apply if the answer is not a whole number)

  11. Click Save changes

  12. Preview the question to make sure it works correctly

Quiz - create a quiz

1. Plan  |   2. Build   |  3. Test   | 4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

You have added a category to the question bank and created questions

Now you can create the quiz, then add questions to it.



Add the Quiz activity

  1. In the topic, click the Turn Edit On button
    Turn editing on

  2. In the module where you want to add the quiz, click Add an activity or resource
     Add an activity or resource

  3. Select Quiz from the Activities tab


Quiz settings


General

Give the quiz a Name and Description

name and description


Timing

Under Timing, you can choose to give the quiz Open and Close dates. Tick the Enable box to the right of the date you wish to enter, then enter the date.

timing

Timeline block: The 'Close the quiz' date will show to students in the Timeline block.

Depending on the purpose of your quiz, you may want to change the default settings (see below). You can also click the question markquestion mark promptprompt next to some options to find out more about a setting.

You can make the quiz available at different times for different groups or users in the Group overrides or User overrides sections via the Actions menu.

  • Before the opening time, the quiz will be unavailable to students – they will be able to view the quiz introduction but not the questions. Quizzes with start times in the future display both the open and close date to students.

  • After the closing time, students will:
    • not be able to start new attempts and any open attempts will be automatically submitted.
    • still be able to see the quiz description and review their attempts. What they see will depend on the settings you choose for Review options (ticked boxes in the 'After the quiz has closed' column).
Time limit

quiz time clockIf enabled, the time limit is stated on the initial quiz page and a countdown timer is displayed in the quiz navigation block (see image to the right). Once the timer runs out, the quiz is submitted automatically. If the quiz close time is reached before the time runs out, the quiz will be automatically submitted (ie student does not get full time). You can make the quiz timing different for different groups or users in the  Group overrides or User overrides sections via the Actions menu.


Grade

Grade category

If you have categories in your gradebook (eg for a quiz set), select the category you wish the quiz to be in here.

Attempts allowed 

Unlimited (default), 1-10

Your choice here depends on what and how you are testing (ie the purpose of your quiz):

  • If a diagnostic test, then probably choose 1; if a formative test, then maybe more often as the student is in the learning process.
  • If the quiz is shuffled (see Layout) or has random questions (see quiz - add questions), then the student will get a new version for each attempt, useful for practice purposes.

You can change the allowed number of attempts for different groups or users in the Group overrides or User overrides sections of the Administration > Quiz administration settings block.

Grading method

Highest grade (default), Average grade, First attempt, Last attempt

This setting only applies if more than 1 attempt is allowed. If each question builds on the last, you might set it at Last attempt, as you want to see that students are gaining knowledge/understanding progressively.

Grade


Layout

  • Question order: Shuffled randomly – if selected, the order of questions in the quiz will be randomly shuffled each time a student starts a new attempt at the quiz. 
  • New page: You may want to group questions on a particular topic together, but not too many on one page as this will require students to scroll.  It is recommended that you do not use the setting 'never, all questions on one page', as student activity within the quiz will be less frequently logged and less information will be captured regarding the attempt.

Note: You can change how many questions per page (Actions menu > Edit quiz). You can Repaginate (eg 2 per page instead of 1 per page), or select questions and move them to a particular page.

  • Navigation method: leave as Free (default) unless the quiz is building knowledge (last question relates to next question etc).


Question behaviour

  • Shuffle within questions: if Yes (default), the option must also be enabled in question settings (when you create a new question).
  • How questions behave: Deferred feedback (default) – students answer each question and submit the entire quiz, before anything is graded or they get any feedback.

Note: CBM stands for 'certainty-based marking' – if you choose this option, students will need to say how sure they are that the answer is right and will be penalised accordingly. More information about CBM (MoodleDocs)

  • Show more… > Each attempt builds on the last: if multiple attempts are allowed and you set this to Yes, then each new attempt contains the results of the previous attempt, so students can concentrate on just those questions they answered incorrectly last time. If you choose this option, each attempt by a particular student uses the same questions in the same order, independent of randomisation settings. To show a fresh quiz on every attempt, select 'No' for this setting.


Review options

Tick the options you would like to choose from the table. Default settings are After the quiz is closed (if a closing date for the quiz has been set).

review options table


The attempt Will show how the student responded to each question. Note: This must be selected before you can enable 'Whether correct, 'Specific feedback', 'General feedback' and 'Right answer'.
Whether correct Displays whether the response to each question is correct or incorrect.
Marks Reveals the marks awarded to the student and the grade for the quiz. This setting will affect the grade's visibility in gradebook.
Specific feedback Will show the feedback for the response to the answer as set when adding the question to the quiz. Each response to a question can have feedback for both correct and incorrect answers.
General feedback Displays the general feedback for the whole question as set when adding the question to the quiz. You can use the general feedback to give students some background to what knowledge the question was testing.
Right answer Reveals the correct answer to each question, whether the student answered correctly or not. Note: This is a bit inconsistent between different question types. For example, the matching question type shows students which of their responses are correct, but does not tell them the right answer for the ones they got wrong. The short answer and multiple choices question types do tell the student what the correct answer is.
Overall feedback Displays feedback for the entire quiz as set in the quiz settings.

For each of the above settings, you can determine the timeframe when the students will see them:
During the attempt Immediately after the attempt Later, while the quiz is still open After the quiz is closed
These settings are only relevant for some behaviours, like 'interactive with multiple tries', which may display feedback during the attempt. These settings apply for the first two minutes after students have clicked 'Submit all and finish'. These settings apply after students have clicked 'Submit all and finish' and before the quiz close date. These settings apply after the quiz close date has passed. If the quiz does not have a close date, this state is never reached.


Appearance

  • Decimal places in grades: Default is 2. This option determines how many digits will be shown after the decimal point when the grade is displayed. A setting of 0 for example will display grades as integers (whole numbers). 

Note: If you use CBM (certainty-based marking) which deducts marks for not being certain, being wrong about being certain etc, then it makes sense to show the decimal places in grades. Likewise for 'Decimal places in question grades'.

  • Show blocks during quiz attempts: Default is No – this is about usability (better display, no distractions).


Extra restrictions on attempts

These settings may be useful if you are using a FLO quiz as a final exam.

  • Require password: If you specify a password then participants must enter the same password before they can attempt on the quiz. 
  • Require network address: You can restrict access for a quiz to particular subnets on the LAN or internet by specifying a comma-separated list of partial or full IP address numbers (eg 192.168. , 231.54.211.0/20, 231.3.56.211). This is especially useful for an invigilated quiz/exam, where you want to be sure that only people in a certain room are able to access the quiz. 

Note: The Flinders network is not configured to allow restricting access to a given room.

  • Enforced delay between attempts: You can set a time (from seconds to weeks) between the first and second attempt on a quiz. You can also (or alternatively) set a time from seconds to weeks for subsequent attempts after the second attempt (eg you might allow a student to take the quiz twice immediately with no delay, but if they want to improve their score with a third attempt, they are forced to wait a week and use the time for extra revision).
  • Show more…Browser security: the options in this section offer various ways to try to restrict how students may try to 'cheat' while attempting a quiz.  


Overall feedback

Overall feedback is feedback shown to a student after they have completed an attempt at the quiz. You can set the grade boundary (eg 100%, 65%, 50%) and apply appropriate feedback according to the range the student falls within (eg if a student gets below 65% they are referred to more information). This is a useful feature in a formative quiz where students are informing themselves/the teacher what they know/understand.


Common module settings

These settings are only relevant if you have groups and groupings set up in your FLO site. 

  • Group mode: you can choose whether the quiz should be organised by group.
    Note: This only affects the results screen and allows you to filter results based on group enrolment.


Restrict access

None (default), Activity completion, Date, Grade, User profile, Restriction set

For example, you might have a series of quizzes and they need to do one before another – this would be the activity completion option but you would first need to enable completion tracking in the topic settings and quiz activities.


Activity completion

Apply these settings if you have enabled completion tracking for the topic and this activity.

Quiz - create a quiz essay question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

The essay question in quiz requires manual grading (marking).

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 7: Essay (Colour quiz)

Steps

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Essay and click Add
        
  3. Give the question a name (this is seen by teachers only) and fill in the Question text. You will probably want to change the Default mark to a number higher than 1
    enter a category, question name, question text, and default mark

  4. Provide general question feedback
    general feedback

  5. If you want students to upload a file, select Allow attachments and choose a number from the drop-down menu (Note: if students are required to write a long essay as part of a quiz, we strongly recommend they write it in Word and either upload the file or copy and paste into the response box).

    You can also list specific file types (e.g. docx, pdf, etc.) if you want to restrict what types of files students can submit.
    select allow attachments and choose from the drop down menu

  6. Click Save changes

Quiz - create a short answer question

1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

This question type can be tricky if there is more than a one-word answer (which may have spelling problems!), or variations on the answer. You can avoid this problem by:

  • using wildcards (*) – see information below Steps
  • putting in the question stem (Question text) a proviso such as 'Please separate words with a comma' (if a two-word answer) or other similar guidance
  • anticipating the variations and adding those to the answers with 100% as the correct grade for each variation

It would be a good idea to test this question on several users before you try it with students in the real situation, especially if it is assessed.

You can manually mark a short-answer question to avoid these problems.

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 4: Short answer (Colour quiz)

Steps

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Short answer and click Add   

  3. Give the question a Category

  4. Give the question a Category Name (required field)

  5. Enter question text (required field)

  6. Decide on the default mark for the question (required field)
    adding a question - category, question name, question text, default mark

  7. Fill in General feedback (students will see this once they have answered the question)
    general feedback

  8. Select the correct answer and grade
    example answer and grade

  9. Provide feedback for the answer (whether right or wrong)
    feedback

  10. Click Save changes


Using wildcards

You can use the asterisk character (*) as a wildcard to match any series of characters. For example, use:

ran*ing
 to match any word or phrase starting with ran and ending with ing

If you really do want to match an asterisk then use a backslash like this: 

\*
 If you want one question with the two answers fuel and oxygen, you ought to be able to limit the number of variants by writing:
fuel*oxygen
This would accept "fuel oxygen", "fuel, oxygen", "fuel; oxygen", "fuel and oxygen", "fuel & oxygen" "fuel oxygen", "fuel und oxygen" "fuel&&oxygen". It would even accept "fuel or oxygen", "fuel but not oxygen" "fuel|oxygen" .
Example

Here are some answers and scores for a question "What does a rocket burn?"

  1. oxygen*fuel
     with a score 100% 
  2. *fuel*
     with a score 50%
  3. *oxygen*
     with a score 50%
  4. *air*
     with a score 40% 
  5. * 
     with a score of 0%

The order of the answers is important. The answers are evaluated from 1st to last. When a match is found the process stops. If no match is found, the question is scored wrong and the general response is used. It is a good practice to put a wildcard as the last answer so the evaluation process knows what to do when nothing above it matches.

If any answer is the right answer (eg a non-graded open-ended quiz), you could have as the only answer * (worth 100%). This means all answers are acceptable. Make the question worth 0, and if you make the quiz non-graded (i.e. worth 0) it will not appear in the Gradebook. 

Quiz - create a true/false question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz icon This entry relates to the Quiz activity.

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 5: True/False (Colour quiz)

Steps

  1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question
    create a new question

  2. Select True/False and click Add
        true false

  3. Give the question a category

  4. Give the question a Name (required field)

  5. Enter question text (required field)

  6. Give the question a default mark (required field)
    add category, question name, question text, and default mark

  7. Fill in general question feedback
    general feedback

  8. Select the correct answer (true or false)
    correct answer

  9. Enter feedback for response 'true'
    if true

  10. Enter feedback for response 'false'
    if false
  11. Click Save changes

Quiz - edit quiz questions (and regrade quiz)

1. Plan  |   2. Build  |  3. Test   | 4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.



Before the quiz opens

This action relates to the 'Plan' step for Quiz. If, before a quiz opens, you discover that a question requires editing or correction, it can be easily edited. 

  1. Click the Topic Management button (cog icon) on the main menu, then the Question bank link
    Topic management button

  2. Question bank link

  3. Use the Select a category drop-down list and select the category that contains the question
    Select a category drop-down

  4. The questions contained in the category will appear. Locate the relevant question, then select Edit question from the Edit drop-down menu. After making the required changes, click Save changes.
    Edit question

If you discover the error after student access has commenced, it is possible to regrade your quiz. When a quiz question is altered, all instances of that question will be altered (ie if the question is used in another quiz it will also be altered). Students will not be notified of the changes made.



After the quiz opens 

There are two steps to this process – edit the quiz question/s and regrade the quiz.

Step 1. Edit the quiz question/s

To regrade a quiz attempt (once it has already opened and students have attempted it), you will first need to edit the quiz question/s that needs changing. You can either edit the question/s (change mark, add comment) for all students OR for selected students.
Edit a quiz question for all students
  1. Click on quiz link      

  2. Click the Edit quiz link in the Actions menu       
    Edit quiz link

  3. Click on the cog to edit the question
    Edit question cog

  4. Make changes, click Save changes

Edit a quiz question for selected students

  1. Click on the quiz link

  2. Click the Actions menu cog and choose Grades under the Results link
    Grades link

  3. Choose the student and question in the Grades screen (scroll down) and click on the mark link (in the example below, it is 0.25)
    question link

  4. In the next screen, scroll down and click on the Make comment or override mark link
    question level - click on link

  5. Add a comment or change the mark
    comment or override mark screen

  6. Click Save



2. Regrade the quiz

How you regrade the quiz is different depending on whether it has random questions or not.

Quiz with
no random questions

If you change the mark for a question to 0, you don't need to regrade. 

If you adjust an answer (eg in an MCQ), you will need to regrade. You cannot change the question type (eg in an MCQ, you will need to leave it at one answer only, and make two answers correct, both worth 100%, rather than change the MCQ to multiple answers allowed).

  1. Click on the quiz

  2. Click Attempts at the bottom of the screen

  3. Next to Show only attempts tick the box 'that have been regraded/are marked as needed regrading'

    regrade attempts

  4. Click Dry run a full regrade (to see the outcome before you actually regrade – it is not a required step)

    dry run a full regrade

  5. Click on the Continue button once the 'Regrade completed successfully' screen has appeared
    regrade and continue

  6. Once completed, the attempts that need regrading will appear in the regrade column with 'Needed' appearing


  7. Click on the 'Regrade attempts marked as needed regrading' button
    regrade attempts...

  8. Click 'Continue' button once Regrade completed successfully appears
    regrade attempts
  9. To complete the process click Regrade all
    button

  10. Click Continue button once 'Regrade completed successfully' appears. You will now notice that the regrade column disappears, indicating that your quiz has been regraded 


Quiz with random questions

If you need to remark one question you will need to identify which students were given the question, as that particular question could have occurred in any order (eg question 1 for some students but question 4 for others).

Example: If you have a randomised quiz of 20 questions, the problem question could be given in any of the 20 possible positions within the quiz.

  1. In the quiz, click the Actions menu cog and choose Manual grading under the Results link

  2. Click the Also show questions that have been graded automatically link

  3. Locate the problem question for each of the possible question slots and edit however many results there are by clicking on update grades in the Automatically graded column. (The random question has a round symbol next to the question name. random question icon) In the case below, you will need to edit 2 attempts on this question
    questions that need regrading

  4. Once you have edited the question and saved the edits, you will see that this question is no longer automatically graded – you have manually regraded the question
    manual regrade screenshot

Quiz - import questions

1. Plan  |   2. Build  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

You can import quiz questions into the question bank from a text editor (eg Microsoft Word). The instructions below relate to multiple-choice questions (MCQs) in text format only (ie no images etc).

If you need help, contact your local eLearning support team.


Steps

In a text editor

  1. Create your MCQs in a text editor such as Word, using this template (Aiken format). Choose the format for your questions (Option 1 or Option 2) and follow the instructions

  2. Save your MCQ file as a .txt file and save in a UTF-8 format


In your FLO topic

    3. Create a category in the question bank for your questions (if you don't already have one) – this is where your imported questions will be located

    4. From anywhere in the topic, go to the Topic management panel > Topic settings > Import

        If you are inside the quiz, you can also use the cog icon in the top-right corner of the page and select import

Quiz import menu


5. In the 'Import questions from a file' screen, select Aiken format for the File format (suitable for these question types/file type) 

Aiken format 

6. Under General, select the
Import category. Leave the settings Match grades and Stop on error as the default settings ('Error if grade not listed' and 'Yes') 
Import category 

7. Under
Import questions from file, either Choose a file... or drag and drop in the box, and click Import 
Import questions 

8. The next screen will show you the questions you have imported. Click
Continue imported questions 

9. The next screen will show you the question bank category you have put your imported questions into. Check that your questions are there (you can also move them to another category if you want) 

Question bank category


Learn how to add questions (including random questions to a quiz (edit quiz).

Quiz - main entry

Whether you are starting from scratch or working with a quiz already created, using the quiz activity in a topic ideally consists of 5 stages, in a looped process.

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

Quiz iconThe Quiz activity enables a teacher to create out-of-class quizzes comprising questions of various types, including multiple-choice, matching, short-answer and numerical. See Active quiz if you wish to use a quiz in a face-to-face lecture/tutorial (ie in class), with a classroom of computers/tablets/phones (devices). 

Accidentally deleted a quiz?
It's important that you don't use the recycle bin to restore a deleted quiz. Refer to the quiz troubleshooting page, I accidentally deleted a quiz and want to restore it, for further information.

Good practice guides and tip sheets

Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to quiz-related resources are provided below. 

Assessment principles | Designing online quizzes to minimise collusion | Incorporating Socratic questions into your FLO site | Aligning quiz questions with Bloom's taxonomy | Using FLO quizzes with large student numbers | Inspirational and engaged teaching | Policy implications for assessment design | Providing constructive feedback in FLO



1. Plan your quiz

The better your planning, the less likely you are to run into a problem once students start doing the quiz. Therefore, it is advised that you have a process for creating your quiz. Your college may have policies or guidelines around quizzes. Whether you are starting from scratch or revising a current quiz, these concepts, planning questions and tips that may help:

  • What is your quiz's purpose? The answer will determine the settings you choose when you create the quiz. 
  • What principle/knowledge are you testing – does the quiz item test it? 
  • Line up quiz questions against the learning outcomes (you could include this information in the quiz question)
  • Connect the questions with Bloom's level/s of taxonomy (Wikipedia) – again, what is being tested? 
  • Be creative – you could use scenarios, embed videos/other resources, provide learning pathways (eg hints, tips, more information, think again) 

Follow the links below to start the process.



2. Build your quiz

You have planned your quiz – its purpose (which determines quiz settings), the category/ies and questions, the feedback you will provide. Now you are ready to set up the quiz.

    1. Create a quiz
    2. Add questions to a quiz (edit quiz) – including random questions
    3. Edit quiz questions (and regrade quiz) 
    4. Calculate a topic total including the best X from Y grades – if you have multiple (eg weekly/two weekly) quizzes in a topic and want to count the best 8 out of 10 (for example)


    3. Test your quiz

    You've created your quiz and added questions. If you are confident the quiz is ready, it is a good idea to preview it to see if it works before making it available to students. When you preview the quiz, you will experience it as a student.



    4. Administer your quiz

    While the quiz is open, you can view how students are progressing (submitted or not, how many attempts so far etc). Once the quiz has closed, you can finalise the grades.



    5. Review your quiz

    Reviewing your quiz (question validity, student experience and learning outcomes, alignment with topic learning outcomes) entails collecting data, analysing the data, and acting on it. Your data may also include student feedback – verbally and electronically. This step feeds into future quiz planning (step 1).


      Training and support

      Troubleshooting

    Training

    Quiz workshop

    Support

    eLearning support teams

    You may have one of the following issues:

    Quiz - manually mark/grade essay (or other) questions

    1. Plan  |   2. Build  |  3. Test   |  4. Administer  |  5. Review  ||  Support

    quiz iconThis entry relates to the Quiz activity.

    Your quiz may have a range of question types, including essay and/or short answer. The Essay question is the only one designed for manual grading.
     


    Manually grade automatically graded questions

    If you want to manually grade questions other than the essay question (eg the Short answer question type), you will have to override the automatic mark for that question. 

    1. Click on the quiz to view in a new screen

    2. Click on the Actions menu cog in the top right corner, then select Manual grading

    3. Click on Also show questions that have been graded automatically (above the table of questions and grades)

    4. In the next screen, find the Already graded column and click on the Update grades link
      Update grades

    5. Use the Options section to choose which questions to mark and the order in which they appear

    6. Underneath the Options, you will see a list of student responses to be marked. Update each entry and save the changes


    Manually grade an essay question

    The Manual grading report enables markers to manually grade written submissions within a quiz. This grading method is automatic for the Essay question type (irrespective of what the quiz is set to).

    1. Open the quiz, click on the cog in the top right corner, then select Manual grading

    2. In the Questions that need grading screen, click on the grade link in the To grade column
      Questions that need grading - to grade column

    3. Use the Options section to choose which questions to mark and the order in which they appear

    4. Underneath the options, you will see a list of student responses to be marked
      Student response to be marked 

    5. Click Save and go to next page when you have finished marking all those displayed. When you have marked all of the questions, you will be prompted to return to the Questions that need grading screen, with the responses that you marked now appearing in the Already graded column.
      All selected attempts have been graded 

    Quiz - provide quiz feedback at quiz and question level

    1. Plan  |   2. Build  |  3. Test   | 4. Administer  |  5. Review  || Support

    quiz iconThis entry relates to the Quiz activity.

    Providing feedback is an excellent way to increase student engagement when they attempt and review a quiz. Feedback can be customised to address particular student responses to a question, the question more generally, or the total score achieved by the student. It can be delivered during the quiz, after the attempt but before the quiz has closed, or after the quiz has closed. The amount and quality of feedback you provide will depend on the quiz's purpose.  

    • Inclusion and release of feedback can increase the complexity required in quiz set-up. For help, please contact your local eLearning support team.

    • Release of feedback to students is controlled by the quiz Review settings in conjunction with the Question Behavior setting. Please see 'I can't unhide the Grade column for a quiz' (Quiz - troubleshooting entry) for further information.

    Good practice guides and tip sheets

    Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to quiz-related resources are provided below. 

    Inspirational and engaged teaching


    The three types of feedback – specific, general and overall

    • Specific feedback is feedback specific to, and dependent upon, the response the student gave to a question. It is response-specific.
      Specific feedback is set up at the question level – when creating the question or later by clicking the edit cog  edit cog beside the question

    specific feedback set-up

    Student view:
    specific feedback

    • General feedback is feedback shown to the student after they have completed the question. The same feedback is shown for all students, regardless of the response they gave. You can use the general feedback to give students a fully worked answer and perhaps a link to more information they can use if they did not understand the question.
      General Feedback is set up at the question level – when creating the question or later by clicking the edit cog   edit cog  beside the question

      general feedback

      Student view:
      general feedback - student view

    • Overall feedback is the text that is shown after a quiz has been attempted. By specifying additional grade boundaries (as a percentage or as a number), the text shown can depend on the grade obtained
      Overall Feedback is set up in the quiz's settings 
        In the scenario below, students scoring between 100% and 80% will see the message 'Well done'.  Those who scored between 79.99% and 0% will see            the message 'Please study this week's work again' (100% and 0% do not need to be entered, as they are the default grade boundaries):

    overall feedback overall feedback

    Student view:
    overall feedback - student view


    Quiz - purpose and settings

    1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

    quiz iconThis entry relates to the Quiz activity.

    These quiz setting guides focus on ways you might want to use the Quiz activity. Where relevant, they link to related quiz entries for further details.

    Good practice guides and tip sheets

    Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to quiz-related resources are provided below. 

    Aligning quiz questions with Bloom's taxonomy | Using FLO quizzes with large student numbers

     


    Self/skills assessment quiz (non-graded)

    Where there is no right or wrong answer 

    The quiz is not assessed. You and your students could use it as a learning tool to assess their knowledge and/or skills, or identify gaps. Students could also 'self-assess' and/or determine their self-efficacy or self-confidence. Feedback on their question answers could personalise support through linking to resources University-wide or providing resources specific to the topic. View the quiz example set up for this purpose.

    Quiz settings 

    Actions menu > Edit settings

    • Grade to pass: 0.00
    • Attempts allowed: Unlimited/1 (depending on purpose)
    • How questions behave: Deferred feedback
    • Review options: The attempt 

    Edit quiz 

    Actions menu > Edit quiz

    Change the maximum grade in the quiz itself to 0 (default is 10). The quiz will function as normal, but the quiz will not appear as a grade item in gradebook.

    • Maximum grade: 0.00 (‘Editing quiz’ screen)

    Question settings

    • Each choice option (MCQ) worth 100%
    • Question is worth 0 (default mark)
    Gradebook

    Topic Management > Topic Settings > Gradebook setup

    Check the gradebook. To make a quiz item worth 0 in the gradebook, change the weighted mean of grades to 0 for that item (Gradebook setup > Setup > Weights), if required.

     


    Practice quiz (non-graded)

    Where there are right and wrong answers 

    The purpose of the quiz is other than to grade. You might use it as a learning tool to give students a way to test their knowledge as the weeks progress. Providing feedback that they can action or understand at a deeper level will be helpful. It is also a teaching tool to see how students are going, whether there is a gap in understanding for one/many, whether a deeper level of engagement is required (e.g. more resources, more class time).

    Quiz settings

    Actions menu > Edit settings

    • Grade to pass: X.00 (choose any number between 0 and 10) – if using activity completion and/or restrict access, otherwise leave blank
    • Attempts allowed: Unlimited/1... (depending on purpose)
    • How questions behave: Deferred feedback; interactive with multiple tries...
    • Review options: The attempt; Whether correct, Specific feedback, General feedback, Overall feedback (suggestions only) 

    Edit quiz

    Actions menu > Edit quiz

    Maximum grade: Change the maximum grade for the quiz to the total of all questions (e.g. for 4 questions worth 1, 2, 2 and 4 the maximum grade would be 9). FLO will calculate a final grade according to the weighting for the quiz in the gradebook. Both student and teacher will be able to see what they got for the quiz (x out of x).

    Question settings

    • Question is worth 1 (default mark) or whatever you think it is worth
    • MCQ: With 1 correct answer (one answer only option), this answer must be worth 100%; with multiple correct answers (multiple answers allowed option), they must add up to 100% (e.g. if there are 2 correct answers, each would be worth 50%). See Create a multiple choice question (MCQ) for more details.
    Gradebook

    Topic Management > Topic Settings > Gradebook setup

    Check the gradebook. To make a quiz item worth 0 in the gradebook, change the weighted mean of grades to 0 for that item (Gradebook setup > Setup > Weights).

     


    Formative quiz (graded or non-graded)

    Where students are given the opportunity to extend their knowledge/understanding through feedback and prompts

    The purpose of the quiz may be to grade/not grade. If you do not intend to grade the quiz, refer to the settings for non-graded quizzes above.

    Interactive with multiple tries

    You can use the 'Interactive with multiple tries' settings to give students a rich experience with learning pathways – they can choose to extend their learning or correct their learning in an informed way, through feedback that provides links to resources or embeds resources such as videos or images. Hints are provided with this setting to enable students to try again (if more than one try is enabled). Rich feedback deters students from guessing. If grading this quiz, you can set a penalty for requiring a hint, if set to multiple tries.

    Quiz settings

    • Attempts allowed: Unlimited (if you want to restrict the number of attempts, the number of hints is one less than the number of attempts) 
    • How questions behave: Interactive with multiple tries
    • Review options: During the attempt; Immediately after the attempt; Later, while the quiz is still open

    User experience

    If the quiz setting for Question behaviour > How questions behave is 'Interactive with multiple tries', the student can see a Check button once they have answered a question. They can reattempt the question by clicking 'Try again' and selecting another answer. You can provide both Specific feedback (answer choice) and General feedback (on the question as a whole) to help the student.

    When the student finishes the quiz, they get a prompt to 'Return to attempt' or 'Submit all and finish'.

    When the student finishes the quiz, they can also click on a 'Review' link (depending on the boxes ticked under Quiz settings > Review options) and see their answers to one/more attempts. They then get the option to 'Submit all and finish'.

    Once they 'Submit all and finish', they receive the Overall feedback (quiz settings) if any is provided.

    They can go back in later and review their quiz responses (Quiz settings > Review options). This is handy if they want to remember something about their responses but do not want to do the quiz again (they may not have this option anyway).

     


    Summative quiz (graded)

    Where students are tested on their knowledge/understanding for grading purposes

    A summative quiz is likely to test a body of work so could be set to occur near the end of the topic, or at the end of a module. It will be listed in the Statement of Assessment Methods as a grade item valued at a percentage of the final grade. Because it is testing the student, they have less options when they do the quiz. They may receive feedback for each question, but are unlikely to be able to do the question again. Overall feedback for the attempt is a key area to support the student's learning. 

    Deferred feedback

    With this setting, students must enter an answer to each question and then submit the entire quiz, before anything is graded or they get any feedback. While all review options are editable, you would not choose the Review option 'Later, while the quiz is still open' for a graded quiz.

    Quiz settings

    • Attempts allowed: 1 
    • How questions behave: Deferred feedback
    • Review options: After the quiz is closed (all options ticked by default). If there is a possibility that students may request extensions/overrides, you can leave all the review options turned off until you are confident all students have attempted the quiz. You may decide to only show the Marks once the quiz is closed.
      After the quiz is closed After the quiz is closed - marks


    In the quiz settings, you can decide on how much Overall feedback to give students at the end of the quiz. You could use grade boundaries to tailor feedback.

    User experience

    If the quiz setting for Question behaviour > How questions behave is Deferred feedback, this is what happens when the student attempts a question. When they attempt a question, they may get feedback for their response, depending on how you have set up the individual question, but will move through the quiz without reattempting a question.

    When the student finishes the quiz, they get the prompt to 'Submit all and finish'.

    Once students click 'Submit all and finish', they receive the Overall feedback (quiz settings).

    Students can go back in later and review their quiz responses (Quiz settings > Review options). This is handy if they want to learn from their responses, perhaps for a final assessment item.

     


    Short-text response quiz (graded)

    Where students are manually graded on their submitted text answers (< 300 words is a guide)

    To set up this type of quiz (it may only be one question that requires manual grading), you need to create an essay question.

    Quiz - troubleshooting

    1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

    quiz iconThis entry relates to the Quiz activity.

    Questions/problems



    I can't see questions from other quizzes

    If you create a quiz, then add 'a new question' rather than add 'from question bank' (Actions menu > Edit quiz screen), you may stumble into this problem. If you leave the Category as 'Default for [topic name]' or choose another category that you have already created, there won't be a problem. But if you choose the category ‘Default for [quiz name]’ from the pull-down menu, the questions will belong to the quiz and you won't be able to see or use them for any another quiz in the topic (e.g. in a revision quiz, or an end-of-topic exam that draws from questions used in formative quizzes throughout the topic).


    Solution to prevent this problem

    Do one of the following:

    • Option 1: Go to the Question bank from your topic homepage (Topic Management > Question bank). Create a category and questions first, before you create the quiz, then add questions into your quiz 'from question bank'

    • Option 2: Create a category, then create the quiz and 'add a new question', making sure the new question is saved in the category you created

    Note: We strongly advise option 1 as the best approach to creating quizzes. See Add a category to the question bank for more information.


    Solution if you have this problem

    If you already have this problem and need to use your questions in other quizzes:

    1. From your topic home page, go to Topic Management > Question bank > Categories
    2. Create a new category (probably best to make the parent category 'top')
    3. Go to your existing quiz, then Actions menu > Question bank
    4. Select all questions which are in the quiz's default category, then using the 'With selected' menu at the bottom of the page, move to your new category

    Note: Questions can be moved to different categories even if they are already used in quizzes, though be careful if they are used as random questions in a quiz.



    I can't unhide the grade column in gradebook for a quiz

    Quiz results visibility settings are controlled within the settings of the quiz activity, not in the gradebook. 

    Check the Marks setting for Later, while the quiz is still open and/or After the quiz is closedPlease see the entry Create a quiz and scroll down to Review options for further information.



    I can't add/delete questions in my quiz

    Once a quiz has been attempted, no additional questions may be added to that quiz, and no questions can be deleted (removed).

    The following message will display on the Editing quiz screen (Actions menu > Edit quiz).

    Cannot add or remove questions message

    You can, however, delete questions if no attempts have been made. To delete multiple questions (Actions menu > Edit quiz):

    1. Click the Select multiple items button
    2. Click the Select all button or select individual questions
    3. Click the Delete selected button
      Delete questions
    4. You will be asked to confirm that you want to removed the selected questions, so check these are the questions you want deleted
    5. Click the Yes button



    I have assigned answers to a quiz question incorrectly

    If, before a quiz opens, you discover that a question requires editing or correction, it can be easily edited. Enter the Question bank and locate the relevant question. Select Edit question from the Edit drop-down menu for the question. After making the required changes, click Save changes.

    If you discover the error after student access has commenced, it is possible to regrade your quiz. To regrade a quiz attempt you will first need to edit the quiz question that needs changing. When a quiz question is changed, all instances of that question will be altered (e.g. if the question is used in another quiz, it will also be altered). Students will not be notified of the changes made. Refer to the Edit quiz questions (and regrade quiz) entry.



    I accidentally deleted a quiz and want to restore it

    What you should do

    If you accidentally delete a quiz and want to restore it, you can either:

    • recreate the quiz – deleting the quiz activity does not delete the questions from the question bank (the original questions are available to use)
    • contact your local eLearning support team to discuss if it's possible to restore the quiz from a previous availability.
    What you should not do

    You may be aware that you can restore deleted activities from the recycle bin, however, this is not recommended for quizzes. Restoring a quiz from the recycle bin will duplicate the question bank (make a copy of each question). If quizzes in your topic use random questions, students may receive the same question more than once. If you've restored a quiz from the recycle bin you will need to delete the duplicate questions before any quiz with random questions opens. Duplicate questions have '(copy)' appended to the question name.

    If you need help, contact your local eLearning support team.

    Quiz - view results and reports

    1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

    quiz iconThis entry relates to the Quiz activity.

    The following quiz reports are available in FLO. Generating and interpreting these reports can help you refine your quiz and question bank for the next cohort/overtime.

    • Grades report: Shows all the students' quiz attempts, the overall grade, and the grade for each question. There are links to review all the details of a student's attempt, just as the student would see it (student view)

      Useful for
       tracking student progress, identifying students at risk, identifying problem questions (either difficult or badly designed) or easy/difficult questions (by time taken)
    • Responses report: Similar to the Grades report, except that it shows the responses the students gave, rather than the marks they earned. It is also possible to show the question text or the right answer, to compare with the student's response. This is helpful when the question is randomised

      Useful for identifying student misunderstandings (individual and common), gaps in their knowledge
    • Statistics report: Gives a statistical (psychometric) analysis of the quiz, and the questions within it. The front page gives a summary of the whole quiz. Links drill down to a detailed analysis of specific questions

      Useful for analysing individual questions and question behaviours (e.g. random guess score) but you will need to understand statistical terminology
    • Manual grading reportAllows the teacher to manually grade questions in the quiz 

      Useful for online marking of essay questions (more a marking facility than a report) – these can't be automated like other formats for questions (eg multiple choice). You can also mark short answer questions if required



    Steps

    1. In the topic, click on the Quiz activity
      Quiz

    2. Click the Actions menu cog. Under Results choose from the four report options: Grades | Responses | Statistics | Manual grading
      quiz results


    Grades report

    The Grades report tells you about student quiz attempts, displaying the overall grade, and a summary of each correct/incorrect answer. It also reports on the State (student progress through a quiz), the time the quiz was started/completed and the total time the student took to complete it. You can re-grade quiz attempts by selecting Re-grade selected attempts. A bar graph summarises the grade range and frequency.

    1. Click the Administration tab > Quiz administration > Results > Grades
      grades

    2. In the What to include in the report section, choose the required settings

    3. Click Show report
      grades report includes

    4. If graph marks distribution is chosen, it will display at the bottom of the page below the student results.

    5. You can download the results in a variety of formats (Comma-separated values text file, Excel spreadsheet etc) 

    6. Checkboxes allow you to individually regrade or delete the selected attempts

    7. Each question's marks is hyperlinked to allow you to view the student's response

    Quiz grades report data

     


    Responses report

    The Responses report is visually similar to the Grades report, but it shows the responses students gave to quiz questions, not the marks they earned. You can view the question text/correct answer to compare students' responses.

    1. Click the quiz link > cog icon > Results > Responses
      response

    2. Use the setting form (What to include in the report) at the top of the page to control what is displayed (enrolled users who have attempted the quiz; enrolled users who have not attempted the quiz etc)

    3. Click Show report
      responses display choices

    4. At the bottom of the page is a graph showing the distribution of scores

    5. You can download the results in a variety of formats (Comma-separated values text file, Excel spreadsheet etc)

    6. Checkboxes allow you to delete the selected attempts

    responses report data



    Statistics report

    The Statistics report provides a statistical ('psychometric') analysis of the quiz and the questions. The report has three sections:

    • a summary of the whole quiz
    • an analysis showing all questions in table format
    • a bar graph of the percentage of correct answers (the 'Facility index') and the 'discriminative efficiency index'.

    To get the report:

    1. Click the quiz link> cog icon > Results > Statistics
      statistics

    2. In the Preferences just for this page, choose whether you want to calculate statistics from the highest graded attempt, all attempts, first attempt or last attempt.

    3. Click Show report
      Calculation settings

    4. You can download the full report in a variety of formats (Comma-separated values (.csv) file, Microsoft Excel (.xlsx) spreadsheet etc)

    5. The summary page (Quiz information) is shown below
      statistics options

    6. The Quiz structure analysis page is shown below

      structure analysis

    7. The bar graph (Statistics for question positions) is shown below

      the bar graph

    8. Click on a question in the Question name column. In the Preferences just for this page, choose whether you want to calculate statistics from the first attempt or all attempts, and click Show report to go to a detailed report for that question, as shown below

      statistics question analysis

      question statistics

    9. The table (Analysis of responses) is shown below

      bar graph statistics

    Self and peer assessment - main entry

    For assistance in using the self and peer assessment activity, please contact your local eLearning support team.

    Good practice guides and tip sheets

    Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to assignment-related resources are provided below.

    Communication, interaction and collaboration tools in FLO

    self & peer assessment (workshop) iconSelf and peer assessment are valuable learning experiences for students if scaffolded well. Discussion about the process (as well as rubrics or other guides) is helpful so that students are comfortable assessing their peers and supported to do so. These two types of assessment are examples of authentic learning – self-assessment helps students in their life post-study (particularly in the workplace, where reflection plays a strong role in the performance and professional development), and peer assessment helps students to critically but constructively examine the ideas and opinions of others (also workplace relevant). Peer review aligns with a critical review of academic and other educational resources.

    The self and peer assessment activity in FLO enables the collection, review and peer assessment of students' work. Students can submit any digital content (files), such as documents or spreadsheets, and can also type text directly into a field using the text editor.

    Submissions are assessed using a multi-criteria assessment form defined by the teacher. Students are given the opportunity to assess one or more of their peers' submissions, and can also perform self-assessment. Submissions and reviewers maybe anonymous if required.

    Students obtain two grades in this activity – a grade for their submission and a grade for their assessment of their peers' submissions. Both grades are recorded in the gradebook.


    How the activity works

    This short (18 mins) video provides an overview – workflow, setup, tips etc (Workshop module = Self and peer assessment activity):

    Timeline block:
    • The 'Submissions deadline' will show to students in the Timeline block, as 'deadline for submission'
    • The 'deadline for assessment' will show to students in the Timeline block, as 'deadline for assessment'
    • If a deadline date is not used but its corresponding opening date is used, the opening date will show instead.


    Create a self and peer assessment activity

    There are currently two ‘self and peer assessment’ activities available in FLO. We recommend that you use the Enhanced self and peer assessment activity as it has more features than the ‘Workshop (Self and peer assessment)’ activity. The former, developed at the University of New South Wales (UNSW), is a modified (enhanced) version of the latter.

    Written documentation for the FLO Staff support is still in development. In the meantime, please refer to UNSW’s step-by-step instructions on creating a self and peer assessment activity (course home page = topic home page). The ‘Workshop (UNSW)’ activity is the Enhanced self and peer assessment activity in FLO:

    Enhanced self and peer assessment