Tuesday, 27 July 2021, 9:25 PM
Site: Flinders Learning Online
Topic: FLO Staff Support (FLO_Staff_Support)
Glossary: How-to glossary
Q

Quick tour (video)

Quiz - add a category to the question bank

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

  • All questions are stored within the question bank
  • Categories are created in the question bank and are used to organise questions
  • Sorting questions into categories is especially important when random questions are used or a topic contains many quizzes 
  • When a quiz delivers random questions, those questions must be stored in a dedicated category (or sub-category)

If you add a category before you add questions to the question bank, all questions created can be added to this category and they will then belong to the topic, rather than the quiz. This approach will make management easier when you are creating new quizzes using questions from previous quizzes. 

Categories can be created within an existing category (ie a sub-category). 


Steps

  1. Go to Topic Management > Question > Category
    In the question block, select categories
  2. Scroll down the screen (categories may already be listed, that you can edit) you will see the option Add category

  3. Choose a Parent category from the pull-down list (defaulted to your topic name) – you are most likely to leave it at your topic name, but you could also add a sub-category within an already created category
    Add Category
  4. Give the category a Name

  5. Add Category info (optional)
  6. In the question block, select categories
  7. Click ID number (optional) 
  8. Click Add category button

  9. The new category should be listed under the relevant Parent category
    Question categories

  10. Once created, you can also Edit categories (rename, add/change category info), delete, re-order and indent (make into a subcategory).

Quiz - add questions (including random questions) to a quiz (edit quiz)

1. Plan  |   2. Build   |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

If you want to add questions from a text file rather than creating them in the question bank (this can save time), see Import questions (multiple choice in a text file). Contact your eLearning support team if you need assistance with this process.


Steps

  1. Add questions (and shuffle if you want) (Build step)
  2. Add random questions to a quiz (if required) (Build step)
  3. Add a module heading (if required) (Build step)

1. Add questions
  1. Click on the quiz you have created

  2. If no questions have been added to the quiz yet, you will see image on the left, and clicking the Edit quiz button will take you to the edit quiz page. If your quiz already has questions, the screen will have a preview quiz button instead (the image on the right).

    A quiz without any questions added
    A quiz with questions added

    To access the edit quiz page for a quiz that already has questions, go the quiz administration menu > edit quiz          

  3. Click the Add link. You  can also tick the Shuffle box so that the order of questions you add to the quiz is randomised at each attempt
    click Add
  4. Click the from question bank option. (You can also select a random question – see below)    
    click from Question bank
  5. Select a category when the questions are located, or search for tags that your questions have been tagged with.

    Choose a category or search for tags

  6. Click the box next to the questions, click Add selected questions to the quiz.  
    add question to quiz

2. Add random questions to a quiz (if required)

You may want to add random questions to the quiz so that students don't get all the same questions at the same time. To do this you need extra questions in your question bank (eg if you have 20 questions in the quiz, you will ideally need an extra 10).

  1. Follow steps 1-3 above. At step 4, choose + a random question

  2. Select a category when the questions are located, or search for tags that your questions have been tagged with.

    Choose a category or search for tags

  3. Select the number of questions you wish to add and click Add random question
add 2 random questions to quiz


3. Add a module heading (if required)

If you have a number of questions (eg > 10) and it would make sense to group them, you can add a module heading. With a quiz of 20 or more questions using free navigation, headings may be particularly helpful to the user.  Another use for modules could be to shuffle questions within sections rather than shuffling all questions throughout the quiz.

  1. To add a heading above the first question, click the pencil above the question, type the heading title, then press Enter
  2. add a module heading (first one)

  3. If you want to add a module heading to later questions, click on the Add pull-down menu and select 'a new module heading'. It will be created above the question you clicked next to
    Add a module heading (to other questions)

  4. Click on the 'New heading' pencil to create a heading (the other option is to delete)
    new heading for module

  5. If required, tick Shuffle (Note: this will only shuffle questions within this module)

Quiz - change quiz settings for a group or user (override/extension)

1. Plan  |   2. Build  |  3. Test   | 4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

In a quiz, you can change the dates, timing and the number of allowed attempts for groups or users. If you want to create a Group override, groups will need to be set up in your topic. This is likely to be an administrative step, once the quiz is running. You can also create an extension for a student using the Assignment extension tool.


Create a group or user override

A group or user override allows you to change some quiz settings for a student or group of students. The settings that can be changed affect the timing and duration of when students can do a quiz, and are generally used when a student is given extra time to do the quiz.

  1. Click on the quiz

  2. Click on the cog in the top-right corner of the page

  3. Select Group overrides or User overrides
    quiz administration block

  4. Click Add group override or Add user override 

  5. In the next screen, choose an override group or user/s (you can search for a user or scroll through a list) (required field)
    override group

  6. Decide whether the group or user will require password, what dates the quiz will open and close on for this group or user/s, the time limit and attempts allowed. You only have to enter settings that are changing, not settings that are staying the same.
    input password, close and poen dates, time limit and attempts allowed
    Timeline block: User overrides show to students in the Timeline block, marked as 'override'. Group overrides will not show to students in the timeline block.

  7. Click Save (or Save and enter another override)
    save icon, save and enter another override icon, cancel icon

Create an extension using the Assignment extension tool

Although set up specifically for assignment extensions (hence you can choose the assignment from a drop-down menu), you can manually add other activities (such as a quiz) to the list of 'assignments', thus providing students and staff with a consistent extension application process for all assessable items in the site. 

  1. Click on the Assignment extension tool assignment extension tool

  2. Add a manual item (the quiz)

  3. Follow the instructions for Assignment - grant extensions for assignments (Assignment extension tool)

After approving the request you will need to make the applicable changes to FLO – that is, the date change is not automatic. For a quiz, apply a user override.

Quiz - create a drag and drop question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.


Create a drag and drop into text question

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 10: Drag and drop into text question (Colour quiz)
Steps
  1. In the question bank (Administration > Question bank), click Questions, then Create a new question… (You can also do this in Quiz administration > Edit quiz)
    Question bank

  2. Select Drag and drop into text and click Add
    Select drag and drop into text

  3. Supply your question with a Question name (required field) and Question text (required field):  
    In your question text, leaves 'gaps' indicated by two sets of square brackets with a number inside.  This number will indicate the correct choice for that gap
    Type question text
    Type question text
  4. Provide the question a default mark and enter any general feedback (shown to the student after they have completed the question)  
    enter a default mark and type general feedback

  5. Enter Choices:
    Decide whether to shuffle the choices (tick the box or leave unticked).  Shuffling is recommended to prevent student's from surmising the correct answer based on choice order.

    The choice with the same number as the numbered text gap is the correct answer for that gap:
    type choices

  6. To add additional 'incorrect' drag and drop answers, add additional choices that do not correspond to a numbered text gap. (in this example there is no text gap labelled [[4]], thus 'green' will be an additional option that is not the correct answer to any question)
    additional choice

  7. If using multiple choices for each question, it may be useful to Group the choices.  
    Each group will be represented by a different colour, which will apply to both the relevant gap(s) in the text and to the choices for that group. 
    select groups


    select groups
    Avoid using groups in simple questions with only as many choices as correct answers.  In this scenario the use of groups will give away the answers.
    select groups

  8. You can preview the question to check that it works correctly before clicking the Save changes button: 
    Preview

  9. Click Save changes (you can now preview the question by choosing it in the question bank list and clicking the preview icon
     preview icon

Create a drag and drop onto image question

For this question type, you will need to have an image to drag and drop text/images onto. If you source an image from the internet, but be careful about copyright/usage (eg use Creative Commons and check the licensing).

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 2: Drag and drop onto image (Colour quiz) 

Steps

  1. In the question bank (Administration > Question bank), click Questions, then Create a new question…


  2. Select Drag and drop onto image and click Add


  3. Give the question a Category, a Question name (required field) and enter Question text (required field)
  4. Category, Question name and Question text

  5. Decide on the default mark for the question (required field)


  6. Fill in General feedback (students will see this once they have answered the question). You could include the correctly labelled image in this box. Students can then see if/where they made an error. This box is seen by all students regardless of whether their response was correct or incorrect
    General feedback
  7. Select a Background image file and drag and drop it into the box provided, or Choose a file... by searching on your computer (the image should not be larger than 600 pixels width so you may have to resize it). If you are searching the web (eg Google images), for an image be careful about copyright and usage
    background image

  8. Under Draggable items (scroll down), for the Type choose either Draggable image or Draggable text (most likely you will use text). Upload an image, or type text into the textbox that you want dragged to an area of the background image you have uploaded. Choose a Group to give each image or text item (eg 1, 2, 3...). Do this for as many items as are relevant.
    You can also tick the box Shuffle drag items each time question is attempted.
    If you tick the Infinite box, this means choices may be used in multiple locations. 
    Note: within draggable text items, limited formatting of text is possible using <sub> (subscript), <sup> (superscript), <b> or <strong> (bold), <i> or <em> (italics) and <br/> (line break)
    draggable image or text

     If Draggable image is selected:
    Draggable image selection

     If Draggable text is selected:
    draggable text option

  9. In the Drop zones section (scroll up), for Drop zone 1, choose the Draggable item from the pull-down menu (this will be whatever you have entered in the Draggable items section). These items should now appear below the background image you placed in the question.
    drop zones populated
  10. Drag the images/text onto the background image – this will populate the drop zone boxes in the Drop zones section with coordinates
    draggable items dragged to drop zone

  11. Click Save changes (if you miss one of the steps, you will stay in the editing screen and a red highlight will tell you what you have missed)  

  12. In the Question bank screen, the new question should be highlighted. Click on the magnifying glass icon preview iconto the right of the question name to preview the question. Click on the cog icon to edit the question

    preview the question

Quiz - create a fill-in-the-blanks (missing words) question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.


Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic 
  2. View question 1: Select missing words (Colour quiz)

Steps

  1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question
    create a new question button

  2. Choose Select missing words and click Add
    select missing words

  3. Give the question a category

  4. Give the question a name (required field) (this is only seen by teachers – make it something meaningful so when you view the questions in a list, you know what they are about) 

  5. Enter some question text. Where you would like the student to choose the missing word, enter a number on double square brackets, for example [[1]]. Number each gap sequentially starting at [[1]] – that is, [[1]], [[2]], [[3]] etc (required field)
    category, question name, question text

  6. Give the question a default mark (required field)
    default mark

  7. Fill in the choices. Choice 1 is the correct answer for the gap indicated by [[1]], choice 2 is the correct answer for the gap indicated by [[2]], and so on. 
    how to enter the 'correct' asnwers

    Choices with the same value for Group appear in the same drop-down lists (Shuffle)
    Choices - Shuffle boxes

  8. Fill in General feedback for the quiz question

  9. Click Save changes

Quiz - create a matching question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 6: Matching (Colour quiz)

Steps

For this question type, you must provide at least two questions and three answers. You can provide extra wrong answers by giving an answer with a blank question. Entries where both the question and the answer are blank will be ignored.

  1. Under Topic administration > Question bank > Questions, click Create a new question
     create a new question button

  2. Select Matching and click Add
    matching    

  3. Give the question a Category

  4. Give the question a Question Name (required field)

  5. Enter question text (required field)

  6. Decide on the default mark for the question (required field)
    select category, question name, question text, and default mark

  7. Fill in General feedback (students will see this once they have answered the question)
    enter general feedback

  8. Add the text for Question 1 and the answer 
    question 1 - question and answer

  9. Add the text for Question 2 and the answer 
    question 1 - question and answer

  10. Continue adding text for questions and the answer. You can provide extra wrong answers by giving an answer with a blank question

  11. Click Save changes

Quiz - create a multiple choice question (MCQ)

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.


Create an MCQ

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 3: Multiple choice (Colour quiz)
Steps
  1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question
    create a new question

  2. Select Multiple choice and click Add
    multiple choice    

  3. Give the question a category

  4. Give the question a name (this will only be shown to teachers) (required field)

  5. Fill in question text (required field)

  6. Give the question a default mark (required field)
    multiple choice - enter category, question name, question text, default mark
    multiple choice - enter category, question name, question text, default mark
  7. Enter some general question feedback
    general feedback
  8. Choose whether the question has one answer only or multiple correct answers. 'One answer only' means users will only be able to select one box; 'Multiple answers allowed' means users will be able to select more than one box (if there is a specific number of correct answers, you may want to say this in the stem/lead-in sentence: 'Please select two of the following.')
    One or multiple answers

  9. Select whether you want to shuffle the question answers
    Shuffle the choices

  10. Under Answers, fill in the choices
    answers
    If you selected multiple correct answers for the MCQ (see step 8 above), you are advised to give wrong answers negative scores, to discourage students from selecting all options (you should say that they will be penalised for wrong answers in the question stem)
    negative score multiple correct answers

  11. For the correct answer, change Grade to be 100%. If there are multiple correct answers (see step 8 where you would need to have selected 'Multiple answers allowed'), allocate the 100% across all correct options; for example, if there are 2 correct responses allocate them 50% each. (Note: they do not need to have equal weightings)

     incorrect answer    Assign to an incorrect answer  

    correct - one answer only     Assign to a correct answer in a question with one correct answer  

     correct answer in a quiz with multiple correct answers    Assign to a correct answer in a question with multiple correct answers

  12. Click Save settings


Tips for creating MCQs

Bloom's level/s of taxonomy, what the item is testing (descriptor), and distracter plausibility:

Question number x Correct answer (key)
Learning objective  
Bloom's level of taxonomy  
Descriptor What the item is testing
Distracter plausibility A....
B....
C....
Question tips
  • Use a consistent style
  • Use clear and concise wording (can be complex but not complicated)
  • Make the question 'stem' either a direct question or an incomplete statement 
  • Avoid double negatives

You may want to use a 'stimulus' prior to the question – this could include introductory text/context, an image etc.

Answer tips
  • Make the key (right answer) and distracters (wrong answers) approximately the same length, and use similar wording to avoid obvious standouts
  • Keep answers consistent in grammar and logical to the stem (question)
  • 3, 4 or 5 options per answer? There is no set preference, but the more options the harder it is to think up a plausible 'distracter'
  • Avoid using 'none of the above' or 'all of the above' (especially if answers are shuffled!)
  • Use a logical pattern but don't always put the correct answer in the same position
  • Provide good feedback for all options (where relevant)
  • Where possible, ensure that wrong answers represent a common misconception
Open response items
  • Provide information to markers on full credit, partial credit and no credit
  • If not marking for grades, provide good feedback on likely responses 
References and resources

The Centre for University Teaching ran two workshops in 2013 with invited speakers from the Australian Council for Educational Research (ACER):
MacKinnon, Philip, MCQ assessment workshop 24 June 2013
Khoo, Siek Toon, Introduction to measurement concepts and assessment in education
"Bloom" search results (eLearning literature and resources collection) 

   

Quiz - create an embedded answers (Cloze) question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 8: Embedded answers (Cloze) (Colour quiz)

Steps

To set up this question type, you need to generate cloze text. This means that where an answer is required, you will need to generate bracketed instructions so the answer can be marked automatically and feedback generated. For example:

{1:SHORTANSWER:%0%tertiary#Sorry, that's incorrect~%100%primary#That's correct!~%0%secondary#Not quite, read the question carefully}

This can be a complex process if you are not familiar with it, and it is easy to make a mistake. You could try the Moodle Cloze editor (external resource) which can generate cloze from your text. Once generated, you can copy and paste it into the Question text area in this question.

  1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question

  2. Select Embedded and click Add
    select the icon for embedded answers (cloze)    

  3. Give the question a Category and Question name (required field)
    enter category and question name

  4. Enter question text (this will include Cloze text – see note above) (required field)
    enter question text

  5. Fill in General feedback (students will see this once they have answered the question)
    general feedback

  6. Give a penalty and hint for each incorrect try
    Penalty and hints

  7. Click Save changes

Quiz - create a new question (question types)

1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.


Create in the question bank or in the quiz

NOTE: Before creating questions, you should set up categories in the question bank. Then use one of the two methods below to create questions in those question banks.

1. Create from within the question bank
  1. Navigate to the question bank from your topic’s Administration menu
  2. Select the category you want the question to be in.
  3. Click on the Create new question button and choose the desired question type
  4. Enter the details of your question.
  5. Save your question. You'll then be taken back to the question bank category where the question is
  6. Click on the magnifying glass to the right of your question and test it is working as expected


    Tip: If you want a series of similar questions you can duplicate then edit questions

2. Create from within the quiz
  1. Open your quiz
  2. From the Administration menu, click on Edit quiz
  3. Click on one of the Add links on right side of the page, then select a new question
  4. Enter the details of your question, making sure you choose an appropriate question bank category* for your question
  5. Save your question. You'll then be taken back to your edit quiz page.
  6. Click on the magnifying glass to the right of your question and test it is working as expected


    *Note: We strongly recommend that you do not use the category "default for your quiz name" as this category is segregated from the question bank. Questions in that category can't be used in other quizzes and can't be viewed with the main question bank. Storing questions in this segregated category can lead to confusion.


Create a new question (from question types)

Choose a question type and follow the instructions for creating under a category:


Import/export questions

You could also import questions from a file, or export questions to a file – talk to your eLearning support team.

import/export questions


Provide question/quiz feedback


Duplicate (copy) a question

  1. Open the question bank you want to duplicate a question in

  2. Find the question you want to duplicate

  3. Click on the Duplicate icon next to the question
    Duplicate a question (icon)

  4. The question will open in an editing screen, where you can make the changes you want (eg to the Question name) and continue editing

  5. Click Save changes when you have finished editing the question duplicate

  6. The duplicated question will now appear on your list of questions.

Quiz - create a numerical question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

If you are interested in this question type, you may also be interested in Calculated, Calculated multichoice and Calculated simple. To create one of these types, at step 2 (below) select one of these options instead of Numerical. 

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 9: Numerical (Colour quiz)

Steps

  1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question
    create a new question

  2. Select Numerical and click Add
        Numerical option

  3. Give the question a Category

  4. Give the question a Category Name (required field)

  5. Enter question text (required field)

  6. Decide on the default mark for the question (required field)
    adding a numerical question - input category, question name, question text, default mark

  7. Fill in General feedback (students will see this once they have answered the question)
    general feedback text box

  8. Select answer 1, the error for getting it wrong, and the grade. Do this for all other correct/incorrect answers
    answer field, error, and grade

  9. Provide feedback for the answer (whether right or wrong)
    answer feedback

  10. Under Unit handling and Units, decide on the configuration (this will only apply if the answer is not a whole number)

  11. Click Save changes

  12. Preview the question to make sure it works correctly

Quiz - create a quiz

1. Plan  |   2. Build   |  3. Test   | 4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

You have added a category to the question bank and created questions. Now you can create the quiz, then add questions to it.


Steps

Add the Quiz activity
  1. In the topic, click Turn editing on 
    Turn editing on
  2. In the week/module where you want to add the quiz, click Add an activity or resource
     Add an activity or resource
  3. Select Quiz and click AddQuiz icon
Name and description
Give the quiz a Name and Description 
name and description
Timing

Under Timing, give the quiz Open and Close dates 

timing
Timeline block: The 'Close the quiz' date will show to students in the Timeline block.

Depending on the purpose of your quiz, you may want to change the default settings (see below). You can also click the question mark promptprompt next to some options to find out more about a setting.

You can make the quiz available at different times for different groups or users in the Group overrides or User overrides sections of the Administration > Quiz administration settings block.

  • Before the opening time, the quiz will be unavailable to students – they will be able to view the quiz introduction but not the questions. Quizzes with start times in the future display both the open and close date to students.
  • After the closing time, students will:
    • not be able to start new attempts and any open attempts will be automatically submitted.
    • still be able to see the quiz description and review their attempts. What they see will depend on the settings you choose for Review options (ticked boxes in the 'After the quiz has closed' column).
Time limit

quiz time clockIf enabled, the time limit is stated on the initial quiz page and a countdown timer is displayed in the quiz navigation block (see image to the right). Once the timer runs out, the quiz is submitted automatically. If the quiz close time is reached before the time runs out, the quiz will be automatically submitted (ie student does not get full time). You can make the quiz last a different period of time for different groups or users in the  Group overrides or User overrides  sections of the Administration > Quiz administration settings block.


Grade
Grade category

If you have categories in your gradebook (eg for a quiz set), select the category you wish the quiz to be in here.

Attempts allowed 

Unlimited (default), 1-10

Your choice here depends on what and how you are testing (ie the purpose of your quiz):

  • If a diagnostic test, then probably choose 1; if a formative test, then maybe more often as the student is in the learning process.
  • If the quiz is shuffled (see Layout) or has random questions (see quiz - add questions), then the student will get a new version for each attempt, useful for practice purposes.

You can change the allowed number of attempts for different groups or users in the Group overrides or User overrides sections of the Administration > Quiz administration settings block.

Grading method

Highest grade (default), Average grade, First attempt, Last attempt

This setting only applies if more than 1 attempt is allowed. If each question builds on the last, you might set it at Last attempt, as you want to see that students are gaining knowledge/understanding progressively.

Grade

Layout
  • Question order: Shuffled randomly – if selected, the order of questions in the quiz will be randomly shuffled each time a student starts a new attempt at the quiz. 
  • New page: you may want to group questions on a particular topic together, but not too many on one page as this will require students to scroll.  It is recommended that you do not use the setting 'never, all questions on one page', as student activity within the quiz will be less frequently logged and less information will be captured regarding the attempt.
    Note: You can change how many questions per page in Quiz administration > Edit quiz. You can Repaginate (eg 2 per page instead of 1 per page), or select questions and move them to a particular page.
  • Navigation method: leave as Free (default) unless the quiz is building knowledge (last question relates to next question etc).

Question behaviour
  • Shuffle within questions: if Yes (default), the option must also be enabled in question settings (when you create a new question).
  • How questions behave: Deferred feedback (default) – students answer each question and submit the entire quiz, before anything is graded or they get any feedback.
    Note: 
    CBM stands for 'certainty-based marking' – if you choose this option, students will need to say how sure they are that the answer is right and will be penalised accordingly. More information about CBM (MoodleDocs)
  • Show more… > Each attempt builds on the last: if multiple attempts are allowed and you set this to Yes, then each new attempt contains the results of the previous attempt, so students can concentrate on just those questions they answered incorrectly last time. If you choose this option, each attempt by a particular student uses the same questions in the same order, independent of randomisation settings. To show a fresh quiz on every attempt, select 'No' for this setting.

Review options

Tick the options you would like to choose from the table. Default settings are After the quiz is closed.

review options table

These settings can affect the visibility of the grade column for a quiz. See Quiz - troubleshooting ('I can't unhide the grade column for a quiz'for more information.


Appearance
  • Decimal places in grades: Default is 2. This option determines how many digits will be shown after the decimal point when the grade is displayed. A setting of 0 for example will display grades as integers (whole numbers). 
    Note: If you use CBM (certainty-based marking) which deducts marks for not being certain, being wrong about being certain etc, then it makes sense to show the decimal places in grades. Likewise for 'Decimal places in question grades'.
  • Show blocks during quiz attempts: Default is No – this is about usability (better display, no distractions).

Extra restrictions on attempts

These settings may be useful if you are using a FLO quiz as a final exam.

  • Require password: if you specify a password then participants must enter the same password before they can attempt on the quiz. 
  • Require network address: you can restrict access for a quiz to particular subnets on the LAN or internet by specifying a comma-separated list of partial or full IP address numbers (eg 192.168. , 231.54.211.0/20, 231.3.56.211). This is especially useful for an invigilated quiz/exam, where you want to be sure that only people in a certain room are able to access the quiz. 
    Note:  the Flinders network is not configured to allow restricting access to a given room.
  • Enforced delay between attempts: You can set a time (from seconds to weeks) between the first and second attempt on a quiz. You can also (or alternatively) set a time from seconds to weeks for subsequent attempts after the second attempt (eg you might allow a student to take the quiz twice immediately with no delay, but if they want to improve their score with a third attempt, they are forced to wait a week and use the time for extra revision).
  • Show more… > Browser security: the options in this section offer various ways to try to restrict how students may try to 'cheat' while attempting a quiz.  

Overall feedback

Overall feedback is feedback shown to a student after they have completed an attempt at the quiz. You can set the grade boundary (eg 100%, 65%, 50%) and apply appropriate feedback according to the range the student falls within (eg if a student gets below 65% they are referred to more information). This is a useful feature in a formative quiz where students are informing themselves/the teacher what they know/understand.


Common module settings

These settings are only relevant if you have groups and groupings set up in your FLO site. 

  • Group mode: you can choose whether the quiz should be organised by group.
    Note: This only affects the results screen, and allows you to filter results based on group enrolment.

Restrict access

None (default), Activity completion, Date, Grade, User profile, Restriction set

For example, you might have a series of quizzes and they need to do one before another – this would be the activity completion option but you would first need to enable completion tracking in the topic settings and quiz activities.


Activity completion

Apply these settings if you have enabled completion tracking for the topic and this activity.

Quiz - create a quiz essay question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

The essay question in quiz requires manual grading (marking).

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 7: Essay (Colour quiz)

Steps

  1. In the quiz or question bank, click Create a new question
    create a new question

  2. Select Essay and click Add
    essay question
        
  3. Give the question a name (this is seen by teachers only) and fill in the Question text. You will probably want to change the Default mark to a number higher than 1
    enter a category, question name, question text, and default mark

  4. Provide general question feedback
    general feedback

  5. If you want students to upload a file, select Allow attachments and choose a number from the drop down menu (Note: if students are required to write a long essay as part of a quiz, we strongly recommend they write it in Word and either upload the file or copy and paste into the response box).

    You can also list specific file types (e.g. docx, pdf, etc) if you want to restrict what types of files students can submit.
    select allow attachments and choose from the drop down menu

  6. Click Save changes

Quiz - create a short answer question

1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

This question type can be tricky if there is more than a one-word answer (which may have spelling problems!), or variations on the answer. You can avoid this problem by:

  • using wildcards (*) – see information below Steps
  • putting in the question stem (Question text) a proviso such as 'Please separate words with a comma' (if a two-word answer) or other similar guidance
  • anticipating the variations and adding those to the answers with 100% as the correct grade for each variation

It would be a good idea to test this question on a number of users before you try it with students in the real situation, especially if it is assessed.

You can manually mark a short-answer question to avoid these problems.

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 4: Short answer (Colour quiz)


Steps

  1. In the question bank, click Create a new question
    create a new question

  2. Select Short answer and click Add
    short answer    

  3. Give the question a Category

  4. Give the question a Category Name (required field)

  5. Enter question text (required field)

  6. Decide on the default mark for the question (required field)
    adding a question - category, question name, question text, default mark

  7. Fill in General feedback (students will see this once they have answered the question)
    general feedback

  8. Select the correct answer and grade
    example answer and grade

  9. Provide feedback for the answer (whether right or wrong)
    feedback

  10. Click Save changes


Using wildcards

You can use the asterisk character (*) as a wildcard to match any series of characters. For example, use:

ran*ing
 to match any word or phrase starting with ran and ending with ing

If you really do want to match an asterisk then use a backslash like this: 

\*
 If you want one question with the two answers fuel and oxygen, you ought to be able to limit the number of variants by writing:
fuel*oxygen
This would accept "fuel oxygen", "fuel, oxygen", "fuel; oxygen", "fuel and oxygen", "fuel & oxygen" "fuel oxygen", "fuel und oxygen" "fuel&&oxygen". It would even accept "fuel or oxygen", "fuel but not oxygen" "fuel|oxygen" .
Example

Here are some answers and scores for a question "What does a rocket burn?"

  1. oxygen*fuel
     with a score 100% 
  2. *fuel*
     with a score 50%
  3. *oxygen*
     with a score 50%
  4. *air*
     with a score 40% 
  5. * 
     with a score of 0%

The order of the answers is important. The answers are evaluated from 1st to last. When a match is found the process stops. If no match is found, the question is scored wrong and the general response is used. It is a good practice to put a wildcard as the last answer so the evaluation process knows what to do when nothing above it matches.

If any answer is the right answer (eg a non-graded open-ended quiz), you could have as the only answer * (worth 100%). This means all answers are acceptable. Make the question worth 0, and if you make the quiz non-graded (ie worth 0) it will not appear in the Gradebook. 

Quiz - create a true/false question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz icon This entry relates to the Quiz activity.

Want to see how this question type works?

  1. Self enrol in the Collections in FLO topic
  2. View question 5: True/False (Colour quiz)

Steps

  1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question
    create a new question

  2. Select True/False and click Add
        true false

  3. Give the question a category

  4. Give the question a Name (required field)

  5. Enter question text (required field)

  6. Give the question a default mark (required field)
    add category, question name, question text, and default mark

  7. Fill in general question feedback
    general feedback

  8. Select the correct answer (true or false)
    correct answer

  9. Enter feedback for response 'true'
    if true

  10. Enter feedback for response 'false'
    if false
  11. Click Save changes

Quiz - edit quiz questions (and regrade quiz)

1. Plan  |   2. Build  |  3. Test   | 4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.


Before the quiz opens

This action relates to the 'Plan' step for Quiz. If, before a quiz opens, you discover that a question requires editing or correction, it can be easily edited.  Enter the Question bank and locate the relevant question, then select the edit cog besides it.  After making the required changes, click Save changes.

question bank
edit question

If you discover the error after student access has commenced, it is possible to regrade your quiz. When a quiz question is altered, all instances of that question will be altered (ie if the question is used in another quiz it will also be altered). Students will not be notified of the changes made.


After the quiz opens 

There are two steps to this process - edit the quiz question/s and regrade the quiz.

1. Edit the quiz question/s

To regrade a quiz attempt (once it has already opened and students have attempted it), you will first need to edit the quiz question/s that needs changing. You can either edit the question/s (change mark, add comment) for all students OR for selected students.
Edit a quiz question for all students
  1. Click on the link for the quiz you have created 

  2. Click the Edit quiz link in the Administration block  
    edit quiz button

  3. Click on the cog to edit the question
    Cog Wheel
  4. Make changes, click Save changes

Edit a quiz question for selected students

  1. Click on the quiz, then Quiz administration > Results > Grades

  2. Choose the student and question in the Grades screen (scroll down) and click on the mark link (in the example below, it is 0.25)
    question link

  3. In the next screen, scroll down and click on the Make comment or override mark link
    question level - click on link

  4. Add a comment or change the mark
    comment or override mark screen

  5. Click Save

2. Regrade the quiz

How you regrade the quiz is different depending on whether it has random questions or not.
Quiz with no random questions

If you change the mark for a question to 0, you don't need to regrade. 

If you adjust an answer (eg in an MCQ), you will need to regrade. You cannot change the question type (eg in an MCQ, you will need to leave it at one answer only, and make two answers correct, both worth 100%, rather than change the MCQ to multiple answers allowed).

  1. Click on the quiz

  2. Click Attempts at the bottom of the screen

  3. Next to Show only attempts tick the box 'that have been regraded/are marked as needed regrading'
    regrade attempts

  4. Click Dry run a full regrade (to see the outcome before you actually regrade – it is not a required step)
    dry run a full regrade

  5. Click on the Continue button once the 'Regrade completed successfully' screen has appeared
    regrade and continue

  6.  Once completed, the attempts that need regrading will appear in the regrade column with 'Needed' appearing


  7. Click on the 'Regrade attempts marked as needed regrading' button
    regrade attempts...

  8. Click 'Continue' button once Regrade completed successfully appears
    regrade attempts
  9. To complete the process click Regrade all
    button

  10. Click Continue button once 'Regrade completed successfully' appears. You will now notice that the regrade column disappears, indicating that your quiz has been regraded 


Quiz with random questions

If you change the mark for a question to 0, you don't need to regrade.

If you need to remark one question you will need to identify which students were given the question, as that particular question could have occurred in any order (eg question 1 for some students but question 4 for others).

Example: If you have a randomised quiz of 20 questions, the problem question could be given in any of the 20 possible positions within the quiz.

  1. Go to Administration > Results > Manual Grading

  2. Click the link for ‘Also show questions that have been graded automatically’

  3. Locate the problem question for each of the possible question slots and edit however many results there are by clicking on update grades in the Automatically graded column. (The random question has a round symbol next to the question name. random question icon) In the case below, you will need to edit 2 attempts on this question
    questions that need regrading

  4. Once you have edited the question and saved the edits, you will see that this question is no longer automatically graded – you have manually regraded the question
    manual regrade screenshot

Quiz - import questions

1. Plan  |   2. Build  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

You can import quiz questions into the question bank from a text editor (eg Microsoft Word). The instructions below relate to multiple-choice questions (MCQs) in text format only (ie no images etc).

If you need help, contact your local eLearning support team.


Steps

In a text editor

  1. Create your MCQs in a text editor such as Word, using this template (Aiken format). Choose the format for your questions (Option 1 or Option 2) and follow the instructions

  2. Save your MCQ file as a .txt file and save in a UTF-8 format


In your FLO topic

    3. Create a category in the question bank for your questions (if you don't already have one) – this is where your imported questions will be located

    4. From anywhere in the topic, go to the Topic management panel > Topic settings > Import

        If you are inside the quiz, you can also use the cog icon in the top-right corner of the page and select import

Quiz import menu


5. In the 'Import questions from a file' screen, select Aiken format for the File format (suitable for these question types/file type) 

Aiken format 

6. Under General, select the
Import category. Leave the settings Match grades and Stop on error as the default settings ('Error if grade not listed' and 'Yes') 
Import category 

7. Under
Import questions from file, either Choose a file... or drag and drop in the box, and click Import 
Import questions 

8. The next screen will show you the questions you have imported. Click
Continue imported questions 

9. The next screen will show you the question bank category you have put your imported questions into. Check that your questions are there (you can also move them to another category if you want) 

Question bank category


Learn how to add questions (including random questions to a quiz (edit quiz).

Quiz - main entry

Whether you are starting from scratch or working with a quiz already created, using the quiz activity in a topic ideally consists of 5 stages, in a looped process.

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

Quiz iconThe Quiz activity enables a teacher to create out-of-class quizzes comprising questions of various types, including multiple-choice, matching, short-answer and numerical. See Active quiz if you wish to use a quiz in a face-to-face lecture/tutorial (ie in class), with a classroom of computers/tablets/phones (devices). 

Accidentally deleted a quiz?
It's important that you don't use the recycle bin to restore a deleted quiz. Refer to the quiz troubleshooting page, I accidentally deleted a quiz and want to restore it, for further information.

Good practice guides and tip sheets

Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to quiz-related resources are provided below. 

Assessment principles | Designing online quizzes to minimise collusion | Incorporating Socratic questions into your FLO site | Aligning quiz questions with Bloom's taxonomy | Using FLO quizzes with large student numbers | Inspirational and engaged teaching | Policy implications for assessment design | Providing constructive feedback in FLO



1. Plan your quiz

The better your planning, the less likely you are to run into a problem once students start doing the quiz. Therefore, it is advised that you have a process for creating your quiz. Your college may have policies or guidelines around quizzes. Whether you are starting from scratch or revising a current quiz, these concepts, planning questions and tips that may help:

  • What is your quiz's purpose? The answer will determine the settings you choose when you create the quiz. 
  • What principle/knowledge are you testing – does the quiz item test it? 
  • Line up quiz questions against the learning outcomes (you could include this information in the quiz question)
  • Connect the questions with Bloom's level/s of taxonomy (Wikipedia) – again, what is being tested? 
  • Be creative – you could use scenarios, embed videos/other resources, provide learning pathways (eg hints, tips, more information, think again) 

Follow the links below to start the process.



2. Build your quiz

You have planned your quiz – its purpose (which determines quiz settings), the category/ies and questions, the feedback you will provide. Now you are ready to set up the quiz.

    1. Create a quiz
    2. Add questions to a quiz (edit quiz) – including random questions
    3. Edit quiz questions (and regrade quiz) 
    4. Calculate a topic total including the best X from Y grades – if you have multiple (eg weekly/two weekly) quizzes in a topic and want to count the best 8 out of 10 (for example)


    3. Test your quiz

    You've created your quiz and added questions. If you are confident the quiz is ready, it is a good idea to preview it to see if it works before making it available to students. When you preview the quiz, you will experience it as a student.



    4. Administer your quiz

    While the quiz is open, you can view how students are progressing (submitted or not, how many attempts so far etc). Once the quiz has closed, you can finalise the grades.



    5. Review your quiz

    Reviewing your quiz (question validity, student experience and learning outcomes, alignment with topic learning outcomes) entails collecting data, analysing the data, and acting on it. Your data may also include student feedback – verbally and electronically. This step feeds into future quiz planning (step 1).


      Training and support

      Troubleshooting

    Training

    Quiz workshop

    Support

    eLearning support teams

    You may have one of the following issues:

    Quiz - manually mark/grade essay (or other) questions

    1. Plan  |   2. Build  |  3. Test   |  4. Administer  |  5. Review  ||  Support

    quiz iconThis entry relates to the Quiz activity.

    Your quiz may have a range of question types, including essay and/or short answer. The Essay question is the only one designed for manual grading.
     


    Manually grade automatically graded questions

    If you want to manually grade questions other than the essay question (eg the Short answer question type), you will have to override the automatic mark for that question. 

    1. Click on the quiz to view in a new screen

    2. Click on the Actions menu cog in the top right corner, then select Manual grading

    3. Click on Also show questions that have been graded automatically (above the table of questions and grades)

    4. In the next screen, find the Already graded column and click on the Update grades link
      Update grades

    5. Use the Options section to choose which questions to mark and the order in which they appear

    6. Underneath the Options, you will see a list of student responses to be marked. Update each entry and save the changes


    Manually grade an essay question

    The Manual grading report enables markers to manually grade written submissions within a quiz. This grading method is automatic for the Essay question type (irrespective of what the quiz is set to).

    1. Open the quiz, click on the cog in the top right corner, then select Manual grading

    2. In the Questions that need grading screen, click on the grade link in the To grade column
      Questions that need grading - to grade column

    3. Use the Options section to choose which questions to mark and the order in which they appear

    4. Underneath the options, you will see a list of student responses to be marked
      Student response to be marked 

    5. Click Save and go to next page when you have finished marking all those displayed. When you have marked all of the questions, you will be prompted to return to the Questions that need grading screen, with the responses that you marked now appearing in the Already graded column.
      All selected attempts have been graded 

    Quiz - provide quiz feedback at quiz and question level

    1. Plan  |   2. Build  |  3. Test   | 4. Administer  |  5. Review  || Support

    quiz iconThis entry relates to the Quiz activity.

    Providing feedback is an excellent way to increase student engagement when they attempt and review a quiz. Feedback can be customised to address particular student responses to a question, the question more generally, or the total score achieved by the student. It can be delivered during the quiz, after the attempt but before the quiz has closed, or after the quiz has closed. The amount and quality of feedback you provide will depend on the quiz's purpose.  

    • Inclusion and release of feedback can increase the complexity required in quiz set-up. For help, please contact your local eLearning support team.

    • Release of feedback to students is controlled by the quiz Review settings in conjunction with the Question Behavior setting. Please see 'I can't unhide the Grade column for a quiz' (Quiz - troubleshooting entry) for further information.

    Good practice guides and tip sheets

    Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to quiz-related resources are provided below. 

    Inspirational and engaged teaching


    The three types of feedback – specific, general and overall

    • Specific feedback is feedback specific to, and dependent upon, the response the student gave to a question. It is response-specific.
      Specific feedback is set up at the question level – when creating the question or later by clicking the edit cog  edit cog beside the question

    specific feedback set-up

    Student view:
    specific feedback

    • General feedback is feedback shown to the student after they have completed the question. The same feedback is shown for all students, regardless of the response they gave. You can use the general feedback to give students a fully worked answer and perhaps a link to more information they can use if they did not understand the question.
      General Feedback is set up at the question level – when creating the question or later by clicking the edit cog   edit cog  beside the question

      general feedback

      Student view:
      general feedback - student view

    • Overall feedback is the text that is shown after a quiz has been attempted. By specifying additional grade boundaries (as a percentage or as a number), the text shown can depend on the grade obtained
      Overall Feedback is set up in the quiz's settings 
        In the scenario below, students scoring between 100% and 80% will see the message 'Well done'.  Those who scored between 79.99% and 0% will see            the message 'Please study this week's work again' (100% and 0% do not need to be entered, as they are the default grade boundaries):

    overall feedback overall feedback

    Student view:
    overall feedback - student view