Thursday, 6 October 2022, 1:43 AM
Site: Flinders Learning Online
Topic: FLO Staff Support (FLO_Staff_Support)
Glossary: How-to glossary
Q

Quick tour (video)

Quiz - add a category to the question bank

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

  • All questions are stored within the question bank
  • Categories are created in the question bank and are used to organise questions
  • Sorting questions into categories is especially important when random questions are used or a topic contains many quizzes 
  • When a quiz delivers random questions, those questions must be stored in a dedicated category (or sub-category)

If you add a category before you add questions to the question bank, all questions created can be added to this category and they will then belong to the topic, rather than the quiz. This approach will make management easier when you are creating new quizzes using questions from previous quizzes. 

Categories can be created within an existing category (ie a sub-category). 


Steps

  1. Go to Topic Management > Question > Category
    In the question block, select categories
  2. Scroll down the screen (categories may already be listed, that you can edit) you will see the option Add category

  3. Choose a Parent category from the pull-down list (defaulted to your topic name) – you are most likely to leave it at your topic name, but you could also add a sub-category within an already created category
    Add Category
  4. Give the category a Name

  5. Add Category info (optional)
  6. In the question block, select categories
  7. Click ID number (optional) 
  8. Click Add category button

  9. The new category should be listed under the relevant Parent category
    Question categories

  10. Once created, you can also Edit categories (rename, add/change category info), delete, re-order and indent (make into a subcategory).

Quiz - add questions (including random questions) to a quiz (edit quiz)

1. Plan  |   2. Build   |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

If you want to add questions from a text file rather than creating them in the question bank (this can save time), see Import questions (multiple choice in a text file). Contact your eLearning support team if you need assistance with this process.


Steps

  1. Add questions (and shuffle if you want) (Build step)
  2. Add random questions to a quiz (if required) (Build step)
  3. Add a module heading (if required) (Build step)

1. Add questions
  1. Click on the quiz you have created

  2. If no questions have been added to the quiz yet, you will see image on the left, and clicking the Edit quiz button will take you to the edit quiz page. If your quiz already has questions, the screen will have a preview quiz button instead (the image on the right).

    A quiz without any questions added
    A quiz with questions added

  3. To access the edit quiz page for a quiz that already has questions, click on the cog in the top right corner and select Edit quiz          


  4. Click the Add link. You can also tick the Shuffle box so that the order of questions you add to the quiz is randomised at each attempt
    click Add
  5. Click the from question bank option. (You can also select a random question – see below)    
    click from Question bank
  6. Select a category when the questions are located, or search for tags that your questions have been tagged with.

    Choose a category or search for tags

  7. Click the box next to the questions, click Add selected questions to the quiz.  
    add question to quiz

2. Add random questions to a quiz (if required)

You may want to add random questions to the quiz so that students don't get all the same questions at the same time. To do this you need extra questions in your question bank (eg if you have 20 questions in the quiz, you will ideally need an extra 10).

  1. Follow steps 1-3 above. At step 4, choose + a random question

  2. Select a category when the questions are located, or search for tags that your questions have been tagged with.

    Choose a category or search for tags

  3. Select the number of questions you wish to add and click Add random question


3. Add a module heading (if required)

If you have several questions (eg > 10) and it would make sense to group them, you can add a module heading. With a quiz of 20 or more questions using free navigation, headings may be particularly helpful to the user.  Another use for modules could be to shuffle questions within sections rather than shuffling all questions throughout the quiz.

  1. To add a heading above the first question, click the pencil above the question, type the heading title, then press Enter
  2. add a module heading (first one)

  3. If you want to add a module heading to later questions, click on the Add pull-down menu and select 'a new module heading'. It will be created above the question you clicked next to
    Add a module heading (to other questions)

  4. To rename the module heading click on the pencil icon to create a heading.
    new heading for module

    Headings added using step 2 can be deleted by clicking on the trash icon.

Quiz - change quiz settings for a group or user (override/extension)

1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

In a quiz, you can change the dates, timing and the number of allowed attempts for groups or users. If you want to create a Group override, groups will need to be set up in your topic. This is likely to be an administrative step, once the quiz is running. You can also create an extension for a student using the Assignment extension tool.


Create a group or user override

A group or user override allows you to change some quiz settings for a student or group of students. The settings that can be changed affect the timing and duration of when students can do a quiz, and are generally used when a student is given extra time to do the quiz.

  1. Click on the quiz

  2. Click on the cog in the top-right corner of the page

  3. Select Group overrides or User overrides
    quiz administration block

  4. Click Add group override or Add user override 

  5. In the next screen, choose an override group or user/s (you can search for a user or scroll through a list) (required field)
    override group

  6. Decide whether the group or user will require password, what dates the quiz will open and close on for this group or user/s, the time limit and attempts allowed. You only have to enter settings that are changing, not settings that are staying the same.
    input password, close and poen dates, time limit and attempts allowed
    Timeline block: User overrides show to students in the Timeline block, marked as 'override'. Group overrides will not show to students in the timeline block.

  7. Click Save (or Save and enter another override)
    save icon, save and enter another override icon, cancel icon

    The quiz summary page indicates when user/group overrides have been applied.
    Text showing there is one group override and one user override.
    Tutors do not have permission to add or edit overrides but can view the details of overrides given by others.


Create an extension using the Assignment extension tool

Although set up specifically for assignment extensions (hence you can choose the assignment from a drop-down menu), you can manually add other activities (such as a quiz) to the list of 'assignments', thus providing students and staff with a consistent extension application process for all assessable items in the site. 

  1. Click on the Assignment extension tool assignment extension tool

  2. Add a manual item (the quiz)

  3. Follow the instructions for Assignment - grant extensions for assignments (Assignment extension tool)

After approving the request you will need to make the applicable changes to FLO – that is, the date change is not automatic. For a quiz, apply a user override.

Quiz - create a drag and drop question

1. Plan  |   2. Build  |  3. Test   | 4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.


Create a drag and drop into text question

Steps
  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Drag and drop into text and click Add

  3. Supply your question with a Question name (required field) and Question text (required field):  
    In your question text, leaves 'gaps' indicated by two sets of square brackets with a number inside.  This number will indicate the correct choice for that gap
    Type question text
    Type question text
  4. Provide the question a default mark and enter any general feedback (shown to the student after they have completed the question)  
    enter a default mark and type general feedback

  5. Enter Choices:
    Decide whether to shuffle the choices (tick the box or leave unticked).  Shuffling is recommended to prevent student's from surmising the correct answer based on choice order.

    The choice with the same number as the numbered text gap is the correct answer for that gap:
    type choices

  6. To add additional 'incorrect' drag and drop answers, add additional choices that do not correspond to a numbered text gap. (in this example there is no text gap labelled [[4]], thus 'green' will be an additional option that is not the correct answer to any question)
    additional choice

  7. If using multiple choices for each question, it may be useful to Group the choices.  
    Each group will be represented by a different colour, which will apply to both the relevant gap(s) in the text and to the choices for that group. 
    select groups


    select groups
    Avoid using groups in simple questions with only as many choices as correct answers.  In this scenario the use of groups will give away the answers.
    select groups

  8. You can preview the question to check that it works correctly before clicking the Save changes button: 
    Preview

  9. Click Save changes (you can now preview the question by choosing it in the question bank list and clicking the preview icon
      preview icon

Create a drag and drop onto image question

For this question type, you will need to have an image to drag and drop text/images onto. If you source an image from the internet, but be careful about copyright/usage (eg use Creative Commons and check the licensing).

Steps

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Drag and drop onto image and click Add

  3. Give the question a Category, a Question name (required field) and enter Question text (required field)
  4. Category, Question name and Question text

  5. Decide on the default mark for the question (required field)


  6. Fill in General feedback (students will see this once they have answered the question). You could include the correctly labelled image in this box. Students can then see if/where they made an error. This box is seen by all students regardless of whether their response was correct or incorrect
    General feedback
  7. Select a Background image file and drag and drop it into the box provided, or Choose a file... by searching on your computer (the image should not be larger than 600 pixels width so you may have to resize it). If you are searching the web (eg Google images), for an image be careful about copyright and usage
    background image

  8. Under Draggable items (scroll down), for the Type choose either Draggable image or Draggable text (most likely you will use text). Upload an image, or type text into the textbox that you want dragged to an area of the background image you have uploaded. Choose a Group to give each image or text item (eg 1, 2, 3...). Do this for as many items as are relevant.
    You can also tick the box Shuffle drag items each time question is attempted.
    If you tick the Infinite box, this means choices may be used in multiple locations. 
    Note: within draggable text items, limited formatting of text is possible using <sub> (subscript), <sup> (superscript), <b> or <strong> (bold), <i> or <em> (italics) and <br/> (line break)
    draggable image or text

     If Draggable image is selected:
    Draggable image selection

     If Draggable text is selected:
    draggable text option

  9. In the Drop zones section (scroll up), for Drop zone 1, choose the Draggable item from the pull-down menu (this will be whatever you have entered in the Draggable items section). These items should now appear below the background image you placed in the question.
    drop zones populated
  10. Drag the images/text onto the background image – this will populate the drop zone boxes in the Drop zones section with coordinates
    draggable items dragged to drop zone

  11. Click Save changes (if you miss one of the steps, you will stay in the editing screen and a red highlight will tell you what you have missed)  

  12. In the Question bank screen, the new question should be highlighted. Click on the magnifying glass icon  preview iconto the right of the question name to preview the question. Click on the cog icon to edit the question

    preview the question

Quiz - create a fill-in-the-blanks (missing words) question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

Steps

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button)

  2. Choose Select missing words and click Add

  3. Give the question a category

  4. Give the question a name (required field) (this is only seen by teachers – make it something meaningful so when you view the questions in a list, you know what they are about) 

  5. Enter some question text. Where you would like the student to choose the missing word, enter a number on double square brackets, for example [[1]]. Number each gap sequentially starting at [[1]] – that is, [[1]], [[2]], [[3]] etc (required field)
    category, question name, question text

  6. Give the question a default mark (required field)
    default mark

  7. Fill in the choices. Choice 1 is the correct answer for the gap indicated by [[1]], choice 2 is the correct answer for the gap indicated by [[2]], and so on. 
    how to enter the 'correct' asnwers

    Choices with the same value for Group appear in the same drop-down lists (Shuffle)
    Choices - Shuffle boxes

  8. Fill in General feedback for the quiz question

  9. Click Save changes

Quiz - create a matching question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

Steps

For this question type, you must provide at least two questions and three answers. You can provide extra wrong answers by giving an answer with a blank question. Entries where both the question and the answer are blank will be ignored.

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Matching and click Add   

  3. Give the question a Category

  4. Give the question a Question Name (required field)

  5. Enter question text (required field)

  6. Decide on the default mark for the question (required field)
    select category, question name, question text, and default mark

  7. Fill in General feedback (students will see this once they have answered the question)
    enter general feedback

  8. Add the text for Question 1 and the answer 
    question 1 - question and answer

  9. Add the text for Question 2 and the answer 
    question 1 - question and answer

  10. Continue adding text for questions and the answer. You can provide extra wrong answers by giving an answer with a blank question

  11. Click Save changes

Quiz - create a multiple choice question (MCQ)

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.


Steps
  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Multiple choice and click Add   

  3. Give the question a category

  4. Give the question a name (this will only be shown to teachers) (required field)

  5. Fill in question text (required field)

  6. Give the question a default mark (required field)
    multiple choice - enter category, question name, question text, default mark

  7. Enter some general question feedback
    multiple choice - enter category, question name, question text, default mark
  8. Choose whether the question has one answer only or multiple correct answers. 'One answer only' means users will only be able to select one box; 'Multiple answers allowed' means users will be able to select more than one box (if there is a specific number of correct answers, you may want to say this in the stem/lead-in sentence: 'Please select two of the following.')
    One or multiple answers

  9. Select whether you want to shuffle the question answers
    Shuffle the choices

  10. Under Answers, fill in the choices
    answers
    If you selected multiple correct answers for the MCQ (see step 8 above), you are advised to give wrong answers negative scores, to discourage students from selecting all options (you should say that they will be penalised for wrong answers in the question stem)
    negative score multiple correct answers

  11. For the correct answer, change Grade to be 100%. If there are multiple correct answers (see step 8 where you would need to have selected 'Multiple answers allowed'), allocate the 100% across all correct options; for example, if there are 2 correct responses allocate them 50% each. (Note: they do not need to have equal weightings)

     incorrect answer    Assign to an incorrect answer  

    correct - one answer only     Assign to a correct answer in a question with one correct answer  

     correct answer in a quiz with multiple correct answers    Assign to a correct answer in a question with multiple correct answers

  12. Click Save settings


Tips for creating MCQs

Bloom's level/s of taxonomy, what the item is testing (descriptor), and distracter plausibility:

Question number x Correct answer (key)
Learning objective  
Bloom's level of taxonomy  
Descriptor What the item is testing
Distracter plausibility A....
B....
C....
Question tips
  • Use a consistent style
  • Use clear and concise wording (can be complex but not complicated)
  • Make the question 'stem' either a direct question or an incomplete statement 
  • Avoid double negatives

You may want to use a 'stimulus' prior to the question – this could include introductory text/context, an image etc.

Answer tips
  • Make the key (right answer) and distracters (wrong answers) approximately the same length, and use similar wording to avoid obvious standouts
  • Keep answers consistent in grammar and logical to the stem (question)
  • 3, 4 or 5 options per answer? There is no set preference, but the more options the harder it is to think up a plausible 'distracter'
  • Avoid using 'none of the above' or 'all of the above' (especially if answers are shuffled!)
  • Use a logical pattern but don't always put the correct answer in the same position
  • Provide good feedback for all options (where relevant)
  • Where possible, ensure that wrong answers represent a common misconception
Open response items
  • Provide information to markers on full credit, partial credit and no credit
  • If not marking for grades, provide good feedback on likely responses 
References and resources

The Centre for University Teaching ran two workshops in 2013 with invited speakers from the Australian Council for Educational Research (ACER):
MacKinnon, Philip, MCQ assessment workshop 24 June 2013
Khoo, Siek Toon, Introduction to measurement concepts and assessment in education
"Bloom" search results (eLearning literature and resources collection) 

   

Quiz - create an all-or-nothing multiple choice question

1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

In an all-or-nothing multiple choice question (MCQ), the answers chosen by a student must correspond exactly to the correct answers defined in the question. If this occurs a student gets 100%. If there are any incorrect answers or not all correct answers are selected, the grade will be 0%.


Create an all-or-nothing MCQ

Steps
  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Multiple choice and click Add   

  3. Give the question a category

  4. Give the question a name (this will only be shown to teachers) (required field)

  5. Fill in the question text (required field)

  6. Give the question a default mark (required field)

     
  7. Enter some general question feedback
    multiple choice - enter category, question name, question text, default mark

  8. Select whether you want to shuffle the question answers


  9. Under Answers, fill in the choices. For all the correct answers, tick the checkbox Correct.
     
    answers

  10. Click Save settings


Tips for creating an all-or-nothing MCQ

Bloom's level/s of taxonomy, what the item is testing (descriptor), and distracter plausibility:

Question number x Correct answer (key)
Learning objective  
Bloom's level of taxonomy  
Descriptor What the item is testing
Distracter plausibility A....
B....
C....
Question tips

Difference from standard Multiple choice questions (MCQ)

The main difference from the standard MCQ is in the way that grading works. In a standard multiple-choice question with multiple correct answers, a negative mark must be given to the incorrect answers to be able to make the grade 0%, however students can still get a partial grade if not all correct answers are selected.

For example, if we have a question with two right and two wrong answers:

  • In the standard MCQ we need to award each of the two right answers 50% of the mark, then award each wrong answer -100%. If the student selects an incorrect answer, the grade will be 0%, but if only one right answer is selected, the grade will be 50%.
  • In the All-or-nothing MCQ, if the student selects an incorrect answer, the grade will be 0%, but if they select only one right answer, the grade will also be 0%.

One answer only MCQ

It is not advisable to use the All-or-nothing MCQ for questions that explicitly ask for one answer. The standard MCQ should be used if there is only one answer or if partial grades are allowed.

Import questions

The All-or-nothing questions must be manually created. It can not be imported from another file.

References and resources
  • The Centre for University Teaching ran two workshops in 2013 with invited speakers from the Australian Council for Educational Research (ACER):
    MacKinnon, Philip, MCQ assessment workshop 24 June 2013
    Khoo, Siek Toon, Introduction to measurement concepts and assessment in education
    "Bloom" search results (eLearning literature and resources collection)


Bloom's taxonomy explained


SOLO taxonomy explained

Quiz - create an embedded answers (Cloze) question



1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

Embedded answers (Cloze) question is very powerful and flexible question type, but probably the most complex to setup.

It is powerful because:

  • There can be many sub-questions within one cloze question, each weighted as you require.
  • Sub-questions can be rendered/displayed in a range of formats – text/number entry, drop-down lists, radio button or checkbox lists.
  • Different sub-question formats can be used within one question.
  • The question can be laid out as required with the sub-questions embedded where required.
To create the embedded sub-question, you place some code at the required place in the text of your question. The code is enclosed in {} and has a specific syntax. The elements of the code define the weight of the sub-question, the format, the answer possibilities, the correct answer & feedback for answer options.

Example (Cloze code is shown in red)

Analyse the graph and complete the following
1.    Which line is not linear {1:MULTICHOICE:Line A~Line B~%100%Line C}
2.    Which line would have a negative intercept on the y axis {1:MULTICHOICE_V: Line A~%100%Line B~Line C}
3.    Use the values on the graph for Line A to calculate the slope  {1:NUMERICAL:=3} and Intercept {1:NUMERICAL:=4}
4.    What is plotted on the y-axis {1:SHORTANSWER:%100%Concentration (mg/l)~%50%Concentration#units are required for full marks}

In the cloze code,
  • answer options are separated with ~
  • correct answer is indicated by = or %100%. Part marks are defined with %x% where x is the % of marks assigned
  • indicates the feedback for the preceding option
The example code will look like this:


Moodle docs has more details of sub-question types and detailed syntax (code) explanations  

One of the strengths is that multiple questions are asked together e.g interpreting a number of elements of a graph/photograph/test report etc, thus creating a scenario in a single multipart question. A bank of such multipart questions can then be developed for random scenario delivery or formative practice as all components are contained in one question. If each interpretation element was a separate question, random scenarios can’t be delivered as you cannot control which questions are delivered together.

Steps


  1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question

  2. Select Embedded and click Add



  3. Give the question a Category and Question name (required field)



  4. Enter question text (this will include Cloze text – see note above) (required field)
    Tip:  You could try the Moodle Cloze editor (external resource) which can generate cloze from your text. Once generated, you can copy and paste it into the Question text area in this question.



  5. Fill in General feedback (students will see this once they have answered the question)



  6. Give a penalty and hint for each incorrect try



  7. Click Save changes


Syntax of a cloze question

{1: MULTICHOICE: Text for option 1 # Feedback for option 1 ~ %100% Text for option 2 # Feedback for option 2 ~ %50%Text for option 3 # Feedback for option3}

Required components
{ }
Cloze sub-questions begin and end with braces
1:
the number represents the weight of this sub-question part in the overall question
MULTICHOICE
the sub-question type - it controls how the sub-question is displayed
~
separator between answer options
#
indicates the feedback that would be provided to the answer option preceding it
%100
indicates the % marks for the following option (correct answers are sometimes also indicated with =)
The above syntax would be rendered as a dropdown menu with 3 options. Option 2 would give full marks for that sub-question and option 3 would score half marks.


More examples


We work at {1:SHORTANSWER:=Flinders} University
We work at {1:SHORTANSWER:%100%Flinders} University

The above 2 examples are essentially the same
  • = indicates correct answer
  • %100% indicates the option will get 100% of the marks for that question part
We work at {1:SHORTANSWER:%100%Flinders~ %50%Flinder} University
  • In this example 50% would be given for the answer “Flinder”
We work at {1:SHORTANSWER:%100%Flinders~ %50%Flinder#Almost right, but there should be an s on the end} University
  • In this example 50% would be given for the answer “Flinder” and the student would be given the feedback “Almost right, but there should be an s on the end”
We work at {1:MULTICHOICE:Adelaide~%100%Flinders ~Monash~Griffith} University
  • This example produces a dropdown with the options of Adelaide, Flinders, Monash and Griffith.  “Flinders” is correct
We work at {1:MULTICHOICE:%25%Adelaide#Well you’ve got the right state, just the wrong uni~ %100%Flinders~Monash~Griffith} University
  • This example produces a dropdown with the options of Adelaide, Flinders, Monash and Griffith.  “Flinders” is correct, but “Adelaide” will earn you 25% of the marks and you will get some feedback “Well you’ve got the right state, just the wrong uni”

Quiz - create a new question (question types)

1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.


Create in the question bank or in the quiz

NOTE: Before creating questions, you should set up categories in the question bank. Then use one of the two methods below to create questions in those question banks.

1. Create from within the question bank
  1. Navigate to the question bank from your topic’s Topic management menu

  2. Select the category you want the question to be in.

  3. Click on the Create new question button and choose the desired question type

  4. Enter the details of your question.

  5. Save your question. You'll then be taken back to the question bank category where the question is

  6. Click on the Edit link to the right of your question and select Preview to test if it is working as expected

     

    Tip: If you want a series of similar questions, you can duplicate then edit questions

2. Create from within the quiz
  1. Open your quiz
  2. Click on the cog in the top right corner and select Edit quiz


  3. Click on one of the Add links on right side of the page, then select a new question

  4. Enter the details of your question, making sure you choose an appropriate question bank category* for your question

  5. Save your question. You'll then be taken back to your edit quiz page.

  6. Click on Edit to the right of your question and select Preview from the dropdown list to test if it is working as expected
     

    *Note: We strongly recommend that you do not use the category "default for your quiz name" as this category is segregated from the question bank. Questions in that category can't be used in other quizzes and can't be viewed with the main question bank. Storing questions in this segregated category can lead to confusion.


Create a new question (from question types)

Choose a question type and follow the instructions for creating under a category:


Import/export questions

You could also import questions from a file, or export questions to a file – talk to your eLearning support team.

import/export questions


Provide question/quiz feedback


Duplicate (copy) a question

  1. Open the question bank you want to duplicate a question in

  2. Find the question you want to duplicate

  3. Click on the Edit link next to the question and select Duplicate from the menu that appears.
    Duplicate a question (icon)

  4. The question will open in an editing screen, where you can make the changes you want (eg to the Question name) and continue editing

  5. Click Save changes when you have finished editing the question duplicate

  6. The duplicated question will now appear on your list of questions.

Quiz - create a numerical question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.

If you are interested in this question type, you may also be interested in Calculated, Calculated multichoice and Calculated simple. To create one of these types, at step 2 (below) select one of these options instead of Numerical.


Steps

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Numerical and click the Add button.

  3. Give the question a Category

  4. Give the question a Category Name (required field)

  5. Enter question text (required field)

  6. Decide on the default mark for the question (required field)
    adding a numerical question - input category, question name, question text, default mark

  7. Fill in General feedback (students will see this once they have answered the question)
    general feedback text box

  8. Select answer 1, the error for getting it wrong, and the grade. Do this for all other correct/incorrect answers
    answer field, error, and grade

  9. Provide feedback for the answer (whether right or wrong)
    answer feedback

  10. Under Unit handling and Units, decide on the configuration (this will only apply if the answer is not a whole number)

  11. Click Save changes

  12. Preview the question to make sure it works correctly

Quiz - create a quiz

1. Plan  |   2. Build   |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

You have added a category to the question bank and created questions

Now you can create the quiz, then add questions to it.



Add the Quiz activity

  1. In the topic, click the Turn Edit On button
    Turn editing on

  2. In the module where you want to add the quiz, click Add an activity or resource
     Add an activity or resource

  3. Select Quiz from the Activities tab


Quiz settings


General

Give the quiz a Name and Description

name and description


Timing

Under Timing, you can choose to give the quiz Open and Close dates. Tick the Enable box to the right of the date you wish to enter, then enter the date.

timing

Timeline block: The 'Close the quiz' date will show to students in the Timeline block.

Depending on the purpose of your quiz, you may want to change the default settings (see below). You can also click the question mark question mark promptprompt next to some options to find out more about a setting.

You can make the quiz available at different times for different groups or users in the Group overrides or User overrides   sections via the Actions menu.

  • Before the opening time, the quiz will be unavailable to students – they will be able to view the quiz introduction but not the questions. Quizzes with start times in the future display both the open and close date to students.

  • After the closing time, students will:
    • not be able to start new attempts and any open attempts will be automatically submitted.
    • still be able to see the quiz description and review their attempts. What they see will depend on the settings you choose for Review options (ticked boxes in the 'After the quiz has closed' column).
Time limit

quiz time clockIf enabled, the time limit is stated on the initial quiz page and a countdown timer is displayed in the quiz navigation block (see image to the right). Once the timer runs out, the quiz is submitted automatically. If the quiz close time is reached before the time runs out, the quiz will be automatically submitted (ie student does not get full time). You can make the quiz timing different for different groups or users in the  Group overrides or User overrides sections via the Actions menu.


Grade

Grade category

If you have categories in your gradebook (eg for a quiz set), select the category you wish the quiz to be in here.

Attempts allowed 

Unlimited (default), 1-10

Your choice here depends on what and how you are testing (ie the purpose of your quiz):

  • If a diagnostic test, then probably choose 1; if a formative test, then maybe more often as the student is in the learning process.
  • If the quiz is shuffled (see Layout) or has random questions (see quiz - add questions), then the student will get a new version for each attempt, useful for practice purposes.

You can change the allowed number of attempts for different groups or users in the Group overrides or User overrides sections of the Administration > Quiz administration settings block.

Grading method

Highest grade (default), Average grade, First attempt, Last attempt

This setting only applies if more than 1 attempt is allowed. If each question builds on the last, you might set it at Last attempt, as you want to see that students are gaining knowledge/understanding progressively.

Grade


Layout

  • Question order: Shuffled randomly – if selected, the order of questions in the quiz will be randomly shuffled each time a student starts a new attempt at the quiz. 
  • New page: You may want to group questions on a particular topic together, but not too many on one page as this will require students to scroll.  It is recommended that you do not use the setting 'never, all questions on one page', as student activity within the quiz will be less frequently logged and less information will be captured regarding the attempt.

Note: You can change how many questions per page (Actions menu >Edit quiz). You can Repaginate (eg 2 per page instead of 1 per page), or select questions and move them to a particular page.

  • Navigation method: leave as Free (default) unless the quiz is building knowledge (last question relates to next question etc).


Question behaviour

  • Shuffle within questions: if Yes (default), the option must also be enabled in question settings (when you create a new question).
  • How questions behave: Deferred feedback (default) – students answer each question and submit the entire quiz, before anything is graded or they get any feedback.

Note:  CBM stands for 'certainty-based marking' – if you choose this option, students will need to say how sure they are that the answer is right and will be penalised accordingly. More information about CBM (MoodleDocs)

  • Show more… > Each attempt builds on the last: if multiple attempts are allowed and you set this to Yes, then each new attempt contains the results of the previous attempt, so students can concentrate on just those questions they answered incorrectly last time. If you choose this option, each attempt by a particular student uses the same questions in the same order, independent of randomisation settings. To show a fresh quiz on every attempt, select 'No' for this setting.


Review options

Tick the options you would like to choose from the table. Default settings are After the quiz is closed (if a closing date for the quiz has been set).

review options table


The attempt Will show how the student responded to each question. Note: This must be selected before you can enable 'Whether correct, 'Specific feedback', 'General feedback' and 'Right answer'.
Whether correct Displays whether the response to each question is correct or incorrect.
Marks Reveals the marks awarded to the student and the grade for the quiz. This setting will affect the grade's visibility in gradebook.
Specific feedback Will show the feedback for the response to the answer as set when adding the question to the quiz. Each response to a question can have feedback for both correct and incorrect answers.
General feedback Displays the general feedback for the whole question as set when adding the question to the quiz. You can use the general feedback to give students some background to what knowledge the question was testing.
Right answer Reveals the correct answer to each question, whether the student answered correctly or not. Note: This is a bit inconsistent between different question types. For example, the matching question type shows students which of their responses are correct, but does not tell them the right answer for the ones they got wrong. The short answer and multiple choices question types do tell the student what the correct answer is.
Overall feedback Displays feedback for the entire quiz as set in the quiz settings.

For each of the above settings, you can determine the timeframe when the students will see them:
During the attempt Immediately after the attempt Later, while the quiz is still open After the quiz is closed
These settings are only relevant for some behaviours, like 'interactive with multiple tries', which may display feedback during the attempt. These settings apply for the first two minutes after students have clicked 'Submit all and finish'. These settings apply after students have clicked 'Submit all and finish' and before the quiz close date. These settings apply after the quiz close date has passed. If the quiz does not have a close date, this state is never reached.


Appearance

  • Decimal places in grades: Default is 2. This option determines how many digits will be shown after the decimal point when the grade is displayed. A setting of 0 for example will display grades as integers (whole numbers). 

Note: If you useCBM (certainty-based marking) which deducts marks for not being certain, being wrong about being certain etc, then it makes sense to show the decimal places in grades. Likewise for 'Decimal places in question grades'.

  • Show blocks during quiz attempts: Default is No – this is about usability (better display, no distractions).


Extra restrictions on attempts

These settings may be useful if you are using a FLO quiz as a final exam.

  • Require password: If you specify a password then participants must enter the same password before they can attempt on the quiz. 
  • Require network address: You can restrict access for a quiz to particular subnets on the LAN or internet by specifying a comma-separated list of partial or full IP address numbers (eg 192.168. , 231.54.211.0/20, 231.3.56.211). This is especially useful for an invigilated quiz/exam, where you want to be sure that only people in a certain room are able to access the quiz. 

Note: The Flinders network is not configured to allow restricting access to a given room.

  • Enforced delay between attempts: You can set a time (from seconds to weeks) between the first and second attempt on a quiz. You can also (or alternatively) set a time from seconds to weeks for subsequent attempts after the second attempt (eg you might allow a student to take the quiz twice immediately with no delay, but if they want to improve their score with a third attempt, they are forced to wait a week and use the time for extra revision).
  • Show more…Browser security: the options in this section offer various ways to try to restrict how students may try to 'cheat' while attempting a quiz.  


Overall feedback

Overall feedback is feedback shown to a student after they have completed an attempt at the quiz. You can set the grade boundary (eg 100%, 65%, 50%) and apply appropriate feedback according to the range the student falls within (eg if a student gets below 65% they are referred to more information). This is a useful feature in a formative quiz where students are informing themselves/the teacher what they know/understand.


Common module settings

These settings are only relevant if you have groups and groupings set up in your FLO site. 

  • Group mode: you can choose whether the quiz should be organised by group.
    Note: This only affects the results screen and allows you to filter results based on group enrolment.


Restrict access

None (default), Activity completion, Date, Grade, User profile, Restriction set

For example, you might have a series of quizzes and they need to do one before another – this would be the activity completion option but you would first need to enable completion tracking in the topic settings and quiz activities.


Activity completion

Apply these settings if you have enabled completion tracking for the topic and this activity.

Quiz - create a quiz essay question

1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

The essay question in quiz requires manual grading (marking).


Steps

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Essay and click Add
        
  3. Give the question a name (this is seen by teachers only) and fill in the Question text. You will probably want to change the Default mark to a number higher than 1
    enter a category, question name, question text, and default mark

  4. Provide general question feedback
    general feedback

  5. Set the student's Response options:

    1. If the response requires that students enter text, you can set up a minimum/maximum number of words that each student will be allowed to submit.

    2. If you want students to upload a file, select Allow attachments and choose a number from the drop-down menu (Note: if students are required to write a long essay as part of a quiz, we strongly recommend they write it in Word and either upload the file or copy and paste into the response box).

    3. You can also list specific file types (e.g. docx, pdf, etc.) if you want to restrict what types of files students can submit.

    4. You can also set a maximum file size limit for the attachments.
      select allow attachments and choose from the drop down menu

  6. Click Save changes

Quiz - create a short answer question

1. Plan  |   2. Build  |  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

This question type can be tricky if there is more than a one-word answer (which may have spelling problems!), or variations on the answer. You can avoid this problem by:

  • using wildcards (*) – see information below Steps
  • putting in the question stem (Question text) a proviso such as 'Please separate words with a comma' (if a two-word answer) or other similar guidance
  • anticipating the variations and adding those to the answers with 100% as the correct grade for each variation

It would be a good idea to test this question on several users before you try it with students in the real situation, especially if it is assessed.

You can manually mark a short-answer question to avoid these problems.


Steps

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select Short answer and click Add   

  3. Give the question a Category

  4. Give the question a Category Name (required field)

  5. Enter question text (required field)

  6. Decide on the default mark for the question (required field)
    adding a question - category, question name, question text, default mark

  7. Fill in General feedback (students will see this once they have answered the question)
    general feedback

  8. Select the correct answer and grade
    example answer and grade

  9. Provide feedback for the answer (whether right or wrong)
    feedback

  10. Click Save changes


Using wildcards

You can use the asterisk character (*) as a wildcard to match any series of characters. For example, use:

ran*ing
 to match any word or phrase starting with ran and ending with ing

If you really do want to match an asterisk then use a backslash like this: 

\*
 If you want one question with the two answers fuel and oxygen, you ought to be able to limit the number of variants by writing:
fuel*oxygen
This would accept "fuel oxygen", "fuel, oxygen", "fuel; oxygen", "fuel and oxygen", "fuel & oxygen" "fuel oxygen", "fuel und oxygen" "fuel&&oxygen". It would even accept "fuel or oxygen", "fuel but not oxygen" "fuel|oxygen" .
Example

Here are some answers and scores for a question "What does a rocket burn?"

  1. oxygen*fuel
     with a score 100% 
  2. *fuel*
     with a score 50%
  3. *oxygen*
     with a score 50%
  4. *air*
     with a score 40% 
  5. * 
     with a score of 0%

The order of the answers is important. The answers are evaluated from 1st to last. When a match is found the process stops. If no match is found, the question is scored wrong and the general response is used. It is a good practice to put a wildcard as the last answer so the evaluation process knows what to do when nothing above it matches.

If any answer is the right answer (eg a non-graded open-ended quiz), you could have as the only answer * (worth 100%). This means all answers are acceptable. Make the question worth 0, and if you make the quiz non-graded (i.e. worth 0) it will not appear in the Gradebook. 

Quiz - create a true/false question

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

quiz icon This entry relates to the Quiz activity.


Steps

  1. Open the quiz and either:
    • Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
    • Open the question bank and click on the Create a new question button

  2. Select True/False and click Add
        true false

  3. Give the question a category

  4. Give the question a Name (required field)

  5. Enter question text (required field)

  6. Give the question a default mark (required field)
    add category, question name, question text, and default mark

  7. Fill in general question feedback
    general feedback

  8. Select the correct answer (true or false)
    correct answer

  9. Enter feedback for response 'true'
    if true

  10. Enter feedback for response 'false'
    if false
  11. Click Save changes

Quiz - edit quiz questions (and regrade quiz)

1. Plan  |   2. Build  |  3. Test   | 4. Administer  |  5. Review  || Support

quiz iconThis entry relates to the Quiz activity.



Before the quiz opens

This action relates to the 'Plan' step for Quiz. If, before a quiz opens, you discover that a question requires editing or correction, it can be easily edited. 

  1. Click the Topic Management button (cog icon) on the main menu, then the Question bank link
    Topic management button

  2. Question bank link

  3. Use the Select a category drop-down list and select the category that contains the question
    Select a category drop-down

  4. The questions contained in the category will appear. Locate the relevant question, then select Edit question from the Edit drop-down menu. After making the required changes, click Save changes.
    Edit question

If you discover the error after student access has commenced, it is possible to regrade your quiz. When a quiz question is altered, all instances of that question will be altered (ie if the question is used in another quiz it will also be altered). Students will not be notified of the changes made.



After the quiz opens 

There are two steps to this process – edit the quiz question/s and regrade the quiz.

Step 1. Edit the quiz question/s

To regrade a quiz attempt (once it has already opened and students have attempted it), you will first need to edit the quiz question/s that needs changing. You can either edit the question/s (change mark, add comment) for all students OR for selected students.
Edit a quiz question for all students
  1. Click on quiz link      

  2. Click the Edit quiz link in the Actions menu       
    Edit quiz link

  3. Click on the cog to edit the question
    Edit question cog

  4. Make changes, click Save changes

Edit a quiz question for selected students

  1. Click on the quiz link

  2. Click the Actions menu cog and choose Grades under the Results link
    Grades link

  3. Choose the student and question in the Grades screen (scroll down) and click on the mark link (in the example below, it is 0.25)
    question link

  4. In the next screen, scroll down and click on the Make comment or override mark link
    question level - click on link

  5. Add a comment or change the mark
    comment or override mark screen

  6. Click Save



2. Regrade the quiz

How you regrade the quiz is different depending on whether it has random questions or not.

Quiz with
no random questions

If you change the mark for a question to 0, you don't need to regrade. 

If you adjust an answer (eg in an MCQ), you will need to regrade. You cannot change the question type (eg in an MCQ, you will need to leave it at one answer only, and make two answers correct, both worth 100%, rather than change the MCQ to multiple answers allowed).

  1. Click on the quiz

  2. Click Attempts at the bottom of the screen

  3. Next to Show only attempts tick the box 'that have been regraded/are marked as needed regrading'

    regrade attempts

  4. Click Dry run a full regrade (to see the outcome before you actually regrade – it is not a required step)

    dry run a full regrade

  5. Click on the Continue button once the 'Regrade completed successfully' screen has appeared
    regrade and continue

  6. Once completed, the attempts that need regrading will appear in the regrade column with 'Needed' appearing


  7. Click on the 'Regrade attempts marked as needed regrading' button
    regrade attempts...

  8. Click 'Continue' button once Regrade completed successfully appears
    regrade attempts
  9. To complete the process click Regrade all
    button

  10. Click Continue button once 'Regrade completed successfully' appears. You will now notice that the regrade column disappears, indicating that your quiz has been regraded 


Quiz with random questions

If you need to remark one question you will need to identify which students were given the question, as that particular question could have occurred in any order (eg question 1 for some students but question 4 for others).

Example: If you have a randomised quiz of 20 questions, the problem question could be given in any of the 20 possible positions within the quiz.

  1. In the quiz, click the Actions menu cog and choose Manual grading under the Results link

  2. Click the Also show questions that have been graded automatically link

  3. Locate the problem question for each of the possible question slots and edit however many results there are by clicking on update grades in the Automatically graded column. (The random question has a round symbol next to the question name. random question icon) In the case below, you will need to edit 2 attempts on this question
    questions that need regrading

  4. Once you have edited the question and saved the edits, you will see that this question is no longer automatically graded – you have manually regraded the question
    manual regrade screenshot

Quiz - import questions

1. Plan  |   2. Build  3. Test   | 4. Administer   |  5. Review  ||  Support

quiz iconThis entry relates to the Quiz activity.

You can import quiz questions into the question bank from a text editor (eg Microsoft Word). The instructions below relate to multiple-choice questions (MCQs) in text format only (ie no images etc).

If you need help, contact your local eLearning support team.


Steps

In a text editor

  1. Create your MCQs in a text editor such as Word, using this template (Aiken format). Choose the format for your questions (Option 1 or Option 2) and follow the instructions

  2. Save your MCQ file as a .txt file and save in a UTF-8 format


In your FLO topic

    3. Create a category in the question bank for your questions (if you don't already have one) – this is where your imported questions will be located

    4. From anywhere in the topic, go to the Topic management panel > Topic settings > Import

        If you are inside the quiz, you can also use the cog icon in the top-right corner of the page and select import

Quiz import menu


5. In the 'Import questions from a file' screen, select Aiken format for the File format (suitable for these question types/file type) 

Aiken format 

6. Under General, select the
Import category. Leave the settings Match grades and Stop on error as the default settings ('Error if grade not listed' and 'Yes') 
Import category 

7. Under
Import questions from file, either Choose a file... or drag and drop in the box, and click Import 
Import questions 

8. The next screen will show you the questions you have imported. Click
Continue imported questions 

9. The next screen will show you the question bank category you have put your imported questions into. Check that your questions are there (you can also move them to another category if you want) 

Question bank category


Learn how to add questions (including random questions to a quiz (edit quiz).

Quiz - main entry

Whether you are starting from scratch or working with a quiz already created, using the quiz activity in a topic ideally consists of 5 stages, in a looped process.

1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

Quiz iconThe Quiz activity enables a teacher to create out-of-class quizzes comprising questions of various types, including multiple-choice, matching, short-answer and numerical. See Active quiz if you wish to use a quiz in a face-to-face lecture/tutorial (ie in class), with a classroom of computers/tablets/phones (devices). 

Accidentally deleted a quiz?
It's important that you don't use the recycle bin to restore a deleted quiz. Refer to the quiz troubleshooting page, I accidentally deleted a quiz and want to restore it, for further information.

Good practice guides and tip sheets

Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to quiz-related resources are provided below. 

Assessment principles | Designing online quizzes to minimise collusion | Incorporating Socratic questions into your FLO site | Aligning quiz questions with Bloom's taxonomy | Using FLO quizzes with large student numbers | Inspirational and engaged teaching | Policy implications for assessment design | Providing constructive feedback in FLO | Providing students with comprehensive assessment information and support in FLO | Constructive alignment in FLO


1. Plan your quiz

The better your planning, the less likely you are to run into a problem once students start doing the quiz. Therefore, it is advised that you have a process for creating your quiz. Your college may have policies or guidelines around quizzes. Whether you are starting from scratch or revising a current quiz, these concepts, planning questions and tips that may help:

  • What is your quiz's purpose? The answer will determine the settings you choose when you create the quiz. 
  • What principle/knowledge are you testing – does the quiz item test it? 
  • Line up quiz questions against the learning outcomes (you could include this information in the quiz question)
  • Connect the questions with Bloom's level/s of taxonomy (Wikipedia) – again, what is being tested? 
  • Be creative – you could use scenarios, embed videos/other resources, provide learning pathways (eg hints, tips, more information, think again) 

Follow the links below to start the process.



2. Build your quiz

You have planned your quiz – its purpose (which determines quiz settings), the category/ies and questions, the feedback you will provide. Now you are ready to set up the quiz.

    1. Create a quiz
    2. Add questions to a quiz (edit quiz) – including random questions
    3. Edit quiz questions (and regrade quiz) 
    4. Calculate a topic total including the best X from Y grades – if you have multiple (eg weekly/two weekly) quizzes in a topic and want to count the best 8 out of 10 (for example)


    3. Test your quiz

    You've created your quiz and added questions. If you are confident the quiz is ready, it is a good idea to preview it to see if it works before making it available to students. When you preview the quiz, you will experience it as a student.



    4. Administer your quiz

    While the quiz is open, you can view how students are progressing (submitted or not, how many attempts so far etc). Once the quiz has closed, you can finalise the grades.



    5. Review your quiz

    Reviewing your quiz (question validity, student experience and learning outcomes, alignment with topic learning outcomes) entails collecting data, analysing the data, and acting on it. Your data may also include student feedback – verbally and electronically. This step feeds into future quiz planning (step 1).


      Training and support

      Troubleshooting

    Training

    Quiz workshop

    Support

    eLearning support teams

    You may have one of the following issues:

    Quiz - manually mark/grade essay (or other) questions

    1. Plan  |   2. Build  |  3. Test   |  4. Administer  |  5. Review  ||  Support

    quiz iconThis entry relates to the Quiz activity.

    Your quiz may have a range of question types, including essay and/or short answer. The Essay question is the only one designed for manual grading.


    Manually grade an essay question

    The Manual grading report enables markers to manually grade written submissions within a quiz. This grading method is automatic for the Essay question type (irrespective of what the quiz is set to).

    1. In the topic, click on the Quiz activity
    2. Click on the Actions menu cog in the top-right corner, then select Manual grading
      Action menu icon
    3. In the Questions that need grading screen, click on the grade link in the To grade column 
      Questions that need grading - to grade column 

    4. Use the Options section to choose which questions to mark and the order in which they appear
      Options section 

    5. Underneath the options, you will see a list of student responses to be marked.
      The student's response appears in the blue box. Include your comments and a mark in the green box  
      Student response to be marked  

    6. Click Save and go to next page when you have finished marking all those displayed. When you have marked all of the questions, you will be prompted to return to the Questions that need grading screen, with the responses that you marked now appearing in the Already graded column. 
      All selected attempts have been graded  


    Manually grade automatically graded questions

    If you want to manually grade questions other than the essay question (eg the Short answer question type), you will have to override the automatic mark for that question. 

    1. In the topic, click on the Quiz activity

    2. Click on the Actions menu cog in the top right corner, then select Manual grading
      Actions menu

    3. Click on Also show questions that have been graded automatically (above the table of questions and grades)

    4. In the next screen, find the Already graded column and click on the Update grades link
      Update grades

    5. Use the Options section to choose which questions to mark and the order in which they appear
      Options section      

    6. Underneath the Options, you will see a list of student responses to be marked. The student's response appears in the blue box. Include your comments and a mark in the green box. Save the changes.