Sunday, 19 September 2021, 5:35 AM
Site: Flinders Learning Online
Topic: FLO Staff Support (FLO_Staff_Support)
Glossary: How-to glossary

#### Quiz - main entry

Whether you are starting from scratch or working with a quiz already created, using the quiz activity in a topic ideally consists of 5 stages, in a looped process.

##### 1. Plan  |  2. Build  |  3. Test  |  4. Administer  |  5. Review  || Support

The Quiz activity enables a teacher to create out-of-class quizzes comprising questions of various types, including multiple-choice, matching, short-answer and numerical. See Active quiz if you wish to use a quiz in a face-to-face lecture/tutorial (ie in class), with a classroom of computers/tablets/phones (devices).

##### Accidentally deleted a quiz?
It's important that you don't use the recycle bin to restore a deleted quiz. Refer to the quiz troubleshooting page, I accidentally deleted a quiz and want to restore it, for further information.

#### Good practice guides and tip sheets

Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to quiz-related resources are provided below.

#### 1. Plan your quiz

The better your planning, the less likely you are to run into a problem once students start doing the quiz. Therefore, it is advised that you have a process for creating your quiz. Your college may have policies or guidelines around quizzes. Whether you are starting from scratch or revising a current quiz, these concepts, planning questions and tips that may help:

• What is your quiz's purpose? The answer will determine the settings you choose when you create the quiz.
• What principle/knowledge are you testing – does the quiz item test it?
• Line up quiz questions against the learning outcomes (you could include this information in the quiz question)
• Connect the questions with Bloom's level/s of taxonomy (Wikipedia) – again, what is being tested?
• Be creative – you could use scenarios, embed videos/other resources, provide learning pathways (eg hints, tips, more information, think again)

Follow the links below to start the process.

#### 2. Build your quiz

You have planned your quiz – its purpose (which determines quiz settings), the category/ies and questions, the feedback you will provide. Now you are ready to set up the quiz.

1. Create a quiz
2. Add questions to a quiz (edit quiz) – including random questions
3. Edit quiz questions (and regrade quiz)
4. Calculate a topic total including the best X from Y grades – if you have multiple (eg weekly/two weekly) quizzes in a topic and want to count the best 8 out of 10 (for example)

#### 3. Test your quiz

You've created your quiz and added questions. If you are confident the quiz is ready, it is a good idea to preview it to see if it works before making it available to students. When you preview the quiz, you will experience it as a student.

While the quiz is open, you can view how students are progressing (submitted or not, how many attempts so far etc). Once the quiz has closed, you can finalise the grades.

#### 5. Review your quiz

Reviewing your quiz (question validity, student experience and learning outcomes, alignment with topic learning outcomes) entails collecting data, analysing the data, and acting on it. Your data may also include student feedback – verbally and electronically. This step feeds into future quiz planning (step 1).

Training and support

Troubleshooting

Training

Support

You may have one of the following issues:

#### Quiz - troubleshooting

This entry relates to the Quiz activity.

#### I can't see questions from other quizzes

If you create a quiz, then add 'a new question' rather than add 'from question bank' (Actions menu > Edit quiz screen), you may stumble into this problem. If you leave the Category as 'Default for [topic name]' or choose another category that you have already created, there won't be a problem. But if you choose the category ‘Default for [quiz name]’ from the pull-down menu, the questions will belong to the quiz and you won't be able to see or use them for any another quiz in the topic (e.g. in a revision quiz, or an end-of-topic exam that draws from questions used in formative quizzes throughout the topic).

##### Solution to prevent this problem

Do one of the following:

• Option 1: Go to Question bank from your topic homepage (Topic Management > Question bank). Create a category/ies and questions first, before you create the quiz, then add questions into your quiz 'from question bank'

• Option 2: Create a category, then create the quiz and 'add a new question', making sure the new question is saved in the category you created

We strongly advise option 1 as the best approach to creating quizzes. See Add a category to the question bank for more information.

##### Solution if you have this problem

If you already have this problem and need to use your questions in other quizzes:

1. From your topic home page, go to Topic Management > Question bank > Categories
2. Create a new category (probably best to make the parent category 'top')
3. Go to your existing quiz, then Actions menu > Question bank
4. Select all questions which are in the quiz's default category, then using the 'With selected' menu at the bottom of the page, move to your new category

Note: Questions can be moved to different categories even if they are already used in quizzes, though be careful if they are used as random questions in a quiz.

#### I can't unhide the grade column for a quiz

Quiz results visibility settings are controlled within the settings of the quiz activity, not in the gradebook.

Please see the entry Create a quiz – scroll down to Review options for further information.

#### I can't add/delete questions in my quiz

Once a quiz has been attempted, no additional questions may be added to that quiz, and no questions can be deleted (removed).

The following message will display, and the Add to quiz or Delete button will appear greyed out.

You can however delete questions if no attempts have been made.  To delete multiple questions:

1. Click Select multiple items button
2. Click Select all or select individual questions
3. Click Delete selected

4. You will be asked to confirm deletions, check these are the questions you want deleted
5. Click Yes

#### I have assigned answers to a quiz question incorrectly

If, before a quiz opens, you discover that a question requires editing or correction, it can be easily edited. Enter the Question bank and locate the relevant question, then select the edit cog besides it.  After making the required changes, click Save changes.

If you discover the error after student access has commenced, it is possible to regrade your quiz. To regrade a quiz attempt you will first need to edit the quiz question that needs changing. When a quiz question is altered all instances of that question will be altered (eg if the question is used in another quiz it will also be altered). Students will not be notified of the changes made.

#### I accidentally deleted a quiz and want to restore it

##### What you should do

If you accidentally delete a quiz and want to restore it you can either:

• recreate the quiz – deleting the quiz activity does not delete the questions from the question bank (the original questions are available to use)
• contact your local eLearning support team to discuss if it's possible to restore the quiz from a previous availability.
##### What you should not do

You may be aware that you can restore deleted activities from the recycle bin, however, this is not recommended for quizzes. Restoring a quiz from the recycle bin will duplicate the question bank (make a copy of each question). If quizzes in your topic use random questions, students may receive the same question more than once. If you've restored a quiz from the recycle bin you will need to delete the duplicate questions before any quiz with random questions opens. Duplicate questions have '(copy)' appended to the question name.

If you need help, contact your local eLearning support team.

#### Quiz - purpose and settings

This entry relates to the Quiz activity.

These quiz setting guides focus on ways you might want to use the Quiz activity. Where relevant, they link to related quiz entries for further details.

#### Good practice guides and tip sheets

Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to quiz-related resources are provided below.

#### Self/skills assessment quiz (non-graded)

Where there is no right or wrong answer

The quiz is not assessed. You and your students could use it as a learning tool to assess their knowledge and/or skills, or identify gaps. Students could also 'self-assess' and/or determine their self-efficacy or self-confidence. Feedback on their question answers could personalise support through linking to resources University-wide or providing resources specific to the topic. View the quiz example set up for this purpose.

##### Quiz settings

Actions menu > Edit settings

• Grade to pass: 0.00
• Attempts allowed: Unlimited/1 (depending on purpose)
• How questions behave: Deferred feedback
• Review options: The attempt

##### Edit quiz

Actions menu > Edit quiz

Change the maximum grade in the quiz itself to 0 (default is 10). The quiz will function as normal, but the quiz will not appear as a grade item in gradebook.

• Maximum grade: 0.00 (‘Editing quiz’ screen)

##### Question settings

• Each choice option (MCQ) worth 100%
• Question is worth 0 (default mark)

Topic Management > Topic Settings > Gradebook setup

Check the gradebook. To make a quiz item worth 0 in the gradebook, change the weighted mean of grades to 0 for that item (Gradebook setup > Setup > Weights), if required.

#### Practice quiz (non-graded)

Where there are right and wrong answers

The purpose of the quiz is other than to grade. You might use it as a learning tool to give students a way to test their knowledge as the weeks progress. Providing feedback that they can action or understand at a deeper level will be helpful. It is also a teaching tool to see how students are going, whether there is a gap in understanding for one/many, whether a deeper level of engagement is required (e.g. more resources, more class time).

##### Quiz settings

Actions menu > Edit settings

• Grade to pass: X.00 (choose any number between 0 and 10) – if using activity completion and/or restrict access, otherwise leave blank
• Attempts allowed: Unlimited/1... (depending on purpose)
• How questions behave: Deferred feedback; interactive with multiple tries...
• Review options: The attempt; Whether correct, Specific feedback, General feedback, Overall feedback (suggestions only)

##### Edit quiz

Actions menu > Edit quiz

Maximum grade: Change the maximum grade for the quiz to the total of all questions (e.g. for 4 questions worth 1, 2, 2 and 4 the maximum grade would be 9). FLO will calculate a final grade according to the weighting for the quiz in the gradebook. Both student and teacher will be able to see what they got for the quiz (x out of x).

##### Question settings

• Question is worth 1 (default mark) or whatever you think it is worth
• MCQ: With 1 correct answer (one answer only option), this answer must be worth 100%; with multiple correct answers (multiple answers allowed option), they must add up to 100% (e.g. if there are 2 correct answers, each would be worth 50%). See Create a multiple choice question (MCQ) for more details.

Topic Management > Topic Settings > Gradebook setup

Check the gradebook. To make a quiz item worth 0 in the gradebook, change the weighted mean of grades to 0 for that item (Gradebook setup > Setup > Weights).

Where students are given the opportunity to extend their knowledge/understanding through feedback and prompts

The purpose of the quiz may be to grade/not grade. If you do not intend to grade the quiz, refer to the settings for non-graded quizzes above.

Interactive with multiple tries

You can use the 'Interactive with multiple tries' settings to give students a rich experience with learning pathways – they can choose to extend their learning or correct their learning in an informed way, through feedback that provides links to resources or embeds resources such as videos or images. Hints are provided with this setting to enable students to try again (if more than one try is enabled). Rich feedback deters students from guessing. If grading this quiz, you can set a penalty for requiring a hint, if set to multiple tries.

##### Quiz settings

• Attempts allowed: Unlimited (if you want to restrict the number of attempts, the number of hints is one less than the number of attempts)
• How questions behave: Interactive with multiple tries
• Review options: During the attempt; Immediately after the attempt; Later, while the quiz is still open

##### User experience

If the quiz setting for Question behaviour > How questions behave is 'Interactive with multiple tries', the student can see a Check button once they have answered a question. They can reattempt the question by clicking 'Try again' and selecting another answer. You can provide both Specific feedback (answer choice) and General feedback (on the question as a whole) to help the student.

When the student finishes the quiz, they get a prompt to 'Return to attempt' or 'Submit all and finish'.

When the student finishes the quiz, they can also click on a 'Review' link (depending on the boxes ticked under Quiz settings > Review options) and see their answers to one/more attempts. They then get the option to 'Submit all and finish'.

Once they 'Submit all and finish', they receive the Overall feedback (quiz settings) if any is provided.

They can go back in later and review their quiz responses (Quiz settings > Review options). This is handy if they want to remember something about their responses but do not want to do the quiz again (they may not have this option anyway).

#### Summative quiz (graded)

Where students are tested on their knowledge/understanding for grading purposes

A summative quiz is likely to test a body of work so could be set to occur near the end of the topic, or at the end of a module. It will be listed in the Statement of Assessment Methods as a grade item valued at a percentage of the final grade. Because it is testing the student, they have less options when they do the quiz. They may receive feedback for each question, but are unlikely to be able to do the question again. Overall feedback for the attempt is a key area to support the student's learning.

Deferred feedback

With this setting, students must enter an answer to each question and then submit the entire quiz, before anything is graded or they get any feedback. While all review options are editable, you would not choose the Review option 'Later, while the quiz is still open' for a graded quiz.

##### Quiz settings

• Attempts allowed: 1
• How questions behave: Deferred feedback
• Review options: After the quiz is closed (all options ticked by default). If there is a possibility that students may request extensions/overrides, you can leave all the review options turned off until you are confident all students have attempted the quiz. You may decide to only show the Marks once the quiz is closed.

In the quiz settings, you can decide on how much Overall feedback to give students at the end of the quiz. You could use grade boundaries to tailor feedback.

##### User experience

If the quiz setting for Question behaviour > How questions behave is Deferred feedback, this is what happens when the student attempts a question. When they attempt a question, they may get feedback for their response, depending on how you have set up the individual question, but will move through the quiz without reattempting a question.

When the student finishes the quiz, they get the prompt to 'Submit all and finish'.

Once students click 'Submit all and finish', they receive the Overall feedback (quiz settings).

Students can go back in later and review their quiz responses (Quiz settings > Review options). This is handy if they want to learn from their responses, perhaps for a final assessment item.

#### Short-text response quiz (graded)

Where students are manually graded on their submitted text answers (< 300 words is a guide)

To set up this type of quiz (it may only be one question that requires manual grading), you need to create an essay question.

#### Quiz - create a quiz

This entry relates to the Quiz activity.

You have added a category to the question bank and created questions. Now you can create the quiz, then add questions to it.

#### Steps

##### Add the Quiz activity
1. In the topic, click the Turn editing on button

2. In the week/module where you want to add the quiz, click Add an activity or resource

3. Select the Quiz icon
##### Name and description

Give the quiz a Name and Description

##### Timing

Under Timing, you can choose to give the quiz Open and Close dates. Tick the Enable box to the right of the date you wish to enter, then enter the date.

Timeline block: The 'Close the quiz' date will show to students in the Timeline block.

Depending on the purpose of your quiz, you may want to change the default settings (see below). You can also click the prompt next to some options to find out more about a setting.

You can make the quiz available at different times for different groups or users in the sections of the Administration > Quiz administration settings block.

• Before the opening time, the quiz will be unavailable to students – they will be able to view the quiz introduction but not the questions. Quizzes with start times in the future display both the open and close date to students.
• After the closing time, students will:
• not be able to start new attempts and any open attempts will be automatically submitted.
• still be able to see the quiz description and review their attempts. What they see will depend on the settings you choose for Review options (ticked boxes in the 'After the quiz has closed' column).
###### Time limit

If enabled, the time limit is stated on the initial quiz page and a countdown timer is displayed in the quiz navigation block (see image to the right). Once the timer runs out, the quiz is submitted automatically. If the quiz close time is reached before the time runs out, the quiz will be automatically submitted (ie student does not get full time). You can make the quiz last a different period of time for different groups or users in the  Group overrides or User overrides  sections of the Administration > Quiz administration settings block.

If you have categories in your gradebook (eg for a quiz set), select the category you wish the quiz to be in here.

###### Attempts allowed

Unlimited (default), 1-10

Your choice here depends on what and how you are testing (ie the purpose of your quiz):

• If a diagnostic test, then probably choose 1; if a formative test, then maybe more often as the student is in the learning process.
• If the quiz is shuffled (see Layout) or has random questions (see quiz - add questions), then the student will get a new version for each attempt, useful for practice purposes.

You can change the allowed number of attempts for different groups or users in the Group overrides or User overrides sections of the Administration > Quiz administration settings block.

Highest grade (default), Average grade, First attempt, Last attempt

This setting only applies if more than 1 attempt is allowed. If each question builds on the last, you might set it at Last attempt, as you want to see that students are gaining knowledge/understanding progressively.

##### Layout
• Question order: Shuffled randomly – if selected, the order of questions in the quiz will be randomly shuffled each time a student starts a new attempt at the quiz.
• New page: you may want to group questions on a particular topic together, but not too many on one page as this will require students to scroll.  It is recommended that you do not use the setting 'never, all questions on one page', as student activity within the quiz will be less frequently logged and less information will be captured regarding the attempt.
Note: You can change how many questions per page in Quiz administration > Edit quiz. You can Repaginate (eg 2 per page instead of 1 per page), or select questions and move them to a particular page.
• Navigation method: leave as Free (default) unless the quiz is building knowledge (last question relates to next question etc).

##### Question behaviour
• Shuffle within questions: if Yes (default), the option must also be enabled in question settings (when you create a new question).
• How questions behave: Deferred feedback (default) – students answer each question and submit the entire quiz, before anything is graded or they get any feedback.
Note:
CBM stands for 'certainty-based marking' – if you choose this option, students will need to say how sure they are that the answer is right and will be penalised accordingly. More information about CBM (MoodleDocs)
• Show more… > Each attempt builds on the last: if multiple attempts are allowed and you set this to Yes, then each new attempt contains the results of the previous attempt, so students can concentrate on just those questions they answered incorrectly last time. If you choose this option, each attempt by a particular student uses the same questions in the same order, independent of randomisation settings. To show a fresh quiz on every attempt, select 'No' for this setting.
##### Review options

Tick the options you would like to choose from the table. Default settings are After the quiz is closed.

These settings can affect the visibility of the grade column for a quiz. See Quiz - troubleshooting ('I can't unhide the grade column for a quiz'for more information.

##### Appearance
• Decimal places in grades: Default is 2. This option determines how many digits will be shown after the decimal point when the grade is displayed. A setting of 0 for example will display grades as integers (whole numbers).
Note: If you use CBM (certainty-based marking) which deducts marks for not being certain, being wrong about being certain etc, then it makes sense to show the decimal places in grades. Likewise for 'Decimal places in question grades'.
• Show blocks during quiz attempts: Default is No – this is about usability (better display, no distractions).
##### Extra restrictions on attempts

These settings may be useful if you are using a FLO quiz as a final exam.

• Require password: if you specify a password then participants must enter the same password before they can attempt on the quiz.
• Require network address: you can restrict access for a quiz to particular subnets on the LAN or internet by specifying a comma-separated list of partial or full IP address numbers (eg 192.168. , 231.54.211.0/20, 231.3.56.211). This is especially useful for an invigilated quiz/exam, where you want to be sure that only people in a certain room are able to access the quiz.
Note:  the Flinders network is not configured to allow restricting access to a given room.
• Enforced delay between attempts: You can set a time (from seconds to weeks) between the first and second attempt on a quiz. You can also (or alternatively) set a time from seconds to weeks for subsequent attempts after the second attempt (eg you might allow a student to take the quiz twice immediately with no delay, but if they want to improve their score with a third attempt, they are forced to wait a week and use the time for extra revision).
• Show more… > Browser security: the options in this section offer various ways to try to restrict how students may try to 'cheat' while attempting a quiz.
##### Overall feedback

Overall feedback is feedback shown to a student after they have completed an attempt at the quiz. You can set the grade boundary (eg 100%, 65%, 50%) and apply appropriate feedback according to the range the student falls within (eg if a student gets below 65% they are referred to more information). This is a useful feature in a formative quiz where students are informing themselves/the teacher what they know/understand.

##### Common module settings

These settings are only relevant if you have groups and groupings set up in your FLO site.

• Group mode: you can choose whether the quiz should be organised by group.
Note: This only affects the results screen and allows you to filter results based on group enrolment.
##### Restrict access

None (default), Activity completion, Date, Grade, User profile, Restriction set

For example, you might have a series of quizzes and they need to do one before another – this would be the activity completion option but you would first need to enable completion tracking in the topic settings and quiz activities.

##### Activity completion

Apply these settings if you have enabled completion tracking for the topic and this activity.

#### Quiz - add a category to the question bank

This entry relates to the Quiz activity.

• All questions are stored within the question bank
• Categories are created in the question bank and are used to organise questions
• Sorting questions into categories is especially important when random questions are used or a topic contains many quizzes
• When a quiz delivers random questions, those questions must be stored in a dedicated category (or sub-category)

If you add a category before you add questions to the question bank, all questions created can be added to this category and they will then belong to the topic, rather than the quiz. This approach will make management easier when you are creating new quizzes using questions from previous quizzes.

Categories can be created within an existing category (ie a sub-category).

#### Steps

1. Go to Topic Management > Question > Category

2. Scroll down the screen (categories may already be listed, that you can edit) you will see the option Add category

3. Choose a Parent category from the pull-down list (defaulted to your topic name) – you are most likely to leave it at your topic name, but you could also add a sub-category within an already created category

4. Give the category a Name

5. Add Category info (optional)

6. Click ID number (optional)
7. Click Add category button

8. The new category should be listed under the relevant Parent category

9. Once created, you can also Edit categories (rename, add/change category info), delete, re-order and indent (make into a subcategory).

#### Tool options - quiz and survey

Tool options (specific purposes)  ||  Support

These tools are available in FLO. For external tool options, contact your local eLearning support team.

 What do you want to do? Tool options Self-assess/check knowledge/mini-test Active quiz (in class)Create a session to test students' knowledge/other purpose; view the results in class (real time) (can be anonymous or with names) Choice (in class)Ask a single question and offer a selection of possible responses; view in class (can be anonymous or with names). Purpose could be to quickly test understanding Quiz (out of class)At the end of a week/module, at the beginning of a topic, can be non-gradedFeedback (out of class)One or two questions to check understanding (active teaching) – can be anonymous, non-graded Poll students Active quiz (in class)Create a session to test students' knowledge/other purpose; view the results in class (real time) (can be anonymous or with names) Feedback (out of class)One or two questions to check understanding (active teaching) – can be anonymous, non-graded Choice (out of class)Ask a single question and offer a selection of possible responses; view in class (can be anonymous or with names). Purpose could be to stimulate thinking, quickly test understanding, or facilitate decision making/voting Get formative feedback about how students are going Touchpoint survey (out of class)Anonymous, can add more questions or change questions Give students exam practice (using questions from past exams) Quiz (out of class)At the end of a week/module, can be non-graded Give a topic exam Use a FLO quiz as a final exam (in/out of class)There are four suggested stages to this quiz purpose, which requires advanced planning. Develop students' critical thinking skills (in/out of class)Questions could be set up to solve a problem or choose the best outcome/s for a scenario – a range of questions can be used Deliver immediate feedback about performance Active quiz (in class)Run a real-time session and view results as a group (can be anonymous or with names)

#### Quiz - add questions (including random questions) to a quiz (edit quiz)

##### 1. Plan  |   2. Build   |  3. Test   | 4. Administer   |  5. Review  ||  Support

This entry relates to the Quiz activity.

If you want to add questions from a text file rather than creating them in the question bank (this can save time), see Import questions (multiple choice in a text file). Contact your eLearning support team if you need assistance with this process.

#### Steps

1. Add questions (and shuffle if you want) (Build step)
2. Add random questions to a quiz (if required) (Build step)
3. Add a module heading (if required) (Build step)

##### 1. Add questions
1. Click on the quiz you have created

2. If no questions have been added to the quiz yet, you will see image on the left, and clicking the Edit quiz button will take you to the edit quiz page. If your quiz already has questions, the screen will have a preview quiz button instead (the image on the right).

3. To access the edit quiz page for a quiz that already has questions, click on the cog in the top right corner and select Edit quiz

4. Click the Add link. You can also tick the Shuffle box so that the order of questions you add to the quiz is randomised at each attempt
5. Click the from question bank option. (You can also select a random question – see below)
6. Select a category when the questions are located, or search for tags that your questions have been tagged with.

7. Click the box next to the questions, click Add selected questions to the quiz.

##### 2. Add random questions to a quiz (if required)

You may want to add random questions to the quiz so that students don't get all the same questions at the same time. To do this you need extra questions in your question bank (eg if you have 20 questions in the quiz, you will ideally need an extra 10).

1. Follow steps 1-3 above. At step 4, choose + a random question

2. Select a category when the questions are located, or search for tags that your questions have been tagged with.

3. Select the number of questions you wish to add and click Add random question

##### 3. Add a module heading (if required)

If you have several questions (eg > 10) and it would make sense to group them, you can add a module heading. With a quiz of 20 or more questions using free navigation, headings may be particularly helpful to the user.  Another use for modules could be to shuffle questions within sections rather than shuffling all questions throughout the quiz.

1. To add a heading above the first question, click the pencil above the question, type the heading title, then press Enter
2. If you want to add a module heading to later questions, click on the Add pull-down menu and select 'a new module heading'. It will be created above the question you clicked next to

3. To rename the module heading click on the pencil icon to create a heading.

Headings added using step 2 can be deleted by clicking on the trash icon.

#### Quiz - create a new question (question types)

This entry relates to the Quiz activity.

#### Create in the question bank or in the quiz

NOTE: Before creating questions, you should set up categories in the question bank. Then use one of the two methods below to create questions in those question banks.

##### 1. Create from within the question bank
1. Navigate to the question bank from your topic’s Topic management menu

2. Select the category you want the question to be in.

3. Click on the Create new question button and choose the desired question type

4. Enter the details of your question.

5. Save your question. You'll then be taken back to the question bank category where the question is

6. Click on the Edit link to the right of your question and select Preview to test if it is working as expected

Tip: If you want a series of similar questions, you can duplicate then edit questions

##### 2. Create from within the quiz
1. Open your quiz
2. Click on the cog in the top right corner and select Edit quiz

3. Click on one of the Add links on right side of the page, then select a new question

4. Enter the details of your question, making sure you choose an appropriate question bank category* for your question

5. Save your question. You'll then be taken back to your edit quiz page.

6. Click on Edit to the right of your question and select Preview from the dropdown list to test if it is working as expected

*Note: We strongly recommend that you do not use the category "default for your quiz name" as this category is segregated from the question bank. Questions in that category can't be used in other quizzes and can't be viewed with the main question bank. Storing questions in this segregated category can lead to confusion.

#### Create a new question (from question types)

Choose a question type and follow the instructions for creating under a category:

#### Import/export questions

You could also import questions from a file, or export questions to a file – talk to your eLearning support team.

#### Duplicate (copy) a question

1. Open the question bank you want to duplicate a question in

2. Find the question you want to duplicate

3. Click on the Edit link next to the question and select Duplicate from the menu that appears.

4. The question will open in an editing screen, where you can make the changes you want (eg to the Question name) and continue editing

5. Click Save changes when you have finished editing the question duplicate

6. The duplicated question will now appear on your list of questions.

#### Quiz - provide quiz feedback at quiz and question level

This entry relates to the Quiz activity.

Providing feedback is an excellent way to increase student engagement when they attempt and review a quiz. Feedback can be customised to address particular student responses to a question, the question more generally, or the total score achieved by the student. It can be delivered during the quiz, after the attempt but before the quiz has closed, or after the quiz has closed. The amount and quality of feedback you provide will depend on the quiz's purpose.

• Inclusion and release of feedback can increase the complexity required in quiz set-up. For help, please contact your local eLearning support team.

• Release of feedback to students is controlled by the quiz Review settings in conjunction with the Question Behavior setting. Please see 'I can't unhide the Grade column for a quiz' (Quiz - troubleshooting entry) for further information.

#### Good practice guides and tip sheets

Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation. Links to quiz-related resources are provided below.

#### The three types of feedback – specific, general and overall

• Specific feedback is feedback specific to, and dependent upon, the response the student gave to a question. It is response-specific.
Specific feedback is set up at the question level – when creating the question or later by clicking the edit cog   beside the question

Student view:

• General feedback is feedback shown to the student after they have completed the question. The same feedback is shown for all students, regardless of the response they gave. You can use the general feedback to give students a fully worked answer and perhaps a link to more information they can use if they did not understand the question.
General Feedback is set up at the question level – when creating the question or later by clicking the edit cog     beside the question

Student view:

• Overall feedback is the text that is shown after a quiz has been attempted. By specifying additional grade boundaries (as a percentage or as a number), the text shown can depend on the grade obtained
Overall Feedback is set up in the quiz's settings
In the scenario below, students scoring between 100% and 80% will see the message 'Well done'.  Those who scored between 79.99% and 0% will see            the message 'Please study this week's work again' (100% and 0% do not need to be entered, as they are the default grade boundaries):

Student view:

#### Quiz - create a drag and drop question

This entry relates to the Quiz activity.

#### Create a drag and drop into text question

Want to see how this question type works?

##### Steps
1. In the question bank (Administration > Question bank), click Questions, then Create a new question… (You can also do this in Quiz administration > Edit quiz)

2. Select Drag and drop into text and click Add

3. Supply your question with a Question name (required field) and Question text (required field):
In your question text, leaves 'gaps' indicated by two sets of square brackets with a number inside.  This number will indicate the correct choice for that gap

4. Provide the question a default mark and enter any general feedback (shown to the student after they have completed the question)

5. Enter Choices:
Decide whether to shuffle the choices (tick the box or leave unticked).  Shuffling is recommended to prevent student's from surmising the correct answer based on choice order.

The choice with the same number as the numbered text gap is the correct answer for that gap:

6. To add additional 'incorrect' drag and drop answers, add additional choices that do not correspond to a numbered text gap. (in this example there is no text gap labelled [[4]], thus 'green' will be an additional option that is not the correct answer to any question)

7. If using multiple choices for each question, it may be useful to Group the choices.
Each group will be represented by a different colour, which will apply to both the relevant gap(s) in the text and to the choices for that group.

Avoid using groups in simple questions with only as many choices as correct answers.  In this scenario the use of groups will give away the answers.

8. You can preview the question to check that it works correctly before clicking the Save changes button:

9. Click Save changes (you can now preview the question by choosing it in the question bank list and clicking the preview icon

#### Create a drag and drop onto image question

For this question type, you will need to have an image to drag and drop text/images onto. If you source an image from the internet, but be careful about copyright/usage (eg use Creative Commons and check the licensing).

Want to see how this question type works?

#### Steps

1. In the question bank (Administration > Question bank), click Questions, then Create a new question…

2. Select Drag and drop onto image and click Add

3. Give the question a Category, a Question name (required field) and enter Question text (required field)

4. Decide on the default mark for the question (required field)

5. Fill in General feedback (students will see this once they have answered the question). You could include the correctly labelled image in this box. Students can then see if/where they made an error. This box is seen by all students regardless of whether their response was correct or incorrect
6. Select a Background image file and drag and drop it into the box provided, or Choose a file... by searching on your computer (the image should not be larger than 600 pixels width so you may have to resize it). If you are searching the web (eg Google images), for an image be careful about copyright and usage

7. Under Draggable items (scroll down), for the Type choose either Draggable image or Draggable text (most likely you will use text). Upload an image, or type text into the textbox that you want dragged to an area of the background image you have uploaded. Choose a Group to give each image or text item (eg 1, 2, 3...). Do this for as many items as are relevant.
You can also tick the box Shuffle drag items each time question is attempted.
If you tick the Infinite box, this means choices may be used in multiple locations.
Note: within draggable text items, limited formatting of text is possible using <sub> (subscript), <sup> (superscript), <b> or <strong> (bold), <i> or <em> (italics) and <br/> (line break)

If Draggable image is selected:

If Draggable text is selected:

8. In the Drop zones section (scroll up), for Drop zone 1, choose the Draggable item from the pull-down menu (this will be whatever you have entered in the Draggable items section). These items should now appear below the background image you placed in the question.
9. Drag the images/text onto the background image – this will populate the drop zone boxes in the Drop zones section with coordinates

10. Click Save changes (if you miss one of the steps, you will stay in the editing screen and a red highlight will tell you what you have missed)

11. In the Question bank screen, the new question should be highlighted. Click on the magnifying glass icon to the right of the question name to preview the question. Click on the cog icon to edit the question

#### Quiz - create a fill-in-the-blanks (missing words) question

This entry relates to the Quiz activity.

Want to see how this question type works?

#### Steps

1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question

2. Choose Select missing words and click Add

3. Give the question a category

4. Give the question a name (required field) (this is only seen by teachers – make it something meaningful so when you view the questions in a list, you know what they are about)

5. Enter some question text. Where you would like the student to choose the missing word, enter a number on double square brackets, for example [[1]]. Number each gap sequentially starting at [[1]] – that is, [[1]], [[2]], [[3]] etc (required field)

6. Give the question a default mark (required field)

7. Fill in the choices. Choice 1 is the correct answer for the gap indicated by [[1]], choice 2 is the correct answer for the gap indicated by [[2]], and so on.

Choices with the same value for Group appear in the same drop-down lists (Shuffle)

8. Fill in General feedback for the quiz question

9. Click Save changes

#### Quiz - create a matching question

This entry relates to the Quiz activity.

Want to see how this question type works?

#### Steps

For this question type, you must provide at least two questions and three answers. You can provide extra wrong answers by giving an answer with a blank question. Entries where both the question and the answer are blank will be ignored.

1. Under Topic administration > Question bank > Questions, click Create a new question

2. Select Matching and click Add

3. Give the question a Category

4. Give the question a Question Name (required field)

5. Enter question text (required field)

6. Decide on the default mark for the question (required field)

7. Fill in General feedback (students will see this once they have answered the question)

8. Add the text for Question 1 and the answer

9. Add the text for Question 2 and the answer

10. Continue adding text for questions and the answer. You can provide extra wrong answers by giving an answer with a blank question

11. Click Save changes

#### Quiz - create a multiple choice question (MCQ)

This entry relates to the Quiz activity.

#### Create an MCQ

Want to see how this question type works?

##### Steps
1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question

2. Select Multiple choice and click Add

3. Give the question a category

4. Give the question a name (this will only be shown to teachers) (required field)

5. Fill in question text (required field)

6. Give the question a default mark (required field)

7. Enter some general question feedback

8. Choose whether the question has one answer only or multiple correct answers. 'One answer only' means users will only be able to select one box; 'Multiple answers allowed' means users will be able to select more than one box (if there is a specific number of correct answers, you may want to say this in the stem/lead-in sentence: 'Please select two of the following.')

9. Select whether you want to shuffle the question answers

10. Under Answers, fill in the choices

If you selected multiple correct answers for the MCQ (see step 8 above), you are advised to give wrong answers negative scores, to discourage students from selecting all options (you should say that they will be penalised for wrong answers in the question stem)

11. For the correct answer, change Grade to be 100%. If there are multiple correct answers (see step 8 where you would need to have selected 'Multiple answers allowed'), allocate the 100% across all correct options; for example, if there are 2 correct responses allocate them 50% each. (Note: they do not need to have equal weightings)

Assign to an incorrect answer

Assign to a correct answer in a question with one correct answer

Assign to a correct answer in a question with multiple correct answers

12. Click Save settings

#### Tips for creating MCQs

Bloom's level/s of taxonomy, what the item is testing (descriptor), and distracter plausibility:

 Question number x Correct answer (key) Learning objective Bloom's level of taxonomy Descriptor What the item is testing Distracter plausibility A....B....C....
##### Question tips
• Use a consistent style
• Use clear and concise wording (can be complex but not complicated)
• Make the question 'stem' either a direct question or an incomplete statement
• Avoid double negatives

You may want to use a 'stimulus' prior to the question – this could include introductory text/context, an image etc.

• Make the key (right answer) and distracters (wrong answers) approximately the same length, and use similar wording to avoid obvious standouts
• Keep answers consistent in grammar and logical to the stem (question)
• 3, 4 or 5 options per answer? There is no set preference, but the more options the harder it is to think up a plausible 'distracter'
• Avoid using 'none of the above' or 'all of the above' (especially if answers are shuffled!)
• Use a logical pattern but don't always put the correct answer in the same position
• Provide good feedback for all options (where relevant)
• Where possible, ensure that wrong answers represent a common misconception
##### Open response items
• Provide information to markers on full credit, partial credit and no credit
• If not marking for grades, provide good feedback on likely responses
##### References and resources

The Centre for University Teaching ran two workshops in 2013 with invited speakers from the Australian Council for Educational Research (ACER):
MacKinnon, Philip, MCQ assessment workshop 24 June 2013
Khoo, Siek Toon, Introduction to measurement concepts and assessment in education
"Bloom" search results (eLearning literature and resources collection)

#### Quiz - create a numerical question

This entry relates to the Quiz activity.

If you are interested in this question type, you may also be interested in Calculated, Calculated multichoice and Calculated simple. To create one of these types, at step 2 (below) select one of these options instead of Numerical.

Want to see how this question type works?

#### Steps

1. Open the quiz and either:
• Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
• Open the question bank and click on the Create a new question button

2. Select Numerical and click the Add button.

3. Give the question a Category

4. Give the question a Category Name (required field)

5. Enter question text (required field)

6. Decide on the default mark for the question (required field)

7. Fill in General feedback (students will see this once they have answered the question)

8. Select answer 1, the error for getting it wrong, and the grade. Do this for all other correct/incorrect answers

9. Provide feedback for the answer (whether right or wrong)

10. Under Unit handling and Units, decide on the configuration (this will only apply if the answer is not a whole number)

11. Click Save changes

12. Preview the question to make sure it works correctly

#### Quiz - create a quiz essay question

This entry relates to the Quiz activity.

The essay question in quiz requires manual grading (marking).

Want to see how this question type works?

#### Steps

1. Open the quiz and either:
• Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
• Open the question bank and click on the Create a new question button

2. Select Essay and click Add

3. Give the question a name (this is seen by teachers only) and fill in the Question text. You will probably want to change the Default mark to a number higher than 1

4. Provide general question feedback

5. If you want students to upload a file, select Allow attachments and choose a number from the drop-down menu (Note: if students are required to write a long essay as part of a quiz, we strongly recommend they write it in Word and either upload the file or copy and paste into the response box).

You can also list specific file types (e.g. docx, pdf, etc.) if you want to restrict what types of files students can submit.

6. Click Save changes

#### Quiz - create a short answer question

This entry relates to the Quiz activity.

This question type can be tricky if there is more than a one-word answer (which may have spelling problems!), or variations on the answer. You can avoid this problem by:

• using wildcards (*) – see information below Steps
• putting in the question stem (Question text) a proviso such as 'Please separate words with a comma' (if a two-word answer) or other similar guidance
• anticipating the variations and adding those to the answers with 100% as the correct grade for each variation

It would be a good idea to test this question on several users before you try it with students in the real situation, especially if it is assessed.

You can manually mark a short-answer question to avoid these problems.

Want to see how this question type works?

#### Steps

1. Open the quiz and either:
• Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
• Open the question bank and click on the Create a new question button

2. Select Short answer and click Add

3. Give the question a Category

4. Give the question a Category Name (required field)

5. Enter question text (required field)

6. Decide on the default mark for the question (required field)

7. Fill in General feedback (students will see this once they have answered the question)

8. Select the correct answer and grade

9. Provide feedback for the answer (whether right or wrong)

10. Click Save changes

#### Using wildcards

You can use the asterisk character (*) as a wildcard to match any series of characters. For example, use:

ran*ing
to match any word or phrase starting with ran and ending with ing

If you really do want to match an asterisk then use a backslash like this:

\*
If you want one question with the two answers fuel and oxygen, you ought to be able to limit the number of variants by writing:
fuel*oxygen
This would accept "fuel oxygen", "fuel, oxygen", "fuel; oxygen", "fuel and oxygen", "fuel & oxygen" "fuel oxygen", "fuel und oxygen" "fuel&&oxygen". It would even accept "fuel or oxygen", "fuel but not oxygen" "fuel|oxygen" .
##### Example

Here are some answers and scores for a question "What does a rocket burn?"

1. oxygen*fuel
with a score 100%
2. *fuel*
with a score 50%
3. *oxygen*
with a score 50%
4. *air*
with a score 40%
5. *
with a score of 0%

The order of the answers is important. The answers are evaluated from 1st to last. When a match is found the process stops. If no match is found, the question is scored wrong and the general response is used. It is a good practice to put a wildcard as the last answer so the evaluation process knows what to do when nothing above it matches.

If any answer is the right answer (eg a non-graded open-ended quiz), you could have as the only answer * (worth 100%). This means all answers are acceptable. Make the question worth 0, and if you make the quiz non-graded (i.e. worth 0) it will not appear in the Gradebook.

#### Quiz - manually mark/grade essay (or other) questions

This entry relates to the Quiz activity.

Your quiz may have a range of question types, including essay and/or short answer. The Essay question is the only one designed for manual grading.

If you want to manually grade questions other than the essay question (eg the Short answer question type), you will have to override the automatic mark for that question.

1. Click on the quiz to view in a new screen

2. Click on the Actions menu cog in the top right corner, then select Manual grading

3. Click on Also show questions that have been graded automatically (above the table of questions and grades)

4. In the next screen, find the Already graded column and click on the Update grades link

5. Use the Options section to choose which questions to mark and the order in which they appear

6. Underneath the Options, you will see a list of student responses to be marked. Update each entry and save the changes

#### Manually grade an essay question

The Manual grading report enables markers to manually grade written submissions within a quiz. This grading method is automatic for the Essay question type (irrespective of what the quiz is set to).

1. Open the quiz, click on the cog in the top right corner, then select Manual grading

2. In the Questions that need grading screen, click on the grade link in the To grade column

3. Use the Options section to choose which questions to mark and the order in which they appear

4. Underneath the options, you will see a list of student responses to be marked

5. Click Save and go to next page when you have finished marking all those displayed. When you have marked all of the questions, you will be prompted to return to the Questions that need grading screen, with the responses that you marked now appearing in the Already graded column.

#### Quiz - create a true/false question

This entry relates to the Quiz activity.

Want to see how this question type works?

#### Steps

1. In the quiz (Quiz > Quiz administration > Edit quiz) or question bank (Administration > Question bank), click Create a new question

2. Select True/False and click Add

3. Give the question a category

4. Give the question a Name (required field)

5. Enter question text (required field)

6. Give the question a default mark (required field)

7. Fill in general question feedback

8. Select the correct answer (true or false)

9. Enter feedback for response 'true'

10. Enter feedback for response 'false'

11. Click Save changes

#### Quiz - create an embedded answers (Cloze) question

This entry relates to the Quiz activity.

Want to see how this question type works?

#### Steps

To set up this question type, you need to generate cloze text. This means that where an answer is required, you will need to generate bracketed instructions so the answer can be marked automatically, and feedback generated. For example:

{1:SHORTANSWER:%0%tertiary#Sorry, that's incorrect~%100%primary#That's correct!~%0%secondary#Not quite, read the question carefully}

This can be a complex process if you are not familiar with it, and it is easy to make a mistake. You could try the Moodle Cloze editor (external resource) which can generate cloze from your text. Once generated, you can copy and paste it into the Question text area in this question.

1. Open the quiz and either:
1. Edit the quiz, click on an Add link on the right side of the page, and select + a new question.
2. Open the question bank and click on the Create a new question button

2. Select Embedded answers (Cloze) and click Add

3. Give the question a Category and Question name (required field)

4. Enter question text (this will include Cloze text – see note above) (required field)

5. Fill in General feedback (students will see this once they have answered the question)

6. Give a penalty and hint for each incorrect try

7. Click Save changes

#### Quiz - change quiz settings for a group or user (override/extension)

This entry relates to the Quiz activity.

In a quiz, you can change the dates, timing and the number of allowed attempts for groups or users. If you want to create a Group override, groups will need to be set up in your topic. This is likely to be an administrative step, once the quiz is running. You can also create an extension for a student using the Assignment extension tool.

#### Create a group or user override

A group or user override allows you to change some quiz settings for a student or group of students. The settings that can be changed affect the timing and duration of when students can do a quiz, and are generally used when a student is given extra time to do the quiz.

1. Click on the quiz

2. Click on the cog in the top-right corner of the page

3. Select Group overrides or User overrides

4. Click Add group override or Add user override

5. In the next screen, choose an override group or user/s (you can search for a user or scroll through a list) (required field)

6. Decide whether the group or user will require password, what dates the quiz will open and close on for this group or user/s, the time limit and attempts allowed. You only have to enter settings that are changing, not settings that are staying the same.

Timeline block: User overrides show to students in the Timeline block, marked as 'override'. Group overrides will not show to students in the timeline block.

7. Click Save (or Save and enter another override)

#### Create an extension using the Assignment extension tool

Although set up specifically for assignment extensions (hence you can choose the assignment from a drop-down menu), you can manually add other activities (such as a quiz) to the list of 'assignments', thus providing students and staff with a consistent extension application process for all assessable items in the site.

1. Click on the Assignment extension tool

2. Add a manual item (the quiz)

3. Follow the instructions for Assignment - grant extensions for assignments (Assignment extension tool)

After approving the request you will need to make the applicable changes to FLO – that is, the date change is not automatic. For a quiz, apply a user override.