The data captured by FLO can be used to inform practice – telling you whether students are engaging with your topic, what is working/not working, and any problems they may be having (eg failed login attempts).
Good practice guides and tip sheets
Good practice guides and tip sheets have been developed to support quality in both curriculum design and teaching practice. Good practice guides provide a pedagogical overview and tip sheets provide you with practical strategies and ideas for implementation.
Links to assessment-related resources are provided below.
Activity
report Useful for: Monitoring the utilisation of each resource and identifying underutilised resources
Topic
participation report Useful for: identifying students who have not engaged with key resources. You can send a message to all students who have not completed a certain task or accessed a resource
Participants – all logs
Useful for: A deep dive into an individual students’ engagement levels over time
Participants – outline report
Useful for: Quantitatively assessing a student's progress, in terms of what they have touched or looked at in the FLO site. For instance, have they looked at key resources provided?
Participants – complete report
Useful for: Qualitatively assessing a student's progress, especially if marking a student's work formatively.
Kaltura analytics Useful for: assessing which videos are being viewed, whether the majority of students are viewing individual videos, if students are watching videos more than once, how long students are watching videos.
Collaborate reports Useful for: assessing engagement with synchronous online classes. Polls in Collaborate can be useful for understanding students’ current levels of knowledge.
Reports on readings Useful for: identifying under or well-utilised readings.
Learning analytics can be used for short-term, rapid changes in teaching just-in-time approach, or in a long-term redesign approach to improving the topic’s overall pedagogical aims. Purposefully sourcing and using data can be successfully used to:
improve student learning outcomes
identify at-risk students
target teaching concepts which are difficult to comprehend using a just-in-time approach
design curriculum and inform teaching practices to enhance learning
inform students of their progress through the topic visually
2. Access reports
During the topic, you can access various reports that can tell you what students are doing in your topic. Reports can be accessed from different locations, but most can be also accessed from the reports screen. To access reports:
1. On your topic's home page, click on the Topic management panel
2. Click on the cog in the top-right corner, and then clicking on More…
3. Click on the Reports tab
Various reports tell you different things for different purposes:
Students with low FLO access levels can be identified in FLO by accessing the participants list in your FLO site.
Using the filters at the top of the screen, select:
Match = All
Select = inactive for more than (and determine the appropriate timeframe, eg. 1 week, 2 weeks)
Add conditions
Status = active
Roles = student
Clicking apply
filters will give you a list of all students who are active (enrolled) and who have not accessed FLO since the time selected. You can then select all students using the tick box function (at the top of the table).
Using the “with selected users menu” (bottom of the table) then allows you to either:
Contact students directly using the FLO message system (With selected users = Send a message)
Download the list (With selected users = Download table data as Excel) and bulk email the students. Another option is to use mail merge to generate a personal email using the student's first name.
Dates report
The Dates report shows you a list of dates in the topic. You can edit all dates (eg quiz, assignment) in one place using this report, so it saves you time.
1. On your topic's home page, click on the Topic management panel
2. Click on the cog in the top-right corner, and then clicking on More…
3. Click on the Reports tab
4. In the Reports tab, click on Dates
5. You will see an Activity filter screen
6. To see all activities, click Expand all (right-hand side of screen)
7. Change the dates you need to, and click Save changes at the bottom of the screen
Logs
Logs in FLO are activity reports. A teacher can use the logs report to create different reports that show activity in the topic. The log can be used to see:
how often a resource or activity has been accessed (see also Activity report)
if an individual student has viewed a resource or activity (see also Activity report)
when a student has participated in an activity (e.g. posted to a forum, attempted a quiz, submitted an assignment)
Note: Logs cannot reliably show how long a user has been doing an activity or has actually viewed a resource. The logs only show whether the resource was opened.
1. Click on the Topic management panel
2. In the User links column, click on Logs
3. Choose what you want to see and how (display on page, or download in a range of formats) 4. Depending on your choices, you will see a display of activity in your topic for a specified day
5. Depending on what type of activity you have set up and your parameters for participation, you may want to see the action/s View,Add, Update, Delete,All changes
6. Depending on your needsindividual users, selected days and/or selected activities can be filtered (or you can show all for a complete listing)
7. Click Get these logs button
8. A breakdown of the topic logs will appear
Live logs
The Live logs report allows a user to view live logs from the past hour. This page automatically updates every minute. First ask yourself: Why do you need to view student activity within the past hour? Will this information suit your purpose?
1. Click on the Topic management panel
2. In the User links column, click on View live logs
3. A pop-up window will show you 'Live logs from the past hour' which you can print if you need to (Ctrl P on most browsers)
Attendance report
The Attendance activity is designed for teachers to be able to take attendance during class, and for students to be able to view their own attendance record. A teacher can mark the attendance status of a student as "Present", "Absent", "Late", or "Excused".
These status descriptions are configurable, and more can be added. The Attendance activity can generate reports for either the entire class or for individual students. Students may also see their own attendance record if the activity is not hidden.
The optional Attendance block allows teachers quick access to the Attendance functionality, and allows students quick access to a summary report for their own attendance.
You can generate attendance reports on sessions:
1. Select the Attendance activity of the topic and session you're interested in
2. Click on the Report tab near the top
3. You will now be able to see attendance reports for the selected time period. Select All to view attendance report for the entire time period.
3. You can also select the Summary view to see a summarized attendance report.
Activity report
The Activity report gives statistics on the number of times each activity or resource has been viewed within a topic and the last accessed date.
Useful for: Monitoring the utilisation of each resource and identifying underutilised resources.
1. Click on the Topic management panel
2. In the User links column, click on View Activity report
3. The page then lists each activity and resource in the topic, as well as the number of times it has been viewed.
3. Select the filter drop down (top of page) to filter by date
Topic participation
The Topic participation report is useful to identify which students have accessed a particular resource or activity. For forums, glossaries and databases where studies can post, you are able to identify how many posts each student has made.
Useful for: identifying which students have not engaged with key resources.
A useful feature of the topic participation report is the option to send a message to all students who have not completed a certain task or accessed a resource. Before using this feature, you must have set up the resource or activity you wish to
collect information on. Naming the resource/activity clearly is important for easily finding the relevant 'activity module'.
1. Click on the Topic management panel
2. In the User links column, click on View topic participation report
3. Set the activity/resource module you want to view, the amount of time to look back, the role you want to examine (usually student) and the type of action required (all, view, post)
4. Click Go to obtain report. Note that the activity reports will not include
activity in tools such as Collaborate, Kaltura or readings.
5. You can send a message to all students who have not
completed a certain task or accessed a resource by selecting students and then
using the “With selected users…” menu at the bottom of the report.
Statistics
The Statistics report uses graphs and tables to show how many 'hits' for a specific section of the topic site. The statistics reports do not show the distinct users. Statistics must be enabled by a site administrator (your eLearning support team).
1. On your topic's home page, click on the Topic management panel
2. Click on the cog in the top-right corner, and then clicking on More…
3. Click on the Reports tab
4. In the Reports tab, click on Statistics
5. Select the Topic, the report type for a type of activity and the roles of who (students). Select the time period (starting from 1 week), then click View button
6. Select the daily Topic Logs for more detail.
Individual student reports
There are a series of reports in FLO available to see the activity of individual students in a specific FLO site:
Displays a graph of a students' activity since the topic start date and shows all 'touches' for each day. Below the graph you can see more detail in terms of the actual items visited and action undertaken.
Useful for: A deep dive into an individual students’ engagement levels over time
1. Click on the Topic management panel
2. In the User links column, click on Participants
3. Select the individual student by clicking on their name. A profile view will appear for the selected student.
4. In the
Reports section select ‘All logs’ to display a graph of a students' activity since the topic start date and shows all 'touches' for each day.
Participants – outline report
The participant outline reports enables teaching staff to see an overview of a individual student activity in a specific FLO site as per the sequence of the FLO site. When reading this report, consider which activities/resources are essential to a
student's completion of a topic. This may help you decide which activities will indicate engagement with a topic.
Useful for: Quantitatively assessing a student's progress, in terms of what they have touched or looked at in the FLO site. For instance, have they looked at key resources provided?
Note: The outline report will only be able to report if the student has click on an item. Therefore, the outline report will not record that a student has ‘read’ a label because the students doesn’t have to ‘click’ the label in order to read it. This
may also apply to videos and other activities, depending how they have been added to your FLO site.
1. Click on the Topic management panel
2. In the User links column, click on Participants
3. Select the individual student by clicking on their name. A profile view will appear for the selected student.
4. In the
Reports section select 'Outline report ' to obtain an overview of the activity views and last access for the selected student.
Participants – complete report
The complete report provides a detailed overview of a student's action sequences as per the FLO site. This report lets you see the contents of a student's contribution for all items in the FLO site (eg their forum posts for a week). The report is
organised as per the outline report but with the actual items included.
Useful for: Qualitatively assessing a student's progress, especially if marking a student's work formatively.
1. Click on the Topic management panel
2. In the User links column, click on Participants
3. Select the individual student by clicking on their name. A profile view will appear for the selected student.
4. In the Reports section select ‘Complete
report ' to obtain an overview of the action sequences as per the FLO site for the selected student.
