Review Personalized Review Assignments (PRA) Class Activity – DnA & ISE

In this lesson, we will learn how to review the assigned and completed Personalized Review Assignments Class Activity or activity results.

Before You Get Started

Please make sure to have:

At least 1 Flexible available that has been administered online
At least 1 student with activities marked as Finished

Where to Start

Go to Assessments.
Click View Assessments.
Select an assessment title that students have completed PRA activities.
Select PRA to get started.

Class Activity

There are a variety of data insights about activities and assessment scores that can be reviewed about students:

Last Access
Time Spent
Score
Multiple Choice Student Performance
Multiple Choice Question Difficulty
Student Results Table

Class Activity results vary based on PRA setup and configuration. Multiple Choice Performance and Question Difficulty are associated with Multiple Choice Activity Parts.

1. Last Access

Click on Last Access to learn more!

Last Access activity will provide insight on the most recent student activity data. For example, you can hover the mouse over a mark to see student details, date and time.
Select OK to close.

2. Time Spent

Click on Time Spent to learn more about the time spent on all activities by students.

The number of students that completed the activities.
The average time of completion within a range
Hover over the bar to see a range of time completion and total number of submissions.
Select Ok to close.

3. Score (%)

Click Score (%) to learn more about assessment results, or a star score distribution.

The number of students who earned star scores on the assessment overall.
The star score minimum range students received on the assessment.
Hover over a column to view the range and number of students who earned star scores within that range.
Select OK to close.

4. Multiple Choice Student Performance

This graph is tied to Multiple Choice Activity Parts if added to a Resource.

Click Multiple Choice Student Performance to learn about student confidence and knowledge level.

The confidence level provided by the student.
The knowledge level on answering the question or time it takes to answer.
Hover over a dot to view a students submission information.
Select OK to close.

Tell Me More About Student Performance

Confidence Level:

On each MC question, the student indicates how confident they are in their first choice for the question: I'm totally guessing, I think I'm right, or I'm totally sure. These responses are coded to values of 0%, 50%, and 100%, and are then averaged for each student across all MC questions in the PRA, resulting in a Confidence Level for each student, which is graphed on the Y-axis of this graph. (Example: if a PRA includes two MC questions and a student said I'm totally guessing for one and I think I'm right for another, the Confidence Level for the student would be (0 + 50) / 2 = 25.)

Knowledge Level:

On each MC question, the student could get the question correct on the first guess, or on a subsequent guess. For a question with 2 possible choices, we code a value of 100% if the first guess was correct, or 0% if the first guess was incorrect. For a question with 3 or more possible choices, we code a value of 100% if the first guess was correct, 50% if the second guess was correct, or 0% if the student required more than 2 guesses to get the question correct. (Note that these values are inverted from the Difficulty Level calculation for questions, since Knowledge is the inverse of Difficulty.) These coded values are then averaged for each student across all MC questions in the PRA, resulting in a Knowledge Level for each student, which is graphed on the X-axis of this graph.

5. Multiple Choice Question Difficulty

This graph is tied to Multiple Choice Activity Parts if added to a Resource.

Click Multiple Choice Question Difficulty to learn more student confidence level in relation to the difficulty level.

The confidence level provided by the student.
The range of question difficulty level.
Hover over a dot to view the total submissions, confidence level and difficulty level data.
Select OK to close.

Tell Me More About Question Difficulty

Confidence Level:

On each MC question, the student indicates how confident they are in their first choice for the question: I'm totally guessing, I think I'm right, or I'm totally sure. These responses are coded to values of 0%, 50%, and 100%, and are then averaged for each MC question in the PRA across all students who completed the question, resulting in a Confidence Level for each question, which is graphed on the Y-axis of this graph. (Example: if 3 students responded to a question, with 2 students saying I think I'm right and 1 student saying I'm totally sure, the Confidence Level for the question would be (50 + 50 + 100) / 3 = 66.7.)

Difficulty Level:

On each MC question, the student could get the question correct on the first guess, or on a subsequent guess. For a question with 2 possible choices, we code a value of 0% if the first guess was correct, or 100% if the first guess was incorrect. For a question with 3 or more possible choices, we code a value of 0% if the first guess was correct, 50% if the second guess was correct, or 100% if the student required more than 2 guesses to get the question correct. (Note that these values are inverted from the Knowledge Level calculation for students, since Knowledge is the inverse of Difficulty.) These coded values are then averaged for each MC question in the PRA across all students who completed the question, resulting in a Difficulty Level for each question, which is graphed on the Y-axis of this graph.

6. Show Student Results Table

To open the Student Results Table, select Show Student Results Table. A table will display providing a list of students and their activity results.
A Search Bar is available when wanting to search for a specific student from within the table.
Student information includes Name, Last Access, Time Spent, Activity Results, and Score.
Select a students Activity Results checkmarks to bring a pop-up to hover and view the student's PRA results.
Select OK to close the window and return to that table.
An option to Reset Submission is available here.
To close and hide the table, select Hide Student Results Table.

Next Steps

Ready for more PRA fun? Visit PRA Assignment & Advanced Options for more lessons and resources!