Systems and methods for analysis and interactive presentation of learning metrics

10650,698

16/127193

September 10, 2018

Identifying material with which students are struggling can guide educators' decisions on which modifications to the instructional experience will be most impactful to the learning experience. Educators make a finite selection of the near infinite number of possible combinations of instructional content, delivery approaches, instructional order, test questions, approaches for accountability, rubrics, and the like. Educators and administrators with thousands of students are incapable of process the quantities of available data unaided. In some embodiments, a system enables users to view quantized metric data from a population of, for example, students. In some embodiments, the system displays a category-filtered presentation table of a single metric data source. In some embodiments, the system may display comparison presentation category cells that allow for direct, visual comparison of metric values from two different sets of quantized metric data from two different populations and thus enable instructors to improve the educational experience.

SparxTeq Inc. (Orem, UT, US)

SparxTeq, Inc. (Orem, UT, US)

1. A system to display a dynamically filterable graphical user interface on an electronic display of a computing device, comprising: a data store to store a plurality of learning activities, where each of the learning activities is associated with metrics received by a large plurality of students with respect to each learning activity; a quantization metric table (QMT) to be displayed via an electronic display as part of a graphical user interface, wherein the QMT is formed from the large plurality of students, learning activities, metrics, and quantization functions; a category-filtered metric table (FMT) to be displayed via the electronic display as part of the graphical user interface, wherein the FMT is formed from the quantization metric table based on a category selection made via the graphical user interface by a user; a quantized metric presentation (QMP) to be displayed via the electronic display as part of the graphical user interface, wherein the QMP is formed from the FMT to display: the category-filtered learning activities along a first axis, and a category cell for each of a plurality of quantized bins of the metrics associated with the displayed category-filtered learning activities along a second axis with a QMT value based on a combination of the associated learning activity, metric, and category; an input selection module to receive a user input selecting a category cell in the QMP corresponding to an updated FMT of a subset of selected students associated with the selected category cell; and a display update module to real-time modify the displayed QMP to immediately display a filtered QMP based on the updated FMT with updated quantized bins of metrics of the subset of selected students.

2. The system of claim 1 , wherein the data store comprises disparate data stores connected via a network.

3. The system of claim 1 , wherein the displayed category cells of each of the QMP and the modified QMP is a count of the number of students in the FMT within the respective category.

4. The system of claim 1 , wherein each of the learning activities comprises one or more of: a test, a quiz, a homework assignment, an attendance record, a lab assignment, and an exam.

5. The system of claim 1 , wherein the QMP further comprises a display of quantized bins of final grades assigned to each of the students.

6. The system of claim 1 , wherein the displayed category cell of each of the QMP and the modified QMP is a percentage of selected students in the FMT within the respective category.

7. The system of claim 1 , further comprising: a behavior subsystem to identify a learning behavior based on a category predicate function of the FMT that identifies a subset of the large plurality of students that exhibit a common combination of metrics; and an action subsystem to implement at least one intervention action for the identified subset of the large plurality of students.

8. The system of claim 7 , wherein the category predicate function is defined by user-selected categories in the FMT.

9. The system of claim 1 , wherein the electronic display comprises a touch screen display and wherein the user input comprises a touch input relative to the touch screen display.

10. The system of claim 7 , wherein the action subsystem is configured to send a message to an instructor identifying those students in the identified subset of the large plurality of students.

11. The system of claim 7 , wherein the action subsystem is configured to automatically send a message directly to each of the students in the identified subset of the large plurality of students.

12. The system of claim 7 , wherein the action subsystem is configured to automatically adjust required learning activities for the identified subset of the large plurality of students to include one of: at least one fewer learning activity in an implementation in which the learning behavior is positively correlated with success, and at least one additional learning activity in an implementation in which the learning behavior is negatively correlated with success.

13. The system of claim 7 , wherein the action subsystem is configured to provide an instructor with a recommendation to modify educational instruction related to at least one learning activity associated with the learning behavior in implementations in which the learning behavior is negatively correlated with success.

14. A system to generate a category-filterable presentation table, comprising: a quantization subsystem to quantize metric values associated with student performance on each of a plurality of activities associated with an educational course into a set of quantized bins, wherein each activity is associated with a plurality of quantized bins, and wherein each quantized bin of each respective activity is associated with a metric value range and includes a count of the number of students whose metric values for the respective activity are within the respective metric value range; a quantized metric presentation subsystem to display on an electronic display, a quantized metric presentation (QMP) of the students, the QMP comprising: a listing of the plurality of activities along a first axis of a table, and the count of each quantized bin of metric values of each activity along a second axis of the table; an input selection module to receive a user input selecting a subset of students with a common performance metric on at least one activity; and a filtering subsystem to cause the electronic display to display a category-filtered presentation table comprising a modified QMP with modified quantized bins by adjusting the count of each quantized bin along the second axis to include only those students included in the user-selected subset of students.

15. An academic intervention system, comprising: a data store to store a plurality of activities associated with an educational course in which each of a population of prior students participated, and a metric value assigned to each prior student for each activity; a quantization subsystem to quantize the metric values of each respective activity into a set of quantized bins, wherein each quantized bin is associated with a metric value range and includes a count of the number of prior students whose metric values for the respective activity are within the metric value range; a presentation subsystem to display a quantized metric presentation (QMP) of the population of prior students on an electronic display, the QMP comprising: a listing of the plurality of activities along a first axis of a table, and the count of each of the quantized bins of each activity along a second axis of the table; an input selection module to receive a user input selecting a subset of the population of prior students; a filtering subsystem to cause the electronic display to display a category-filtered presentation table comprising a modified QMP with modified quantized bins by adjusting the count of each quantized bin along the second axis to include only the user-selected subset of prior students; a behavior subsystem to identify a learning behavior identified in terms of an activity and metric value that correlate with the user-selected subset of prior students, wherein the learning behavior is identified based on a quantized bin of an activity with a count exceeding a threshold value in the category-filtered presentation table; a current-student analysis subsystem to identify a subset of current students that exhibit the identified learning behavior based on metric values assigned to the subset of current students for the activity associated with the identified learning behavior; and an action subsystem to implement at least one intervention action for the identified subset of current students exhibiting the identified learning behavior correlated with the user-selected subset of prior students.

16. The system of claim 15 , wherein each of the activities associated with the education course comprises one or more of: a test, a quiz, a homework assignment, an attendance record, a lab assignment, and an exam.

17. The system of claim 15 , wherein the quantization subsystem is configured to normalize the quantization bins associated with each activity by mapping the metric values to a normalized scale.

18. The system of claim 15 , wherein the action subsystem is configured to provide an instructor with a recommendation to modify educational instruction related to at least one activity associated with the learning behavior in implementations in which the learning behavior is correlated with a negative outcome.

6988138 January 2006 Alcorn
2008/0138788 June 2008 Allen
2010/0047758 February 2010 McCurry
2010/0261150 October 2010 Matwick
2012/0244510 September 2012 Watkins, Jr.
2014/0272911 September 2014 York

edspgr.10650698