Affiliations: Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln, NE, USA, lmille@cse.unl.edu | Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln, NE, USA | Center for Research on Children, Youth, Families & Schools, University of Nebraska-Lincoln, Lincoln, NE, USA
Abstract: Learning objects (LOs) are digital or non-digital entities used for learning, education or training commonly stored in repositories searchable by their associated metadata. Unfortunately, based on the current standards, such metadata is often missing or incorrectly entered making search difficult or impossible. In this paper, we investigate automating metadata generation for SCORM-complaint LOs based on user interactions with the LO and static information about LOs and users. Our framework, called the Intelligent Learning Object Guide (iLOG), involves real-time tracking of each user sessions (an LO Wrapper), offline data mining to identify key attributes or patterns on how the LOs have been used as well as characteristics of the users (MetaGen), and the selection of these findings as metadata. Mechanisms used in the data mining include data imputation via clustering, association rule mining, and feature selection ensemble. This paper describes the methodology of automatic annotation, presents the results on the evaluation and validation of the algorithms, and discusses the resulting metadata. We have deployed our iLOG implementation for five LOs in introductory computer science topics and collected data for over 1400 sessions. We demonstrate that iLOG successfully tracks user interactions that can be used to automate the generation of meaningful empirical usage metadata for different stakeholder groups including learners and instructors, LO developers, and researchers.
Keywords: SCORM learning objects, empirical usage metadata, association rule mining, feature selection, data imputation
