Embed Size (px)
DESCRIPTION
Presentation of "ENSURING THE INTEGRITY AND INTEROPERABILITY OF EDUCATIONAL USAGE AND SOCIAL DATA THROUGH CALIPER FRAMEWORK TO SUPPORT COMPETENCY-ASSESSMENT" paper at FIE 2014
Citation preview
Ensuring the integrity and Ensuring the integrity and interoperability of educational usage interoperability of educational usage and social data through Caliper and social data through Caliper framework to support competency framework to support competency framework to support competency framework to support competency assessmentassessmentA. Rayon, Mariluz Guenaga and A. Núñez
•• HigherHigher EducationEducation1
2
ContextContext
•• TechnologyTechnology--richrich environmentsenvironments2
•• CompetencyCompetency--basedbased learninglearning3
Assessment of competenciesAssessment of competencies
� Subjective� Difficult to scale� Hard to find latent skills
ICT in education
Challenge
� ICT in education� Usage and social data� Great promise to improve
learning and assessment
LearningAnalytics
EnrichedRubrics
Challenge: data interoperabilityChallenge: data interoperability
Models and Methods
AnalyticalData for
The scope of LA interoperability
It may be useful to define interoperability in levels:
• Domain-specific concepts•High-level concepts•Format
From: “Learning Analytics Interoperability – The Big Picture in Brief”. Adam Cooper, Cetis, University of Bolton, UK. March 2014. @laceproject
AnalyticalResults
Data forAnalysis
Q: how can we getdata out of theoperational system
Data takes many forms:
• Attributes and actions• Resources and context• Reference data
Our proposal: SCALAOur proposal: SCALA
� upport ompetency ssessment through
approach
� Extensible web-platform
� Integrates usage and social data to provide enriched rubricsrubrics
◦ Uses IMS Caliper Measurement Framework
� Oriented to non-expert users: teachers and students
Learning data
Context data
UDLM: University of Deusto Learning Model
UniversityFaculty
CurriculumSubject
Learning outcomes
MethodCompetency
IndicatorRubric
…
Intelligent data
SCALA data integration
SCALA Model
SCALA Process
SCALA DB
Learning data
Context data
UniversityFaculty
CurriculumSubject
Learning outcomes
MethodCompetency
IndicatorRubric
…
Intelligent data
SCALA data integration
SCALA Model
SCALA Process
University
Faculty
Teacher Student
University of Deusto’sLearning Model
Learning Event
ActionActivityContext
LearningContext
SCALA SCALA ModelModel
Faculty
Curriculum
Subject Syllabus
Teachingmethod
Workload
Genericcompetencies
Learningoutcomes
Indicator
AssessmentLearningActivities
Activitymetrics
Foundationalmetrics
Engagement Performance
Quiz
Lecture …
Reading
IMS MetricProfile
SCALA Data SCALA Data IntegrationIntegration
� Service bus
◦ Data from the source to SCALA-DB
◦ Extensible data adapters
� SCALA process� SCALA process
◦ Extract-Transform-Load
◦ We use Kettle, Pentaho’s Data IntegrationModule
◦ In parallel for each data adapter
ExperimentationExperimentation
� Context◦ 2013-14◦ Engineering Faculty◦ Entrepreneurship subject◦ Teamwork competency
Learning toolsTeamwork competency
� Learning tools◦ Moodle, Google Docs, MediaWiki, Youtube,
Twitter, Google Forms
� Result: SCALA integrates heterogeneus data into normalized and exchangeable data �interoperable
ConclusionsConclusions
� Data interoperability is a key aspect of LA
� Involves benefits: efficiency, adaptability, durability of data, innovation, aggregation, sharing…sharing…
� We are ready for exploitation!
Spanish Spanish Network OfNetwork Of Learning Learning
AnalyticsAnalytics
� Founded in 2013
� Network of researchers and developers interested on the field
Creating synergies and promoting related � Creating synergies and promoting related initiatives
� New members are welcome!
http://snola.deusto.es
@snolaresearch
IMS IMS CaliperCaliper vs vs TinTin Can APICan API
� Balance between completelyopen mechanisms and rigidschema
� Is more encompassing:
◦ Takes a learning environment view
◦ Includes LTI as a important
� Widely used
◦ More experience
� Only defines the statementpattern
� It does not especify verbs
◦ Advantage: open to a wide range◦ Includes LTI as a importantcomponent
◦ Incorporates existing standards(LIS, QTI…)
� Both are interoperable
◦ Caliper � xAPI
◦ xAPI � mapping � Caliper
◦ Advantage: open to a wide rangeof users
◦ Disadv: adopters need to define these missing parts
