Embed Size (px)
Citation preview
Developing and Piloting an Information Literacy Assessment Plan
Diana Chan, HKUST
Enhancing Learning Experiences in Higher Education: International Conference
2 -3 December 2010
2
o Course Embedded IL sessionso Open Workshopso Total: 295 sessions for 6,076
participantso One-credit GE Course
o GNED008 Information Skills for Life-long Learning
o Online Information Literacy Tutorial
Information Literacy Program at HKUST
o “A University Core that complement specialist knowledge with intellectual breadth through an extended program of general education in the humanities, social science, science and technology, and competency building in communications, mathematics, and information literacy and technology.”
o From: Transforming Undergraduate Education – The Transition to the 4-yr Undergraduate Degree
ABCLive Attributes of Graduates
ABCLiveo Academic excellence o Broad-based education o Competencies and capacity building o Leadership and teamwork o International outlook o Vision and an orientation to the
future o Ethical standards and compassion
Graduate Attributes of HKUST
o Articulate information needso Identify sourceso Select tools to retrieve informationo Evaluate information to determine reliability,
validity, accuracy, authority, timeliness, point of view, and suitability
o Understand issues in privacy, security, censorship, intellectual property, and copyright
o Apply IL skills for life-long learningComply with ACRL Competency Standards for
Higher Education
Library: Intended Learning Outcomes
Information Literacy Competency Levels
o A Proposal Submitted in Feb 2010o GNED008 credit course – pre and post
testo Course-specific/Open library classeso Information literacy requirement o Common Core Courseo Student Engagement and Satisfaction
Questionnaire (Indirect Assessment)o A standardized survey instrument –
JM?, SAILS?, RRSA?
Developing the Assessment Plan
o Subject Librarians attended OBE workshops
o Director gave feedback on assessment proposal
o Associate Director gave assessment workshops o James Madison ILT assessment resultso Other assessment testso Validity and reliability issues o Creating a question bank
Partnership with CELT
o Attended SBM OBE meeting o Mapped SBM‘s PILO – 30 courseso Offered library sessions to some courseso Developed Sample Rubrics on FINA321o Piloted assessments on 3 courseso Developed OBE website with rubrics,
assignments, examples, pptso Will attempt to assess on program level
Partnership with SBM
o Goal 7 – Graduates will be effective users of information technology and sources in business applicationso Demonstrate proficiency in using IT
applications in business and management
o Locate, gather, organize, and evaluate information using appropriate information technology and systems.
SILOs of SBM
o Center for Engineering Education Innovation o Workshop on Designing Rubrics
o Possible partnership on final year projects
o Other initiatives
Partnership with SENG
o 23 studentso Mean score of
74o Std Deviation
17.7
Post-Test
GNED 008 Pre and Post Assessment
o 22 studentso Mean score of
58o Std Deviation
17.2
Pre-Test
1-credit GE course - Information Skills for Life-long Learning
A 14-MC Test was given at the beginning and at the end of the semester in 2010
o ILOs focus on Library Catalogo 208 students took a 13-MC test in
Sept 2010
New Students Library Orientation
ILOs Competency
Find a record for an item in the Library Catalog 97%
Look at a Catalog record and know where to go and get the item
97%
Log-in to my account and know the basic functions of making holds and renewals
91%
Know how and what to request via HKALL 83%
Locate an item on Course Reserve 76%
Under what circumstances one may make a request using the Library catalog
58%
FINA 221 MARK 222 MGMT 335
Student # 260 82 37
# of Qs 3 3 6
Accuracy 56%-97% 77%-88% 50%-89%
Confidence level
77% 80% 85%
Competency
76% respondents
scored 67/100 and
above
Remarks Limited time2 shared a PCReliability
Low response
Course-specific IL assessment
Based on your own assessment, please rate how effective your UG education has been in helping you to develop the following abilities, knowledge and skills using a 5 point scale (5=very effective; 1=very ineffective)
o Finding and evaluating information effectivelyo Using information responsibly and ethicallyo Applying information research skills in real
life
Student Engagement & Satisfaction Questionnaire
o James Madison University Information Literacy Test (ILT)
o Administered by CELT in 2007 and 2010o A sample of 300 students
o Entrance test o Exit test
o Officially administered from Sept 2012+?
o US$7 per studento Problem: a small sample, costs,
frequency, local adaptation
Standardized Test
Curriculumo No formal IL Program required by the Universityo Feeding assessment into OBE instruction
Assessmento Implementing institutional, school or program level
assessmento Validity and reliability, reporting mechanismPartnership• CELT - IL Proficiency Test and a Standardized Testo Collaboration with faculty, depts & Language Center
Resources $$
Challenges & Opportunities
