I had great fun at the recent CAA (Computer Assisted Assessment) Conference hosted by University of Southampton, UK. I’d like to thank the team there for taking the lead in organizing the event and opening a new chapter in its history. This conference builds on the success of the 12 previous CAA conferences hosted at Loughborough University. Although I didn’t go to the first event in 1997, I’ve been a regular attendee on and off for the past 10 years.
I was given the job of summing up the conference and providing closing remarks. With just two days to read over 30 academic papers I found myself searching for a tool to help me summarize the information quickly. After a little bit of text processing with a python script and the excellent TagCrowd tool I came up with a tag cloud based on the top 50 terms from the abstracts of the papers presented at the conference:
Assessment obviously remains a key focus of this community, but I was also struck by the very technical language used: system, tools, design, computer and so on. However, it was also interesting to see which words were missing. Traditionally I would have expected words like reliability and validity to feature strongly. Although summative assessment makes an appearance formative assessment does not feature strongly enough to appear in the cloud. Clearly students, learners and the individual are important but where is adaptivity or personalization?
It is interesting to compare this picture with a similar one taken from the abstracts of the papers in 2000, ten years ago.
An important part of our mission at Questionmark is learning from communities like this one and using the knowledge and best practices to develop our software and services. During the conference I witnessed a range of presentations covering ideas that we can apply right now through to some fascinating areas of research that point the way to future possibilities.
The conference was a great success, and planning for next year (5th-6th July 2011) has already started. Check out the CAA Web site for the latest information.
The program for the Questionmark Users Conference in Miami March 14 -17 offers something for every Questionmark Perception user, whether they are just starting out or have been using Perception for many years. Here’s the complete line-up of conference sessions.
The conference will also include opportunities to meet one-on-one with Questionmark product managers and technicians, and to attend networking events.
Opening General Session: Conference kick-off
Keynote: Dr. David Metcalf on “Assessments on the Move: Mobility, Mashups and More”
Closing General Session: The Road Ahead
Customer Case Studies
Integrating Questionmark Perception and SAP for Employment Testing
Streamlined Training and Assessment at NPPD: Integrating Perception with SAP Learning Solution
Using Flash and Captivate in Questionmark Perception
Questionmark Live: Distributing the Workload and Increasing Accessibility
Many from One: Creating Hundreds of Questions to QML Import Using Excel
Question Bank as a Knowledge Tree: Sowing the Seeds of Knowledge
Questionmark in Dental Education: Why, How and Lessons Learned
Establishing a Broad National Certification Network Based on Questionmark
Questionmark Perception as a Central Component of a Training Strategy
Perfecting the Test Through Question Analysis
The Cloud School: Learning and Assessment for Underserved People in Brazil
Introduction to Questionmark Perception for Beginners
Advanced Authoring Techniques Using Authoring Manager
Planning Your Migration from Perception v4 to v5
Configuring the User Experience and Understanding Templates in Perception v5
Analyzing and Sharing Results with Enterprise Reporter
Using Perception for Evaluations and Other Types of Surveys
Methods for Integrating Perception with Other Systems
Item and Test Analysis Analytics
Making Your Assessments Available and Accessible to All
Questionmark Live Item Writing Workshop: Bring Your Own Laptop!
Technical Standards and Questionmark’s Open Assessment Platform
Conducting Validity Studies within Your Organization
Effectively Measuring Knowledge, Skill and Ability with Well-crafted Assessments
Strategies for High-Stakes Tests
Shaping the Future of ADL SCORM: What’s On Your Wish List?
Using Questionmark To Facilitate ROI strategies
Options and More Options: Different Ways to Deliver Your Assessments
The suspense is over for those of you waiting for Part 2 of our tutorial on creating and editing assessments in Questionmark Perception! This video demonstrates how to customize and control how your assessment works. Find out how to use the assessment editor to arrange time limits, security options and other settings. Learn how to establish the look and feel of your assessment, create jump blocks, set up feedback options, organize post-assessment email messages and perform many other tasks.
Click here to review Part 1 of the assessment creation tutorial, and here to watch our video about creating and managing questions.
Earlier this month I shared a tutorial on creating and managing questions using Questionmark Perception. Now it’s time to move on to organizing your questions into assessments. This video from the Questionmark Learning Cafe will show you how to create assessment folders and assign administrators to them. It will demonstrate how Perception’s assessment wizard guides you step-by-step through the process of creating surveys, quizzes, tests and exams.
What type of assessment do you want? Do you want to set a time limit for taking it? Do you want to provide feedback to participants? How do you want to order your questions, and how many questions would like to include? Do you want to set a pass/fail threshold? The wizard will walk you through these and many other decisions as you create your assessment.
In my next post I will share another video showing how to customize your assessments and control how they work. Watch this space for Part 2!