The CAA Conference, 10 years on

Posted by Steve Lay

I had great fun at the recent CAA (Computer Assisted Assessment) Conference hosted by University of Southampton, UK.  I’d like to thank the team there for taking the lead in organizing the event and opening a new chapter in its history.  This conference builds on the success of the 12 previous CAA conferences hosted at Loughborough University. Although I didn’t go to the first event in 1997, I’ve been a regular attendee on and off for the past 10 years.

I was given the job of summing up the conference and providing closing remarks.  With just two days to read over 30 academic papers I found myself searching for a tool to help me summarize the information quickly.  After a little bit of text processing with a python script and the excellent TagCrowd tool I came up with a tag cloud based on the top 50 terms from the abstracts of the papers presented at the conference:

tagcloud4

Assessment obviously remains a key focus of this community, but I was also struck by the very technical language used: system, tools, design, computer and so on.  However, it was also interesting to see which words were missing.  Traditionally I would have expected words like reliability and validity to feature strongly.  Although summative assessment makes an appearance formative assessment does not feature strongly enough to appear in the cloud.  Clearly students, learners and the individual are important but where is adaptivity or personalization?

It is interesting to compare this picture with a similar one taken from the abstracts of the papers in 2000, ten years ago.

tagcloud2000

An important part of our mission at Questionmark is learning from communities like this one and using the knowledge and best practices to develop our software and services.  During the conference I witnessed a range of presentations covering ideas that we can apply right now through to some fascinating areas of research that point the way to future possibilities.

The conference was a great success, and planning for next year (5th-6th July 2011) has already started.  Check out the CAA Web site for the latest information.

Questionmark Users Conference: Here’s the Full Program

Joan Phaup

Posted by Joan Phaup

The program for the Questionmark Users Conference in Miami March 14 -17 offers something for every Questionmark Perception user, whether they are just starting out or have been using Perception for many years. Here’s the complete line-up of conference sessions.

The conference will also include opportunities to meet one-on-one with Questionmark product managers and technicians, and to attend networking events.

General Sessions

  • Opening General Session: Conference kick-off
  • Keynote: Dr. David Metcalf on “Assessments on the Move: Mobility, Mashups and More”
  • Closing General Session: The Road Ahead

Customer Case StudiesMiami

  • Integrating Questionmark Perception and SAP for Employment Testing
  • Streamlined Training and Assessment at NPPD: Integrating Perception with SAP Learning Solution
  • Using Flash and Captivate in Questionmark Perception
  • Questionmark Live: Distributing the Workload and Increasing Accessibility
  • Many from One: Creating Hundreds of Questions to QML Import Using Excel
  • Question Bank as a Knowledge Tree: Sowing the Seeds of Knowledge
  • Questionmark in Dental Education: Why, How and Lessons Learned
  • Establishing a Broad National Certification Network Based on Questionmark
  • Questionmark Perception as a Central Component of a Training Strategy
  • Perfecting the Test Through Question Analysis
  • The Cloud School: Learning and Assessment for Underserved People in Brazil

Tech Training

  • Introduction to Questionmark Perception for Beginners
  • Advanced Authoring Techniques Using Authoring Manager
  • Planning Your Migration from Perception v4 to v5
  • Configuring the User Experience and Understanding Templates in Perception v5
  • Analyzing and Sharing Results with Enterprise Reporter
  • Using Perception for Evaluations and Other Types of Surveys
  • Methods for Integrating Perception with Other SystemsDeco Drive, South Beach

Best Practices

  • Item and Test Analysis Analytics
  • Making Your Assessments Available and Accessible to All
  • Questionmark Live Item Writing Workshop: Bring Your Own Laptop!
  • Technical Standards and Questionmark’s Open Assessment Platform
  • Conducting Validity Studies within Your Organization
  • Effectively Measuring Knowledge, Skill and Ability with Well-crafted Assessments

Peer Discussions:

  • Strategies for High-Stakes Tests
  • Shaping the Future of ADL SCORM: What’s On Your Wish List?
  • Using Questionmark To Facilitate ROI strategies

Drop-in Demos

  • Options and More Options: Different Ways to Deliver Your Assessments
  • What’s New in Perception Version 5?
  • Tools/Features to Enhance Your Use of Perception

Register for the conference and join us in Miami!

How to Create and Edit Assessments in Questionmark Perception: Part 2

joan-small1Posted by Joan Phaup

The suspense is over for those of you waiting for Part 2 of our tutorial on creating and editing assessments in Questionmark Perception! This video demonstrates how to customize and control how your assessment works. Find out how to use the assessment editor to arrange time limits, security options and other settings. Learn how to establish  the look and feel of your assessment, create  jump blocks, set up feedback options, organize post-assessment email messages and perform many other tasks. 

Click here to review Part 1 of the assessment creation tutorial, and here to watch our video about creating and managing questions.

 

How to Create and Edit Assessments in Questionmark Perception: Part 1

joan-small1Posted by Joan Phaup

Earlier this month I shared a tutorial on creating and managing questions using Questionmark Perception. Now it’s time to move on to organizing your questions into  assessments. This video from the Questionmark Learning Cafe will show you how to create assessment folders and assign administrators to them. It will demonstrate how Perception’s assessment wizard guides you step-by-step through the process of creating surveys, quizzes, tests and exams.

What type of assessment do you want? Do you want to set a time limit for taking it?  Do you want to provide feedback to participants? How do you want to order your questions, and how many questions would like to include? Do you want to set a pass/fail threshold? The wizard will walk you through these and many other decisions as you create your assessment.

In my next post I will share another video showing how to customize your assessments and control how they work. Watch this space for Part 2!