Internet assessment software pioneer Paul Roberts to retire

Paul Roberts photoPosted by John Kleeman

We think of the Internet as being very young, but one of the pioneers in using the Internet for assessments is about to retire. Paul Roberts, the developer of the world’s first commercial, Internet assessment software is retiring in March. I thought readers might like to hear some of his story.

Paul was employee number three at Questionmark, joining us as software developer in 1989 when the company was still working out of my home in London.

During the 1990s, our main products ran on DOS and Windows. When we started hearing about the new ideas of HTML and the web, we realized that the Internet could make computerized assessment so much easier. Prior to the Internet, testing people at a distance required a specialized network or sending floppy disks in the mail (yes people really did this!). The idea that participants could connect to the questions and return their results over the Internet was compelling. With me as product manager, tester and documenter for our new product — and Paul as lead (and only!) developer — he wrote the first version of our Internet testing product QM Web, which we released in 1995.

QM Web manual cover

QM Web became widely used by universities and corporations who wanted to deliver quizzes and tests over the Internet. Later in the nineties, learning from the lessons of QM Web, we developed Questionmark Perception, our enterprise-level Internet assessment management system still widely used today. Paul architected Questionmark Perception and for many years was our lead developer on its assessment delivery engine.

One of Paul’s key innovations in developing Questionmark Perception was the use of XML to store questions. XML (eXtensible Markup Language) is a way of encoding data that is both human-readable and machine-readable. In 1997, Paul implemented QML (Question Markup Language) as an early application of this concept. QML allowed questions to be described independently of computer platforms. To quote Paul at the time:

“When we were developing our latest application, we really felt that we didn’t want to go down the route of designing yet another proprietary format that would restrict future developments for both us and the rest of the industry. We’re very familiar with the problems of transporting questions from platform to platform because we’ve been doing it for years with DOS, Windows, Macintosh and now the Web. With this in mind, we created a language that can describe questions and answers in tests, independently of the way they are presented. This makes it extremely powerful because QML now enables the same question database to be presented no matter what computer platform is chosen on or whatever the operating system.”

Questionmark Perception and Questionmark OnDemand still use QML as their native format, so that every single question delivered by Questionmark technology has QML as its core. QML was very influential in the design of the version 1 IMS Question & Test Interoperability specification (IMS QTI), which was led by Questionmark CEO Eric Shepherd and to which Paul was a major contributor. Paul also worked on other industry standards efforts including AICC, xAPI and ADL SCORM.

Over the years, many other technology innovators and leaders have joined Questionmark, and we have a thriving product development team. Most members of our team have had the opportunity to learn from Paul over the years, and Paul’s legacy is in safe hands: Questionmark will continue to break new frontiers in computerizing assessments. I am sure you will join me in wishing Paul well in his personal journey post-retirement.

Next Generation Assessment Technology & Exciting Events Driving the Conference Agenda

Now that we have the program in place for Questionmark Conference 2017, I’m eager to highlight a few sessions that you will have a chance to attend in Santa Fe, New Mexico March 21-24.

Before the conference gets rolling, there are two full-day workshops available Tuesday, March 21:

Here’s a peak and the agenda. You can explore the entire list of sessions here: Conference Program.

Questionmark Features & Functions

Case Studies

Best Practices

Networking Events

We have some fantastic networking events planned as well.

We’re kicking off the conference with our signature dessert reception. The next day, you will have a chance to enjoy Santa Fe enchanting downtown and dine with a group of fellow assessment professionals. But it’s all culminating to our final event: Meow Wolf’s House of Eternal Return – an exciting multimedia immersive art exhibit experience. Watch out for surprise acts! We look forward to an evening of eating, networking and celebrating!

Questions? Email conference@questionmark.com. We’re happy to help!

How to manage compliance in a highly regulated world? [30-minute webinar]

Posted by Chloe Mendonca

If your industry demands compliance, then your people need compliance training and certifications. Learning and training records are almost always reviewed during regulatory audits to check that employees have received the required training and their competencies or certifications are up to date and valid. The regular assessment of employee knowledge and competencies ensures you’re always ready for an audit or if something goes wrong.

Did you know…


Source: Brandon Hall Group

Perhaps you already understand the value assessments can bring, but need to convince your management team. Or perhaps you’d like a better view on how to use assessments most effectively to ensure compliance. You’re not alone.

Join us for a 30-minute webinar on Thursday March 9, 2017 to:

  • discuss the critical role assessments play in compliance learning
  • explore the benefits of using assessments before, during and after training
  • find out 7 ways assessments fortify compliance
  • get best practice tips for ensuring valid and reliable assessments

We also have several other webinars you may be interested in:

  • How to write high-quality test items – March 4, 2017

If you’d like best practice tips to improve your test items and ensure they produce fair, valid and reliable results then sign up for this 30-minute webinar.

  • Introduction to Questionmark’s Assessment Management System – Various dates and times

Get an overview of Questionmark’s features and functions in this live demo. We will look at the basics of authoring, delivering and reporting on surveys, quizzes, tests and exams.

Early-Bird Conference Special Ends Today

Questionmark Conference 2017 is where you will want to be for three intensive days of learning and networking in Santa Fe, New Mexico March 21-24.

Early-bird registration ends TODAY, February 22. This is your last chance to save $100 on this outstanding professional development opportunity.

Why attend?

  • Learn best practices for assessment authoring, delivery and reporting
  • Make the most of Questionmark features and functions
  • Meet with Questionmark technicians and get answers to your questions
  • Influence the product roadmap
  • Network with your peers

See the full conference program & register by the end of the day for early-bird savings!

 

Final Early-Bird Discount Ends Next Week!

Register for Questionmark Conference 2017 by Wednesday, February 22, for a chance to take advantage of of our final early-bird discount.

Register now and save!

Here are some highlights from the agenda:
  • Assessments as Career Development Tools at Caterpillar Inc.
  • BYOL: Next Generation Assessment Authoring Using Demographics and Jump Blocks
  • Secure Authentication: Single sign-on for Questionmark
  • Staying Ahead of Evolving Security Threats
  • Setting a Fair, Defensible Cut (Passing) Scores

Don’t miss out on the opportunity to:

  • Maximize your Assessment Value
  • Harness the Power of your Results
  • Innovate with us on Future Assessment Technologies

Register now for early-bird savings
Book your room at the Inn and Spa at Loretto before Thursday, Feb. 16 to take advantage of our special rates

We look forward to seeing you in Santa Fe, New Mexico, March 21-24 for our most important learning event of the year!

Sneak Peek: Conference Agenda & Special Workshop in Santa Fe

Posted by Julie Delazyn

Certified Performance Technologist Jim Parry

Questionmark Conference 2017 is the place to be for vital info and training on the latest assessment technologies and best practices. This event will give you the tools you need to take your assessments to the next level and harness the power of your results.

Register by February 22 — your final chance to save for early-bird discounts.

This year, we’re offering a special pre-conference session. Advanced Test Item Writing Workshop – Learn how to test more than just knowledge. Join Certified Performance Technologist Jim Parry – an expert user of Questionmark technologies – in this fast paced, high-powered workshop.

What’s on the agenda? Here’s a sneak-peek of what you can expect in Santa Fe March 21-24:

  • Explore the Advanced Editor in Next Gen Authoring
  • Avionics: A hands-on, performance-based certification using Questionmark at SpaceTEC
  • Certifying Services-Oriented Associates at PetSmart
  • Setting a Fair, Defensible Cut (Passing) Scores
  • Staying Ahead of Evolving Security Threats
« Previous PageNext Page »