Security, Reporting and Online Testing in Academia: A Q&A with Don Kassner

Julie ProfileI recently spoke with Don Kassner, who has joined Questionmark as vice president of academic markets. I wanted to take a moment to welcome Don and to ask him a few questions about his extensive background, his new job role and his hopes for the future. Here’s a snippet of our conversation:

Don Kassner, VP of academic markets, Questionmark

You have had an extensive career. What is your background, and how has it influenced the insight you have on the learning and assessment world?

At heart, I am an entrepreneur.  I started my first business when I was 8 years old and have been starting and building things ever since. In the last 15 years or so I have focused on technology, training and education. During that time, I have served as the CFO for an auto dealership training company and as president of a small university in addition to founding and building the largest online proctoring company. I have also served on the faculty of San Jose State University (economics) and have been an active member of multiple onsite accreditation evaluation teams.

Now that you are part of the Questionmark team, can you share a little about your new role and the goals you have for this position?

I am excited to reach out to the academic markets and address ongoing concerns around testing.

Colleges and universities want to deliver tests and exams that are consistent, fair, reliable and defensible. They want to deliver and monitor course evaluations, identify knowledge gaps and place students in appropriate courses, and be able to analyze questions to determine which ones are valid and fair. They want to do this while increasing student satisfaction and reducing cheating.

With Questionmark’s extensive security, reporting and analytics tools, that’s all possible.  My focus is to leverage my insight and experience and put this secure and easy-to-use tool in the right hands.

Can you share some of the important topics surrounding the academic markets that are on your radar?

In academia, there are real issues related to online testing. These are the top two:

  • Is the student doing the work? – With technology comes flexibility and as the stakes become higher, students will naturally look for ways to enhance their scores.
  • Are the exam results fair?  Did all the students face the same conditions with the same opportunities and were the exam rules followed?

Questionmark OnDemand, especially its analytics and reporting tools, can provide reports that can uncover the meaning hidden within assessment results, such as an item or assessment’s reliability and defensibility. In regards to security, Questionmark Secure’s lock-down browser plays a huge role in helping organizations provide a secure environment in which to deliver high stakes assessments. This can significantly help reduce the risk of cheating when deployed along with other defenses to combat impersonation and content theft.

We’re very excited to have you on board! What are your plans for keeping in touch with us on The Questionmark Blog?

Once a teacher, always a teacher! I look forward to turning back the clock to my university days and speaking on the hot-button topics that surround academic testing. My experience in education and entrepreneurship will help me as I share my thoughts on current market trends and the future of assessment and testing.

Thank you Don for taking the time to speak to us today!

You can follow Don on Twitter and connect with him on LinkedIn

Secure exams outside the testing center

Joan Phaup HeadshotPosted by Joan Phaup

The increasing numbers of students studying online in recent years – many of them raising families and holding down jobs – have embraced the idea of doing all their coursework at the kitchen table, so to speak.  But until recently, when it came time for a test, these students had to travel to at testing center. Many of these students raised the question: “If I can study at the kitchen table, why can’t I take an exam there, too?”

Today, taking tests from home or the office — using online monitors or proctors — is an option for certification candidates as well as students, and there are various means of providing secure testing at a distance.

Delegates to the Questionmark Users Conference in Baltimore March 3 – 6 will have the opportunity learn more about online proctoring/invigilation during a presentation on Secure Testing in Remote Environments.

Don Kassner, president of ProctorU, will co-present this session with Maureen Woodruff, who directs the Office of Test Administration at Thomas Edison State College. I spent a few minutes with Don the other day and asked for some details.

Can you explain what makes it possible to offer secure remote proctoring or monitoring?

Don Kassner

Don Kassner

There are three key elements to this: the environment, the computer and the test taker. The first thing we need to do is to make sure each test taker has reliable internet access and is in a fairly controlled environment. This is not about testing anywhere. It’s about testing in an environment that’s predictable. The person gets to choose the place, but it has to be in a certain kind of place. And the test taker must “show” us their environment using a webcam. Second, we have to secure their computer. Test takers use their own equipment, but we need to make sure they are not switching tasks, accessing the Internet for answers and so forth. Last, we have to secure the test taker themselves, by using a layered authentication approach to make sure they are who they say they are having our online proctors observe them as they complete their tests.

What are the biggest security challenges in delivering tests to people outside of test centers?

In a test center, you already know that the environment and the computers are secure; you can focus on the identity and behavior of the test taker.  When proctoring at a distance, you have to give a lot of importance to all three of the elements I mention; there are a lot more decisions to be made about the testing process.

With online proctoring, we have to be willing to stop a testing session and say that something doesn’t meet our standards – that the test taker is not meeting the requirements and must reschedule.

We also need to be able replicate our processes across the board and make sure that the testing experience replicates no matter who is taking the test or where they are taking it. We have to focus on making sure the experience is identical for every test taker.

How will you address those challenges during your session?

We will introduce the basics of online proctoring and give examples of how different institutions and organizations have used it. We’ll also drill down into the details of what it takes to secure the environment, the computer and the test taker.

Woodruff Maureen Exc  Portrait (cropped)

Maureen Woodruff

Maureen will share a case study about what they did at Thomas Edison State College and the important factors they had to take into account when they set up remote testing for their students. And I’ll differentiate between the factors that are important for academic institutions and those that matter the most for certification tests. Students are likely to take a number of tests and end up have a long track record. Certification candidates tend not to be repeat test takers, so that means using slightly different procedures.

What kinds of tests are best suited for online monitoring or proctoring?

If you are going to use this kind of proctoring, you really need to think about the nature and structure of the test. You are trying to minimize the risk inherent in someone taking a test, so you need to ask yourself what issues you are concerned about relative to that. Tests with large data banks are best, because they help mitigate the risks of people stealing questions or colluding. Standard tests  increase the risk factor and may not be appropriate.

What would you like your audience to take away?

A real understanding on how effective this approach can be in some situations and  an understanding of when it may or may not be appropriate – so they can think about their own programs and consider where they think this will fit.

Click here for more information about the conference program — and register soon!