How much do you know about defensible assessments?

Julie Delazyn HeadshotPosted by Julie Delazyn

This quiz is a re-post from a very popular blog entry published by John Kleeman.

Readers told us that it was instructive and engaging to take quizzes on using assessments, and we like to listen to you! So here is the second quiz in a pre-published series of quizzes on assessment topics. This one was authored in conjunction with Neil Bachelor of Pure Questions. You can see the first quiz on Cut Scores here.

As always, we regard resources like this quiz as a way of contributing to the ongoing process of learning about assessment. In that spirit, please enjoy the quiz below and feel free to comment if you have any suggestions to improve the questions or the feedback.

Is a longer test likely to be more defensible than a shorter one? Take the quiz and find out. Be sure to look for your feedback after you have completed it!

NOTE: Some people commented on the first quiz that they were surprised to lose marks for getting questions wrong. This quiz uses True/False questions and it is easy to guess at answers, so we’ve set it to subtract a point for each question you get wrong, to illustrate that this is possible. Negative scoring like this encourages you to answer “Don’t Know” rather than guess; this is particularly helpful in diagnostic tests where you want participants to be as honest as possible about what they do or don’t think they know.

How much do you know about assessment? Quiz 5: Designing Assessments

Posted by John Kleeman

Here is the fifth of our series of quizzes on assessment subjects, authored in conjunction with Neil Bachelor of Pure Questions. This week’s quiz is on designing assessments, a large topic area, but we’ve selected some interesting questions to check your understanding.

Here are links to earlier quizzes in the series:

Quiz 1 – Cut Scores
Quiz 2 – Validity & Defensibility
Quiz 3 – Use of formative quizzes
Quiz 4 – Trialling Questions

We regard resources like this quiz as a way of contributing to the ongoing process of learning about assessment. In that spirit, please enjoy the quiz below and feel free to comment if you have any suggestions to improve the questions.

How much do you know about assessment? Quiz 4: Trialling questions

Posted by John Kleeman

Here is the fourth of our series of quizzes on assessment subjects, authored in conjunction with Neil Bachelor of Pure Questions. You can see the first quiz, on Cut Scores here, the second, on Validity and Defensibility here, and the third on use of formative quizzes here.

This week’s quiz is on trialling (or piloting) questions, the important process of checking the questions prior to using them in production.

We regard resources like this quiz as a way of contributing to the ongoing process of learning about assessment. In that spirit, please enjoy the quiz below and feel free to comment if you have any suggestions to improve the questions.

.

Questionmark software is very effective for beta testing and trialling questions. You can easily construct a trial assessment containing selected questions for trial delivery, and you can easily schedule certain people to be able to trial. You can also easily change delivery settings, e.g. require secure browser / not require secure browser, require monitoring / not require monitoring to suit the need. Beta questions can also be included within production exams by setting them as “Experimental”, which means that they gather statistics but don’t count to the score of the participant.