10 reasons why practice tests help make perfect exams

John Kleeman HeadshotPosted by John Kleeman

Giving the opportunity for candidates / participants to take a practice or mock version of an exam before they take the real thing has huge benefits for all stakeholders. Here are 10 reasons why including practice tests within your exam programme will improve it.

1. Most importantly, practice tests tell candidates which topics they have not mastered and encourage them to focus future learning on weak areas.

2. Almost as important, practice tests tell candidates which topics they have already mastered. They can then direct their learning to other areas and spend minimal further time on the topics they already know.

3. Practice tests can also feed back to the instructional team the strengths and weaknesses of each candidate and for the candidate group. It can tell which topics have been successfully learned and which areas need more work.

image4. It’s well understood in psychology that you are more likely to retain something if you learn it spaced (separated) over time. Since practice tests stimulate revision and studying, they encourage earlier learning and so space out learning, which is likely to improve retention. See this Slideshare for more information on how assessments can help space out learning.

5. The accuracy and fairness of exams can be impacted by some candidate’s fear or anxiety around the exam process. Practice tests can reduce test anxiety. To quote ETS on test anxiety:

“The more you are accustomed to sitting for a period of time, answering test questions, and pacing yourself, the more comfortable you will feel when you actually sit down to take the test.”auth-collab-350x200

6. Accuracy and fairness can also be impacted by problems with familiarization or incompatibilities with the computers and software used for the testing. If the same equipment and software can be used in practice, this greatly reduces the chance of problems.

7. Taking a test doesn’t just measure how much you know, it helps reinforce the learning and make it more likely that you can retrieve the same information later. It’s a surprising fact that taking a test can actually be more beneficial to learning than spending the same amount of time studying. See Evidence from Medical Education that Quizzes Do Slow the Forgetting Curve for one of many research studies showing this.

8. Giving formative or practice tests seems to improve learning as well as final exam results. See Evidence that topic feedback correlates with improved learning or  Where’s the evidence for assessment? for a couple of articles with evidence of this.

9. Such tests are consistent with good practice and with assessment standards. For example the international standard on delivering assessments in the workplace ISO 10667 states:

“The service provider shall … where appropriate, provide guidance on ways in which the assessment participant might prepare for the assessment, including access to approved or recommended sample and practice materials”

10. It is crucial that exams  are fair and that they are seen to be fair. By providing practice tests, you remove the mystique from your exams and allow people to see the question styles, to practice the time planning required and to have a fair view of what the exam consists of. It helps level the playing field and promotes the concept of a fair exam, open to and equal for all.

Not all these reasons apply in every organization, but most do.  I hope this article helps remind you why practice tests are valuable and encourages their use.

Dr. Larsen’s five principles for test-enhanced learning in medical education

Dr Douglas Larsen
Douglas Larsen

Posted by John Kleeman

In the first part of this interview, Dr. Douglas Larsen, an expert in medical education at the Washington University in St Louis explained his research on how tests and quizzes taken during learning act as retrieval practice and aid learning and retention in medical education. Answering questions in written or computer tests gives practice in recollecting relevant facts and aids future retrieval of such facts when they are needed. In this final part of the interview, he explains his five principles to implement test-enhanced learning successfully.

Your research shows that tests in medical education can significantly help long-term retention. What advice would you give medical educators?

A big misunderstanding is that the research suggests promoting more summative tests. What we’re actually talking about here is changing how we teach people, and simply having more tests at the end of a course probably won’t change a lot. This is an opportunity for educators to think about what it is they want students to learn to do. And then to make sure that the practice of doing it is incorporated in the entire educational process and not just simply at the end.

One of the things that this research has shown is that cramming (e.g. intensive study before an exam) leads to very short-term effects. The benefits disappear quite quickly.

We have come up with 5 principles we think are important for long-term retention.

What are the 5 principles?

1. Closely align the testing with educational objectives.

2. Make sure the test involves generating or recalling, not just recognition.

Generation questions include free-recall, fill-in-blank, short-answer or essay-type questions. We’re still researching this area, but it seems the more that you force the learner to generate and organize their own structure of knowledge, the better. So the less the question enforces structure, the better.

Some studies have shown benefits of multiple-choice tests, others have shown them to be no better than studying. I think the key to the success of a question is the amount of processing required. In some multi-step multiple-choice questions, you have to process and generate an answer, not just recognize the right answer, and this is better. Retrieval and having an opportunity to organize information yourself is important rather than just picking something out of a list.

3. Adequate repetition

There need to be enough opportunities that the knowledge or skill “sinks in”.

Just like when learning the piano, you have to practice many times. When learning information, there need to be multiple practice opportunities. It seems that procedural knowledge may not need to be repeated as often as declarative facts. We’ve seen in some studies that a single testing event can have effects years later when you are dealing with procedural information.

But declarative facts go away very quickly. In one of my studies, learning of facts was measured at 60-80% initially but had dropped to 40-50% in 2 weeks. You need a lot of repetition to interrupt the forgetting curve and maintain the information. The more times you retrieve something, the more likely you are to retain it.

4. Adequate spacing

There has been research to show that if you want learning to last months and years, you need to space out your testing on the order of weeks and months, not days or hours.

5. You need to have adequate feedback.

There is definitely a testing effect without feedback, but the research has shown that with feedback, the effect is greatly amplified. People just learn more.

What is good practice in feedback?

There are a couple of principles with feedback.

One is that when people simply get immediate feedback, where someone answers a question and then immediately gets told whether it’s correct or incorrect – they probably don’t retain it as well. There needs to be a degree of delay in the feedback. The reason for that is that we need to wash the information out of short term / working memory, and give them a chance to re-process it.

Feedback that leads to re-processing is likely to be the most beneficial. Where you are forced to go back and work out why you answered incorrectly, and how that compares to the correct answer. It’s important that learners actively process the feedback, not just passively read it. For instance, one technique we use is to have students go back and grade their own test – this makes them re-process.

What is your perspective on case study questions, where you navigate through a medical scenario and answer questions on the way?

I think those are excellent in the sense that you can better approximate your desired outcomes by aligning learning objectives. If you want people to recognize elements of a case, to deduce what they need to do and so on, you obviously have to have a context for that. So case studies can be very important. As before, it is best to structure questions so that they involve recall rather than recognition.

What impact is the research on test-enhanced learning having on medical education?

Many people are very positive and very excited. The challenge is for people to understand all the implications, and to understand that we’re not talking about more standardized tests or more summative tests, but we’re really saying that people have to go back and look at how they teach, and how they incorporate retrieval practice into the longitudinal teaching experience.

That is the biggest challenge, but my hope is that, as we keep talking about it, people will catch the vision and it will have an even greater impact on how people both teach and learn.