Observational Assessments enable an “observer” – such as an instructor or supervisor — to watch someone complete a task and assess the participant’s performance. This type of assessment, available in Questionmark OnDemand, provides a way to assess a participants in their everyday tasks and rate cognitive knowledge or abilities that would not normally get reflected in answers to a standard assessment. For example, an observational assessment could be used to rate areas such as skills, safety practices and adherence to required procedures.
In many cases, it’s convenient to conduct observational assessments using mobile devices, and this is easy to do using Questionmark Perception’s mobile delivery capabilities and our free Apps for Apple and Android devices.
Whether you plan to deliver an observational assessments via PC or mobile device, here’s how to schedule it in Perception Enterprise Manager:
Set up a Perception administrator as a “monitor” who performs the role of observer
Assign participants to groups
Assign the monitor to administer the groups
Schedule the participant or a group of participants to an assessment and set it to require monitoring
The observer logs in, selects the desired assessment, chooses the participant to be rated, and then completes the assessment. Reports for the assessment will appear under the participant’s name. In addition, the name of the monitor who observed the tasks can be included in reports such as the Coaching Report, Test Analysis Report and Survey Report.
For more details observational assessments, including example applications and a video tutorial, click here.
Many Questionmark customers use SharePoint within their organization. Microsoft SharePoint is a fantastic tool that lets non-technical people create collaborative web sites, and SharePoint is a great system to deploy assessments in for learning, training and compliance.
One of the easiest ways to include an assessment inside SharePoint is as a knowledge check – you can easily put a Questionmark Perception assessment beside some learning content as in the screenshot.
Putting a knowledge check in a SharePoint page gives three benefits
The learner can check he/she understands
The learner gets retrieval practice to reinforce the learning
As author, you can run reports to see which parts of the learning are understood or missed
In order to help people get the benefits of using assessments inside SharePoint, Questionmark have launched a new blog http://blog.sharepointlearn.com which focuses on SharePoint and assessment. This will allow us to run more detailed articles on SharePoint and assessments than the main blog can.
SharePoint is a lot easier to use than many people think. You don’t need administrative rights or programming skills to do most things. At the Questionmark Users Conference last week, I ran a session where people added an assessment in a sandbox site in just a few minutes. You can include an assessment inside SharePoint using the Page Viewer Web Part, which most people who can edit SharePoint pages have access to – if you want to give it a go, here are some instructions from the new blog.
I recently shared a video that showed how easy it is to configure our mobile apps to access your installation of Questionmark Perception. But I actually left out one of the best features within our apps: configuring with a customer number.
If you contact Customer Care, they can give you a number that you can use within your mobile apps to access your installation, On Premise or OnDemand. This allows you to easily share the number to your user base without having to worry about a long URL address. Watch the following video to see how easy it is to use a customer number to configure your Questionmark Mobile App.
We’re Back!!! The Questionmark Live team has released some great new browser-based assessment authoring features.
This release of Questionmark Live contains pull-down list question types, explanations, non-scored questions and an interface to support left to right languages such as Arabic. (We will get to this feature in another post.)
Explanations are a great way to collect scenarios, videos, links and images from subject matter experts without the need to create questions — easily crowdsourcing valuable information that is sitting in your organization right now.
The new pull-down list question presents a number of options for a participant to choose from. The pull-down list question has long been a popular way for Questionmark Perception users to collect information from participants in many types of assessments including surveys.
Non-scored questions allow you to use Questionmark Live to create questions for surveys. This feature allows you to create a question that does not have a correct answer, score, or feedback.
Pull-down questions and non-scored questions are demonstrated in the following video. Take a look!
Course evaluations make it easy to obtain valuable feedback that can be gathered and analyzed in order to improve future learning activities. But to get meaningful results from these evaluations, it’s important to observe certain principles. Here are some best practice tips for authoring course evaluation questions and surveys:
Use Likert or survey matrix questions.
Using the same scale (e.g., Likert 1-5) for all questions on a course evaluation survey will yield the most accurate and easy-to-interpret reports.
Use short scales (e.g., Likert 1-5 versus Likert 1-9) if possible to decrease reading and increase the speed with which participants can complete the survey.
All questions should be set up so that Likert scales have the highest positive number rating as the highest number (e.g., 4 = Strongly Agree) and the lowest negative number rating as the lowest number (e.g., 1 = Strongly Disagree). Using this pattern consistently for every question on the survey allows for the analysis of reports to be the most meaningful.
Generally, reports will yield the most useful topic-level information if meaningful groups of questions are located in smaller number of topics or sub-topics rather than distributed across a large number of topics or sub-topics (e.g., 3 – 4 questions in a topic versus 1 question in numerous topics).
Keep course evaluation surveys short and make them easy to complete: they generally should have about 10 – 15 questions.
In my next post, I’ll share some tips about how to get better response rates and high-quality data when administering course evaluations.
It’s easy to link external resources to Moodle courses using resource links. This technique can be used to launch assessments and surveys in Questionmark Perception. But you can also pass demographic information from Moodle to Perception this way!