You must be a member of this (Vendor Announcements) subgroup to see this feature.

Competency Assessment Quizzes - How much is too much?

7 followers
0 Likes

Hi.  I am an employee of MediaLab and have recently been assigned the task of updating some of the competency assessment quizzes we offer in our Compass POCT product.  Recently, I had some comments from some customers about the length of some of the competency assessment quizzes being too long.   Some of our quizzes have 25+ questions.  

How many questions do you think are appropriate for a competency assessment quiz?  I realize that there are many variables that go into the number of questions in an assessment, so I am just asking generally.   I know in some instances, you want to gear questions based on issues you may have encountered or items that you want to stress.   Just looking for thoughts.  

I appreciate your response.  

5 Replies

Rory:  

I have moved your post to the Vendor section of the Listserv.  Please limit commercial posts and queries to that section.

Thanks,

Bill

POCT Listserv Manager 

for my annual competencies, i try to limit the # of questions to 10 or 12, as they quite often have several POC devices to maintain competency on. I also try and focus on situational scenarios, with focus on QC and actions to take, sample and stability, etc, rather than principles of methodology.  i also include a question on accreditation requirements.

At least one question for each of the six elements of competency assessment, as applicable to the test system, plus one question for each KPI that you measure where you consistently see problems, such as patient identification or critical value communication  and documentation.  I recommend keeping it to under 10, and keep the questions current with issues seen in the past year. I'm also not a big fan of trick questions, multiple choice questions with more than one right answer, or questions that are so complicated that the testing operator would need to have a degree in lab to answer correctly. Keep It Super Simple and limit to the things they need to know only.

I agree with both Jim and Silka. 25+ questions on a competency quiz seems a bit excessive. Each of the six elements and any test specific items that you need to ensure understanding. I would limit to 10 unless there are circumstances that require a deeper dive. 

I agree also, 10-12 questions at most.  I like questions that has some critical thinking as we like to use the quizzes to fulfill the competency assessment for troubleshooting and maintenance.  I would like to see your 25 questions though, maybe it would be nice to have a variety of questions from year to year.

Reply
Subgroup Membership is required to post Replies
Join POCT Listserv now
Rory Huschka
almost 5 years ago
5
Replies
0
Likes
7
Followers
75
Views
Liked By:
Suggested Posts
TopicRepliesLikesViewsParticipantsLast Reply
Ova and Parasites Enhanced with Ai
Steven Wilson
7 months ago
0093
Steven Wilson
7 months ago
AMR take a moment to consider it
Greg Sloan
about 1 year ago
0017
Greg Sloan
Antimicrobial stewardship means testing
Greg Sloan
almost 2 years ago
0012
Greg Sloan