Competency assessment for waived testing

0 followers
0 Likes

For waived testing, such as Nitrazine pH testing or HemaPrompt, competency assessment we have the clinical educators for the specific department to go over the skills checklist and perform a blind sample. Then the user is assigned an exam in which they get 3 times to pass with a score of 100. However, we've had several users that have failed the exam after 3 tries and  the user receives remedial training before being reset for one more attempt at passing. But we're having users who are failing this fourth attempt. These are manual test that we can't lock the user out from performing. Has anyone else had this issue? We dont want an inspector asking why did you give the user "x" number of times to pass the exam when the user must not be competent. 

6 Replies

You need to have course material that covers each question in the exams. Make it easy for them and for you. Make the exams simple and short. I have see exams with three questions. It is only waived testing , observation and a checklist is sufficient.

Agree with Sandra.   Also, in a previous life, I have known users to purposely fail so they would not have to perform testing.  

Hello


When I have a operator fail their annual written competency.  They are given a paper copy of the procedure and the test again.  It is done as an "open book" exam. I record on the repeat test that the procedure has been reviewed. Onus on the end user.


The educational rationale for this is that if they have questions about a particular test or testing platform the directions are available to them in either in a procedure manual or online.



  • The complexity of the waived test is how I determine the number of questions.


Question hierarchy is as follows:



  • True/False

  • Multiple Choice

  • Multiple/multiple choice

  • Short answer


I usually use T/F questions and multiple choice. 5 questions.


Why do you require a score of 100%?  Our institution previously required a 100% on ALL competency assessments, nursing, lab, DI,etc. Our Professional Development department changed the standard to 80% or better about two years ago.  Easier to manage and with feedback for the incorrect answers everything works better here for us!

When you are only asking 5 questions, they must all be important.  What one would be okay to miss?  I usually use ten questions which may be more then necessary but I feel one can truly cover the topic with ten.

Also agree with several comments, particularly on including content with training materials covering whatever is on the quiz. Also, perhaps have the policy/procedure reviewed by someone in nursing who could spot terminology that isn't easily recognized by end users/operators.


I've heard it repeatedly: a training assessment is not to be counted as a competency assessment. Competency assessment should come after a period of time the operator has performed.


I'm not saying that the training is inadequate; I'm saying if someone can't pass the training assessment quiz or a competency assessment quiz on a repeat attempt but they can perform the procedure under observation, something must not be understood or is not being applied in order to get the correct answers on the quiz. 


 

I agree that a Quiz be performed post clinical assessment (8 key areas to be assessed) to make sure that the end user understands the reasoning behind the procedure for the POCT being used.  I also have Power Point material and quiz (on HealthStream)  along w/ the P&P for reference on all POCT devices.  I use a minimum of 10 questions (T/F, Multiple choice, short scenarios) all reflect what was covered in the training.  I oversee the Professional Nursing Educators on their competencies annually as well and sign off on the paperwork-(NYSDOH reg). 


Most recently I started attending the Nursing Unit Meetings (for a brief review) and talk about the most current errors in POCT (usually w/ the Glucometer) and supply handouts to show scenario's and how to correct them.  End Users are "Locked Out" of the system for non compliance, and re-training form must be completed by unit director, prof nsg edu or POCC. 

Reply
Subgroup Membership is required to post Replies
Join POCT Listserv now
Mary Pierce
over 6 years ago
6
Replies
0
Likes
0
Followers
1821
Views
Liked By:
Suggested Posts
TopicRepliesLikesViewsParticipantsLast Reply
iSTAT in NICU -chem 8, CG4
Kim Ballister
about 5 hours ago
30113
Kim Ballister
about 4 hours ago
Rotem Sigma Validation Help
BRENDA PENA
about 7 hours ago
1081
BRENDA PENA
35 minutes ago
Hemochron Sig Elite use outside of manufacturer temperature range
Melisa Wagoner
2 days ago
10125
Melisa Wagoner
about 9 hours ago