While there are no stated requirements to measure the effectiveness of the entire Control Room Management plan, there are two inspection questions related to the effectiveness of fatigue training and education. Are you reviewing the effectiveness of your program? There should be a record, beginning in the calendar year 2012, of how companies have reviewed the effectiveness of its fatigue training/education program at least once each calendar year, not to exceed 15 months. Our CRM clients have been provided a form that can be used for that review.
The first question is D2-3: Is the effectiveness of the fatigue education program reviewed at least once each calendar year, not to exceed 15 months? The guidance with that question indicates that one gauge of effectiveness may be controller test scoring (the lazy man’s gauge). I prefer the other suggested gauge of discussing with the trainees the thoroughness or missing elements of the training program content (requiring an interpersonal discussion and actually talking to other people about what they have learned about fatigue mitigation and what behaviors they have changed as a result of what they learned).
The second question is D3-3: Is the effectiveness of the fatigue training program reviewed at least once each calendar year, not to exceed 15 months? The guidance with that question indicates that companies need to establish what metrics best serve to demonstrate the effectiveness of their program and then review what has actually been done compared to those metrics. Have you established metrics that can be used to review your program’s effectiveness?
The simplest metric is whether or not the company is providing fatigue training and education to controllers and supervisors at least once each calendar year, not to exceed 15 months. A related metric is what content is included in the fatigue training and education. In one Notice of Amendment, an inspector stated, “The CRM plan did not indicate what the training includes. More detail must be added to clearly show how the company trains their personnel on fatigue mitigation.”
Use the information below as a starting point in developing measures of fatigue training/education CRM effectiveness:
I believe that the CRM requirements related to fatigue training and education are straightforward and simple to meet. Our four-hour classroom course covers every subject that should be included in fatigue training and education. The complimentary monthly fatigue educational articles we have provided each month since January 2011 are written to cover the subjects mentioned by PHMSA (Reference: PPG_Fatigue_Training_Education_Covered_Subjects_2016). Some of the online courses used for fatigue training cover all the subjects; others do not. This is one of the reasons to review the effectiveness of the fatigue training and education program used by your company.