Interview with Captain James Mitchell – EBT Program Manager
Why did you transition to EBT?
As a Check & Training Pilot, I always felt that training could be more realistic in its delivery by providing crews with much greater variability to replicate responses more likely to occur when having to deal with problems dynamically. Sim sessions in the past tended to be more about executing a well thought out pre-planned scenario, simply regurgitating information learnt a few weeks before rather than building on processes that work for multiple situations. There’s no better training than handling problems exactly how you would in a real-life environment.
How much did you know about the EBT Program?
I was fortunate enough to be studying for my Aviation Management Master’s Degree at the time and ended up completing my thesis on Evidence-Based Training. This gave me a very solid foundation to work from, as I had read all the available literature several times over and was also able to clarify a lot of questions directly from EBT Solutions (now Salient).
What were the first steps (internal and external)?
Internally, I presented my thesis to the Training & Checking Management team, where it was thoroughly discussed and then decided upon to investigate the feasibility of implementation.
Externally, when it was decided to go ahead with EBT we called for a meeting with the Regulator to discuss our intentions of implementation. We were keen to engage with them on this critical safety piece from the start.
How did you involve CASA in the implementation process?
We scheduled regular progress meetings to discuss implementation plans and when training was conducted, CASA personnel were participants rather than observers, so they could get a real feel for the program and a deeper understanding of how EBT works in practice. Keeping them in the loop throughout the implementation, certainly paid off when it came to the approval stage.
Can you describe the roadmap to EBT implementation?
- Internal Approval to implement EBT
- External meeting with Regulator discussing intentions to implement EBT and then regular updates at defined intervals
- IT engagement for new infrastructure for Prodefis TPMS
- Stakeholder Workshop (Run by EBT Solutions, now Salient)
- Pilot Comms (3 Newsletters – every 6 months)
- Change of ethos for entire Training & Checking System – New Grading outside of EBT
- Prodefis Development work for EBT
- Malfunction Clustering Build
- Instructor Training (Run by EBT Solutions, now Salient)
- Cyclic Build – First Semester
- Instructor Training (Internal) – Non-technical Competencies enhancement
- Manual re-writes
- Simulator Training (Run by EBT Solutions, now Salient)
- Change Management
- Software Training and EBT recap (Internal)
- Pilot Roadshows – Presented and Answering Questions on EBT
- Go Live with EBT
What was the feedback from you instructors about the change and their training?
Almost everybody was on board from the very start, as most Check Pilots were very training orientated anyway, so they loved the concept of EBT. There were a few that took a little longer to convince, but by the time they had completed all of their training, everybody was behind the program. This in my opinion, was one of the main reasons why we had such a successful introduction, you really need to have all of your Instructors onside to accomplish this. We also had great feedback from the Training Courses that were run, however the Sim Training seemed to be the standout that the guys enjoyed the most, as they could really see how the theory was put into practice.
What support did you provide the instructors with to do their job (TMS, docs etc.)?
After completing the training with EBT Solutions (now, Salient), we also ran a Non-technical Competencies workshop to bolster the identification and rectification of those said Competencies, as we had only completed minimal training in this area beforehand. This was about giving the Instructors useful tips in enhancing Pilots Skills in these critical areas. We also conducted training in the use and delivery of the Software which we specifically developed with Prodefis to manage the EBT sessions.
When you launched the program, what feedback were you expecting?
With all the work that went into setting up and implementing EBT, we were certainly hoping that it would be successful, however the program speaks for itself, as it’s all about professional development of Flight Crew, so we were quite comfortable that crews would see it for what it is.
What feedback did you receive from the pilots?
I was expecting good feedback, but what we received was just simply amazing, the fact that we had almost two thirds of the Pilot group providing feedback and in such a favorable way, certainly exceeded our expectations. The trust in the EBT program was cemented in that first semester. This in part was due to the great Instructors we have working for us, delivering the program as we had intended.
Could it be that EBT can be a softer approach so pilots don’t have to prepare and never fail?
No, I don’t believe this to be the case, I think as a Professional Pilot, you are always your harshest critic. Pilots are always trying to improve their skills and this program allows you to do so in a non-threatening environment, where making mistakes is a part of the learning process. There is still jeopardy, but a lot less than traditional cyclic programs.
After initial feedback what was the next step?
It was more building on the success and making sure we kept our end of the bargain. We kept working on the inter-rater reliability of our Instructors and involved them in improving the overall delivery. Almost all of the feedback was very positive, however still took on board any criticisms.
What did you learn from the first semester (cyclic)?
That Pilots loved EBT, they loved being challenged and they loved learning and enhancing their skills in an environment conducive to learning.
How did you adapt subsequent cyclics?
Each Semester brings a change in some of the Training Topics that the Pilots are exposed too. The important things to remember here are; keep the scenarios real and believable, make sure it’s not all about system failures and focus on particular competencies each semester to get a wide range of challengers for the Pilots to deal with. Variability is the key with the Scenario Elements so that Pilots experience real Surprise and aren’t anticipating what’s going to happen next. You want the Decision Making and Problem Solving to be real, so you can really see the softer non-technical skills at play.
After 3 semesters has the feedback changed.
The Feedback is very consistent with 99% of Pilots stating that the EBT system is far more effective. We also saw improvement in strengthening weaker competencies during Day 2 and the delivery of the facilitated debrief.
How would you advise other organizations about the pathway to successful EBT?
Consult with the experts in EBT, unfortunately the ICAO/IATA Manuals only tell you part of the story, you really need good guidance and be able to clarify parts of the program when it comes down to the business end of implementation.
Is there anything else you would like to add?
I have heard a lot of Airlines tinkering with the EBT program even before they have implemented it, Introduce the Baseline Program as it was intended, it makes it for a much easier experience with the regulatory for initial approval, plus a lot of smart people spent a lot of time putting this excellent program together.