As a global certification body, IWCF delivers high-stakes, summative assessments that are trusted worldwide to measure the skills and knowledge of safety-critical personnel.
Given the critical role our assessments play, we are committed to ensuring that every question remains consistent, technically robust, and fair to all candidates. Our technical review process is a key component of our overall approach to maintaining assessment quality.
What Is the Technical Review Process?
Before a question is included in an assessment, it undergoes a technical and quality review. This process confirms technical accuracy, clarity, and alignment with established standards.
Once questions are active, we monitor their performance through an ongoing review process. This helps maintain the validity, relevance, and fairness of assessments over time, and across languages and regions.
Our review process involves four core activities:
- Monitoring Candidate Feedback
Candidates are encouraged to provide feedback on individual questions following their assessments. Feedback can address any aspect of a question, including its technical content, wording, or answer options.All candidate feedback is reviewed by a team member. We analyse both individual comments and broader patterns to determine whether multiple candidates are raising similar concerns, whether the feedback comes from specific regions or languages, or whether technical or wording issues are being identified.We recognise that feedback reflects a wide range of perspectives and experiences across our candidate base. While we cannot respond to every comment individually, we carefully consider each one. - Analysing Data
Robust reporting tools enable us to monitor question performance across languages and regions. This helps us to identify whether questions are performing consistently or if variations exist in specific languages or locations.We also examine how often candidates select each answer option, providing insight into question clarity and difficulty. - Technical Review by Subject Matter Experts (SMEs)
Data gathered from candidate feedback and pass rate analysis is reviewed by a panel of subject matter experts from diverse regions and backgrounds. They use this data, along with candidate feedback, to evaluate whether a question requires updates.The panel aims to avoid unnecessary or subjective changes. In some cases, the best course of action is to maintain the current version of the question. In others, wording or technical terminology may be updated to improve clarity or reflect industry developments. - Continuous Monitoring over time
Whether amendments are made or not, our monitoring continues. We consistently review feedback and performance data to identify trends or patterns that may signal the need for further review. When questions are repeatedly flagged in feedback but confirmed as technically sound through review, we highlight these in the Instructor Focus section of our Instructor and Assessor Newsletter. This provides valuable insight into common candidate misunderstandings and supports targeted instruction.
Why Does This Matter?
We take the quality and relevance of our assessment questions seriously. Continuous review is not just a process, it is fundamental to our mission of reducing risk to life, assets and environment caused by well control incidents.
The technical review process supports:
- Fairness: Every candidate, regardless of location or language, deserves an equal opportunity to succeed. By reviewing pass rates and feedback across regions, we help ensure consistent standards for all.
- Continuous Improvement: Assessments must evolve over time. Regular review allows us to refine content in line with changes in industry standards and candidate needs.
- Trust: Organisations and individuals rely on the validity of our certifications. Our review process demonstrates our commitment to maintaining high-quality standards.
Summary
Our technical review process plays a central role in ensuring IWCF certification remains fair, valid, and fit for purpose.
By analysing candidate feedback and pass rate data, we identify trends, address potential issues, and make informed improvements to our assessment.
If you have any specific feedback you’d like us to consider, please contact us at assessmentdevelopment@iwcf.org.
