IWCF

This edition of our blog series outlines how learning objectives, outcomes, and importance levels work together to create a clear and consistent framework for teaching and learning.

A well-structured syllabus is fundamental to any educational programme. It provides clear learning objectives and specific outcomes and ensures a level of standardisation between training institutions and teachers/instructors.  

For well control training, having the correct skills and knowledge makes the difference between a controlled situation and a catastrophic blowout. This is why the syllabus is intentionally designed and structured to ensure all key topics are adequately taught and assessed. 

What is a learning objective?

A learning objective is a clear, general statement that outlines the topic which will be taught and assessed.  It sets the context for the more detailed and specific learning outcome. 

What is a learning outcome?

Learning outcomes are detailed and make the results of learning clear, specific, and measurable. Action verbs such as ‘identify’, ‘explain’ or ‘describe’ signal to the instructor the scope the candidate must have to effectively meet the syllabus requirement. 

Importance levels 

The IWCF Drilling Well Control and the Well Intervention Pressure Control syllabi both apply importance level weightings to topics.  

This framework highlights the most safety-critical principles, ensuring candidates build the core competencies needed to understand the full syllabus and develop the skills they will need in their roles.  

Below is an example of the importance level structure from the WIPC syllabus. 

Syllabus categories marked with higher importance levels often contain principles that, while introduced within a specific section, are not confined to a single learning outcome.  

These topics are critical for safe and effective operations that may appear throughout the entire well control syllabus, appearing in multiple contexts. Assessment questions often incorporate these principles when asking candidates to identify the safest or most appropriate first action in response to a well control scenario. 

Examples of high-importance topics include managing barriers, leak detection, kick warning signs and indicators, secondary well control, and the management of non-shearables across the BOP. 

IWCF has designed the syllabus in a way that all topics are necessary and must be both taught and assessed. While Level A outcomes represent the most safety-critical knowledge and skills, Levels B and C remain essential for supporting safe and effective operations.

Why this matters

Aligning learning objectives, outcomes, and importance levels gives both instructors and candidates a clear understanding of what’s expected and how each topic fits within the wider framework. 

The IWCF syllabus framework ensures that every essential topic is taught and assessed consistently, supporting our goal of maintaining the highest standards of well control training worldwide.

If you have any questions about our syllabi for IWCF programmes, please contact us at assessmentdevelopment@iwcf.org. 

As a global certification body, IWCF delivers high-stakes, summative assessments that are trusted worldwide to measure the skills and knowledge of safety-critical personnel.

Given the critical role our assessments play, we are committed to ensuring that every question remains consistent, technically robust, and fair to all candidates. Our technical review process is a key component of our overall approach to maintaining assessment quality.

What Is the Technical Review Process? 

Before a question is included in an assessment, it undergoes a technical and quality review. This process confirms technical accuracy, clarity, and alignment with established standards.

Once questions are active, we monitor their performance through an ongoing review process. This helps maintain the validity, relevance, and fairness of assessments over time, and across languages and regions.

Our review process involves four core activities: 

1. Monitoring Candidate Feedback
   Candidates are encouraged to provide feedback on individual questions following their assessments. Feedback can address any aspect of a question, including its technical content, wording, or answer options.All candidate feedback is reviewed by a team member. We analyse both individual comments and broader patterns to determine whether multiple candidates are raising similar concerns, whether the feedback comes from specific regions or languages, or whether technical or wording issues are being identified.We recognise that feedback reflects a wide range of perspectives and experiences across our candidate base. While we cannot respond to every comment individually, we carefully consider each one.
2. Analysing Data
   Robust reporting tools enable us to monitor question performance across languages and regions. This helps us to identify whether questions are performing consistently or if variations exist in specific languages or locations.We also examine how often candidates select each answer option, providing insight into question clarity and difficulty.
3. Technical Review by Subject Matter Experts (SMEs)
   Data gathered from candidate feedback and pass rate analysis is reviewed by a panel of subject matter experts from diverse regions and backgrounds. They use this data, along with candidate feedback, to evaluate whether a question requires updates.The panel aims to avoid unnecessary or subjective changes. In some cases, the best course of action is to maintain the current version of the question. In others, wording or technical terminology may be updated to improve clarity or reflect industry developments.
4. Continuous Monitoring over time
   Whether amendments are made or not, our monitoring continues. We consistently review feedback and performance data to identify trends or patterns that may signal the need for further review. When questions are repeatedly flagged in feedback but confirmed as technically sound through review, we highlight these in the Instructor Focus section of our Instructor and Assessor Newsletter. This provides valuable insight into common candidate misunderstandings and supports targeted instruction. 

Why Does This Matter? 

We take the quality and relevance of our assessment questions seriously. Continuous review is not just a process, it is fundamental to our mission of reducing risk to life, assets and environment caused by well control incidents.

The technical review process supports: 

• Fairness: Every candidate, regardless of location or language, deserves an equal opportunity to succeed. By reviewing pass rates and feedback across regions, we help ensure consistent standards for all. 

• Continuous Improvement: Assessments must evolve over time. Regular review allows us to refine content in line with changes in industry standards and candidate needs. 

• Trust: Organisations and individuals rely on the validity of our certifications. Our review process demonstrates our commitment to maintaining high-quality standards.

Summary 

Our technical review process plays a central role in ensuring IWCF certification remains fair, valid, and fit for purpose. 

By analysing candidate feedback and pass rate data, we identify trends, address potential issues, and make informed improvements to our assessment.

If you have any specific feedback you’d like us to consider, please contact us at assessmentdevelopment@iwcf.org.

Maintaining assessment integrity in a digital format presents considerable challenges. 

This article shares how we have adapted IWCF processes to ensure the assessment process remains valid, reliable and fair in an online environment.

Our recent newsletter highlighted a core value that underpins our work: our unwavering commitment to maintaining the highest standards of integrity. This commitment is critical as we adapt and strengthen our assessment processes in an increasingly digital world.  

The COVID-19 pandemic accelerated the transition from paper-based to digital formats. Post- pandemic, many institutions, including IWCF, have embraced online training and assessment due to its flexibility and accessibility.  

With this shift comes a significant concern: assessment security. Assessment and awarding bodies now need to consider new types of misconduct and negative behaviours that may not have previously been considered. 

Safeguarding high-stakes, summative assessment  

Assessment can generally be categorised into two types.  

Formative assessment is carried out by the instructor, throughout the learning process.  It is often low-stakes (informal, no serious outcomes) and can include quizzes, classroom discussions, exercises and other activities designed to check understanding and provide feedback. 

Summative Assessment is often high-stakes, as the outcome determines whether someone is qualified or competent for a role. Created by the assessment/awarding body, it evaluates whether a candidate has achieved the required standard of knowledge and competence.  

IWCF delivers high-stakes, summative assessment. Negative online behaviours such as cheating and dishonestly can have catastrophic consequences for the safety our industry. It is critical that our assessments must remain trusted and effective, ensuring those certified are skilled, competent and capable of managing the risks involved with well control operations.  

No single tool or feature can fully safeguard the assessment. That is why we apply multiple layers to create a robust authentication and security framework.  

Virtual invigilation  

Our invigilation partner, VICTVS, plays a key role in overseeing the assessment process. Invigilators (also called proctors) support candidates, monitor the test and help to prevent malpractice.  

• ID checks: Invigilators verify each candidate’s ID to confirm they are the authorised test taker. 

• Room checks: Candidates must use their webcam to do a 360-degree scan of their room before starting. This confirms they are alone and have no unauthorised materials. The invigilator also ensures the candidate’s video, sound, lighting, and workspace meet IWCF standards. 

• Secure PINS: Candidates receive a one-time secure PIN to access their assessment. 

• Multi-mode monitoring: Invigilators monitor candidates from multiple angles during their assessment. This includes a mobile device behind them, a webcam on their assessment device and live screen sharing. This approach reduces cheating and ensures candidates follow requirements throughout.  

Assessment Design  

The online framework also contributes to the security and integrity of the assessment process. 

• Randomised question selection: sections of the assessment are randomised to ensure each candidate receives a unique sequence.  

• Question banks: the system selects questions from a varied pool to ensure differences between candidates’ assessments. 

• Answer order randomisation: Shuffling the answer choices encourages critical thinking and reduces cheating.  

• Level-appropriate questions: Including scenario-based questions that reflect real-world well control challenges tests problem-solving and critical thinking rather than memory recall.  

Data monitoring  

A major advantage of online assessments is the wealth of data they generate. Unlike paper-based assessments, digital platforms provide instant insights into pass rates and performance trends across our global network of accredited training centres.  

Detecting integrity issues  

• Unusual patterns such as sudden spikes in pass rates in certain regions could highlight compromised security.  

• Technical issues: We can identify lags or connection problems and provide support.  

• Global comparison: Analysing performance across regions helps us to ensure fairness in assessment conditions. 

Data monitoring also plays a significant role in ensuring the validity and reliability of our assessment questions. We will explore this further in a future post. 

Commitment to integrity  

With the right measures in place, assessment bodies can strengthen the overall assessment process, addressing concerns while providing a secure testing environment. 

IWCF will continue to be vigilant and adaptable as learning and assessment becomes increasingly digital and new challenges present themselves. 

We are grateful to our team, instructors and members who work daily to protect the integrity of IWCF assessments. We share a responsibility to ensure that our programmes remain not only effective, but fair and secure. 

Many of the points mentioned in this post are brief summaries of more in-depth, detailed IWCF procedures. If you have any questions related to our online assessment process, please contact information@iwcf.org.