GVP Module XVI: Educational Materials as Additional Risk Minimisation Measures

Introduction

Educational materials are one of the tools that may be used when routine risk minimisation is not sufficient to address an important risk. Their purpose is not simply to provide more information. They are intended to support a defined risk-minimisation objective by influencing the knowledge, decisions or behaviour of a specific audience.

This distinction determines how an educational programme should be designed and evaluated. A document can be accurate, attractive and widely distributed while still failing to minimise the risk for which it was introduced.

The correct starting point is therefore the safety problem rather than the material itself:

Important risk
      ↓
Risk-minimisation objective
      ↓
Required behaviour
      ↓
Target audience
      ↓
Educational intervention
      ↓
Implementation
      ↓
Effectiveness
      ↓
Adaptation

Educational materials should remain connected to this chain throughout their lifecycle.

1. What Educational Materials Are Intended to Do

An educational programme is an additional risk minimisation measure when it is used to address a specific safety concern that cannot be adequately managed through routine measures alone.

The intervention may need to help healthcare professionals recognise a risk, apply a particular prescribing or monitoring requirement, administer a product correctly, or counsel patients about a specific precaution.

The material should therefore contain information that enables the intended action. Merely repeating general product information does not necessarily constitute effective additional risk minimisation.

2. The Relationship With Routine Risk Minimisation

Routine risk minimisation is the foundation of safe use and includes the product information and other measures that apply as part of normal medicinal-product regulation.

Additional educational measures should address a residual risk that remains after consideration of routine measures. They should not simply duplicate the SmPC or package leaflet without a defined additional purpose.

The decision to introduce education should therefore follow assessment of the residual risk and the limitations of existing controls.

3. Start With the Risk

The safety concern should be clearly defined before an educational intervention is designed.

The organisation should understand the nature of the risk, the population affected, the circumstances in which it occurs and the preventable mechanism where one exists.

For example, if the risk results from failure to recognise a contraindication, the educational objective may be to improve recognition before prescribing. If the risk results from incorrect administration, the intervention may instead need to teach the correct preparation or administration process.

The intervention follows from the mechanism of risk.

4. Define the Risk-Minimisation Objective

The objective should describe what the educational programme is intended to achieve.

A useful objective is specific enough to determine whether the intervention worked. "Increase awareness" is usually less informative than an objective describing the knowledge or behaviour required to prevent the identified risk.

The objective should also be consistent with the RMP and the regulatory decision that established the additional risk-minimisation measure.

5. Identify the Required Behaviour

Education is most useful when it supports a clearly defined action.

The required behaviour may involve prescribing, screening, dose selection, monitoring, counselling, administration, contraception, recognition of symptoms or another safety-related activity.

If no meaningful behaviour or decision needs to change, the organisation should question whether an educational intervention is the appropriate additional measure.

6. Identify the Target Audience

The target audience should be defined according to who must perform the action needed to control the risk.

This may include prescribers, pharmacists, nurses, other healthcare professionals, patients or caregivers. Different audiences may require different content because their responsibilities and decisions differ.

Broad distribution should not substitute for appropriate audience definition.

7. Content Should Add to Routine Information

Educational material should be aligned with the authorised product information while serving its additional risk-minimisation purpose.

The material should not contradict the SmPC, package leaflet or labelling. At the same time, simply reproducing those documents may not address the specific behavioural or educational objective.

The content should therefore select and present the information needed for the safety intervention without creating an alternative source of inconsistent product information.

8. Scientific Accuracy

Every substantive safety statement in an educational material should be supported by the authorised and scientifically established information relevant to the risk.

The material should preserve important qualifications and should not introduce stronger causal or clinical claims than the evidence supports.

Simplification for the target audience is appropriate; alteration of the scientific meaning is not.

9. Clear and Actionable Messages

An educational material should make the required action readily identifiable.

A healthcare professional should be able to determine what to do differently as a result of the material. A patient or caregiver should similarly be able to understand the relevant precaution or action where they are part of the intervention.

A long document is not necessarily a comprehensive document if the critical action is difficult to find.

10. Educational Materials and Promotion

Educational materials used as risk minimisation should remain focused on the safety objective and should not become promotional communications.

The distinction is particularly important where materials contain product-specific information, branding or distribution mechanisms associated with commercial activity.

The content should be controlled as a safety intervention rather than as marketing material.

11. Design Around the User

The effectiveness of an educational intervention depends partly on whether the intended audience can understand and use it.

Design should therefore consider terminology, sequence, readability, format and the practical environment in which the information will be used.

User-centred design does not mean changing the scientific content to make it more appealing. It means presenting the necessary content in a form that supports the intended decision or behaviour.

12. Stakeholder Engagement

Early engagement with healthcare professionals and patients can help identify whether an educational intervention is understandable and usable.

Feedback can reveal ambiguities, unrealistic assumptions or practical barriers before widespread implementation.

Engagement should inform the design without allowing the safety objective or regulatory requirements to be weakened merely because a message is inconvenient.

13. Member State Implementation

EU-level agreement on an educational programme does not eliminate the need to consider national implementation requirements.

National healthcare systems, languages, professional structures and distribution arrangements can differ. The organisation should therefore understand the applicable regulatory pathway in each Member State in which the measure is implemented.

The scientific content should remain consistent while the implementation can reflect legitimate national requirements.

14. Review and Approval

Educational materials should pass through the applicable scientific and regulatory review before dissemination.

The review should confirm alignment with the authorised product information, the risk-minimisation objective and the regulatory decision establishing the measure.

Where Member State review is required, national implementation should not begin before the applicable approval or agreement has been obtained.

15. Version Control

Educational materials should be controlled documents.

The organisation should be able to identify the current approved version, its effective date and the versions that preceded it. Obsolete versions should not remain in active distribution channels where they could create conflicting instructions.

Version control becomes particularly important when product information or the underlying risk assessment changes.

16. Distribution

Distribution should be designed around the target population and the required behaviour.

A distribution record can demonstrate that material was sent or made available. It does not demonstrate that the intended audience received, understood or acted on it.

This distinction becomes important when assessing implementation and effectiveness.

17. Implementation Versus Effectiveness

Implementation asks whether the risk-minimisation measure was delivered as intended. Effectiveness asks whether it achieved its safety objective.

For example, an organisation may demonstrate that educational material was distributed to the intended healthcare professionals. That establishes an element of implementation. It does not establish that the professionals understood the safety message or changed the relevant behaviour.

These are separate questions and should be evaluated accordingly.

18. Knowledge, Behaviour and Outcomes

Effectiveness can be examined at different levels.

Knowledge measures may assess whether the intended audience knows the relevant safety information. Behavioural measures assess whether the required action occurs in practice. Outcome measures assess whether the clinical risk itself has changed.

The appropriate level depends on the risk-minimisation objective and the causal pathway between the intervention and the desired outcome.

19. Effectiveness Evaluation Should Be Planned Prospectively

A strong evaluation strategy is designed when the risk-minimisation measure is designed, rather than added after implementation.

The organisation should identify the objective, indicators, data sources, timing and decision thresholds needed to determine whether the measure is functioning adequately.

This creates an evidence-based basis for later adaptation.

20. Choosing Effectiveness Indicators

The indicator should correspond to the point in the causal pathway that the intervention is intended to influence.

If the immediate objective is knowledge, a knowledge measure may be appropriate. If the objective is a prescribing decision, prescribing behaviour may be more informative. If the intervention is intended to prevent a measurable clinical event, an outcome measure may provide additional evidence, although attribution may be difficult.

No single indicator is automatically appropriate for every educational programme.

21. Baseline Measurement

Where feasible, information about the situation before implementation can improve interpretation of later findings.

Without a baseline, an observed post-intervention result may be difficult to interpret because there is no direct comparison with the pre-intervention state.

Baseline data are not always available or feasible, but their absence should be recognised as a limitation rather than ignored.

22. Surveys

Surveys can assess knowledge, awareness, attitudes or self-reported behaviour.

Their usefulness depends on the questions, sampling, response rate, timing and population represented. Self-reported behaviour may not correspond to actual clinical behaviour.

Survey results should therefore be interpreted according to what the method can genuinely establish.

23. Behavioural Data

Where the objective concerns prescribing or another observable action, routinely collected healthcare data may provide stronger evidence than self-report.

Examples can include prescribing patterns, laboratory monitoring, screening procedures or other measurable actions. The selected data source should directly capture the behaviour that the intervention is intended to influence.

Changes in behaviour should also be considered in relation to other factors that could have changed at the same time.

24. Clinical Outcomes

Clinical outcomes can provide the most direct evidence that a risk-minimisation intervention may have reduced harm, but they are often the most difficult measures to interpret.

Rare outcomes require large populations or long observation periods. Changes in disease incidence, exposure, treatment patterns or reporting can also affect the observed outcome.

Outcome evidence should therefore be interpreted within an appropriate study design rather than treated as a simple before-and-after count.

25. Mixed Evaluation Strategies

A combination of implementation, knowledge, behavioural and outcome measures may provide a more complete assessment than any one measure alone.

For example:

Material delivered
      ↓
Audience reached
      ↓
Message understood
      ↓
Required behaviour performed
      ↓
Risk reduced

If the final outcome does not improve, the intermediate measures can help identify where the intervention failed.

26. Interpreting a Negative Result

Failure to demonstrate effectiveness does not automatically mean that the educational material itself was ineffective.

The intervention may not have reached the intended population, may have been misunderstood, may not have changed behaviour, or may have been appropriate but insufficient to overcome other causes of the risk.

The evaluation should therefore identify which part of the causal pathway failed before deciding how the measure should be changed.

27. Confounding in Effectiveness Evaluation

Changes in safety outcomes may reflect factors unrelated to the educational programme.

Changes in prescribing, disease incidence, diagnostic practice, competing risk-minimisation measures or regulatory restrictions can all affect the outcome.

The evaluation design should therefore consider plausible alternative explanations and avoid attributing every post-implementation change to the intervention.

28. Multiple Risk Minimisation Measures

A medicinal product may have several risk-minimisation measures operating simultaneously.

When an outcome changes, it may be difficult to determine which measure contributed. The evaluation should therefore consider the overall intervention package and the sequence in which measures were introduced.

Where possible, the evaluation should identify the specific component whose performance is being assessed.

29. Educational Materials for Medication Errors

Educational materials can be appropriate when a preventable use error contributes to an important risk.

The intervention should identify the precise error mechanism and provide the information needed to prevent it. General reminders to "use the product correctly" are unlikely to be sufficient when the error involves a specific calculation, preparation or administration step.

The evaluation should measure the relevant behaviour or error rate where feasible.

30. Educational Materials for Monitoring Requirements

Some risks depend on a healthcare professional performing a particular monitoring activity.

An educational programme may need to explain who requires monitoring, what test or assessment is required, when it should occur and what action follows an abnormal result.

The measure should not merely state that monitoring is recommended if the safety objective depends on a specific clinical pathway.

31. Educational Materials for Contraindications and Precautions

Where a serious risk can be prevented by avoiding exposure in a defined circumstance, education may focus on recognition of the relevant contraindication or precaution.

The material should make the decision point clear and avoid creating ambiguity between situations in which treatment is contraindicated and situations in which additional monitoring or clinical judgement is appropriate.

The evaluation should focus on whether the intended prescribing or treatment decision occurs.

32. Educational Materials for Administration

Some risks arise from how a product is prepared or administered rather than from the pharmacological effect of the active substance.

Educational materials may need to demonstrate the correct procedure, identify common errors and explain the consequences of incorrect administration.

Where technique is central to the risk, written information alone may not be sufficient to demonstrate competence. The selected intervention should reflect the actual mechanism of error.

33. Educational Materials and Pregnancy Prevention

Pregnancy-prevention measures require particular attention to the interaction between healthcare-professional behaviour, patient behaviour and the timing of exposure.

An educational intervention may be one component of a broader risk-minimisation programme. The objective should be defined precisely, and the evaluation should reflect the relevant pathway from information and counselling to preventive behaviour and pregnancy-related outcomes.

The applicable current Module XVI Addendum I should be used for medicinal products with embryo-fetal risks.

34. Updating Educational Materials

A material should be reassessed when the underlying risk, product information, regulatory decision or intended behaviour changes.

An update should preserve the original risk-minimisation objective unless the regulatory or scientific assessment has changed it. Changes should be documented so that the organisation can explain why the material was revised.

The existence of an updated material should also trigger consideration of whether obsolete versions remain accessible.

35. Coordinating Across Products With the Same Active Substance

Several medicinal products containing the same active substance may require comparable risk-minimisation measures.

Where coordinated measures are appropriate, inconsistent educational content could create confusion for healthcare professionals and patients. The organisation should therefore consider the broader regulatory and product context when developing or revising materials.

The current Module XVI framework provides for coordination of risk-minimisation effectiveness evaluation for medicinal products containing the same active substance.

36. National Differences

National healthcare systems can affect how an educational intervention is delivered.

Professional roles, prescribing systems, reimbursement arrangements, language and access to healthcare may differ between Member States. These differences should be considered when implementing and evaluating the intervention.

National adaptation should not alter the underlying safety objective or introduce scientifically inconsistent information.

37. Translation

Translation can affect the safety meaning of an educational material, particularly where instructions depend on precise terminology.

The translated version should preserve the approved scientific content, required action and degree of certainty. Material ambiguity should be identified before dissemination.

Translation review is therefore part of implementation quality.

38. Digital Educational Materials

Digital formats can improve accessibility and allow rapid updating, but they also introduce control challenges.

The organisation should ensure that the current approved content is identifiable, obsolete content is controlled where necessary and the digital channel remains appropriate for the intended audience and regulatory context.

A digital format does not remove the requirement for scientific, regulatory and version control.

39. Websites and Online Materials

Online resources require particular attention to their regulatory and promotional context.

A website may be used in some national settings as part of an agreed communication approach, but it should not automatically be assumed to be an acceptable additional risk-minimisation channel in every Member State.

The applicable regulatory and national requirements should be established before an online intervention is included in an RMP or implemented.

40. Distribution Records

Distribution records should be sufficient to demonstrate implementation of the measure where such evidence is required.

The record may need to show which population was targeted, when the material was distributed and through which mechanism. It should not be confused with evidence that the material was understood or acted upon.

The distinction is essential for later effectiveness evaluation.

41. Record Retention and Traceability

The organisation should retain enough evidence to reconstruct the lifecycle of a significant educational intervention.

This may include the underlying safety concern, RMP objective, regulatory decision, approved material, review records, national implementation, distribution evidence, effectiveness assessments and subsequent revisions.

The level of documentation should be proportionate to the measure but sufficient to demonstrate controlled governance.

42. Quality Management

Educational-material processes should be integrated into the pharmacovigilance quality system.

Responsibilities, review steps, approval pathways, document control, distribution, deviation management and escalation should be defined. Where external vendors or affiliates are involved, interfaces should be controlled.

Quality management should support timely implementation rather than create unnecessary procedural complexity.

43. Illustrative Failure Mode: Accurate but Non-Actionable Material

An educational document accurately describes a serious adverse reaction but does not clearly explain what the prescriber should do to prevent or manage it.

The potential weakness is a disconnect between scientific information and the risk-minimisation objective.

The material may be factually correct while still being ineffective as an intervention.

44. Illustrative Failure Mode: Material Duplicates the Product Information

An educational document reproduces large sections of the SmPC without providing additional information targeted to the identified safety concern.

The potential weakness is that the additional measure has not been designed around a residual risk or specific behavioural objective.

The organisation should be able to explain what the educational intervention adds beyond routine risk minimisation.

45. Illustrative Failure Mode: Distribution Mistaken for Effectiveness

The organisation can demonstrate that educational materials reached the target audience and concludes that the risk-minimisation measure was effective.

The potential weakness is a failure to distinguish implementation from effectiveness. Distribution establishes delivery, not whether the intended knowledge, behaviour or outcome changed.

46. Illustrative Failure Mode: Obsolete Versions Remain Available

A revised educational material has been approved, but an older version remains accessible through an uncontrolled digital channel.

The potential weakness is inadequate document and channel control. Where the obsolete content could create a conflicting safety instruction, the organisation should have a process for identifying and controlling the obsolete version.

47. Illustrative Failure Mode: Evaluation Measures the Wrong Behaviour

An educational programme is intended to reduce inappropriate prescribing, but its effectiveness assessment measures only whether healthcare professionals remember the name of the safety concern.

The potential weakness is a mismatch between the evaluation indicator and the risk-minimisation objective.

Knowledge may be relevant, but if prescribing behaviour is the required intervention point, the evaluation should also consider whether that behaviour changed.

48. Illustrative Failure Mode: National Adaptation Changes the Meaning

A national version is adapted for local practice and introduces wording that changes the original safety instruction.

The potential weakness is loss of scientific consistency during implementation. Legitimate national adaptation should not alter the underlying risk-minimisation objective or introduce a different safety conclusion.

49. Illustrative Inspection Scenario: No Defined Objective

An inspector asks what the educational programme is intended to achieve. The organisation can provide the material and distribution records but cannot identify a specific risk-minimisation objective beyond "increase awareness."

This would make it difficult to determine whether the intervention was appropriately designed or whether its effectiveness can be assessed.

The scenario is illustrative and is not presented as a documented regulatory finding.

50. Illustrative Inspection Scenario: No Link to the Risk

An educational material has been revised several times, but the organisation cannot readily show which safety concern and residual risk each major content element addresses.

The potential weakness is loss of traceability between the risk assessment, RMP objective and intervention design.

51. Illustrative Inspection Scenario: Effectiveness Cannot Be Interpreted

A post-implementation survey reports that most respondents understood the educational material, but there is no defined baseline, sampling rationale or explanation of how the measured knowledge relates to the required safety behaviour.

The result may be informative, but its ability to establish effectiveness is limited.

52. Practical Design Framework

Before approving an educational programme, the organisation should be able to describe the intervention as a chain:

Safety concern
      ↓
Residual risk
      ↓
Preventable mechanism
      ↓
Risk-minimisation objective
      ↓
Required behaviour
      ↓
Target audience
      ↓
Educational content
      ↓
Implementation channel
      ↓
Implementation indicator
      ↓
Effectiveness indicator
      ↓
Decision rule
      ↓
Adaptation

Each step should have a reason for existing. If the organisation cannot explain how the educational content is expected to influence the safety outcome, the intervention should be reconsidered before implementation.

53. The Role of the RMP

The educational programme should be connected to the relevant RMP section describing the important risk, the risk-minimisation objective and the additional measure.

The RMP provides the context in which the intervention is selected and later evaluated. It should therefore be possible to trace the educational material back to the safety concern and forward to the effectiveness assessment.

Changes to the material or evaluation strategy should be considered in relation to the RMP when the change affects the risk-management strategy.

54. The Role of the QPPV

The QPPV should have appropriate oversight of significant additional risk-minimisation measures and their relationship to the pharmacovigilance system.

This does not require personal approval of every educational document. The relevant question is whether governance gives the QPPV sufficient visibility and assurance that important measures are appropriately designed, implemented, evaluated and adapted.

Where effectiveness results indicate that a measure is not achieving its objective, the QPPV should be able to understand the implications for the wider pharmacovigilance system.

55. Vendor and Affiliate Oversight

External agencies may support design, translation, distribution, digital hosting or evaluation.

Delegating an operational activity does not eliminate the MAH's need for oversight. Responsibilities, interfaces, escalation pathways, data access and record retention should be defined sufficiently to reconstruct the intervention's performance.

The organisation should also know which party controls the current approved version at each stage of the process.

56. Adapting the Measure

Effectiveness evaluation should lead to a decision when the evidence shows that the measure is inadequate, unnecessary, or no longer proportionate.

Possible responses can include changing the content, changing the delivery mechanism, targeting a different audience, strengthening implementation, adding another intervention or reconsidering whether the measure remains necessary.

Adaptation should be evidence-based and connected to the reason the original measure was introduced.

57. When the Measure Is No Longer Needed

Risk-minimisation measures should remain proportionate throughout the product lifecycle.

If new evidence demonstrates that a residual risk has changed materially, the organisation and regulatory authorities may need to reassess whether an additional educational measure remains justified.

The continued existence of a measure should therefore not be treated as proof that it remains effective or necessary indefinitely.

58. Communication Versus Education

Educational materials and general safety communication overlap but are not identical.

Safety communication may inform a broad audience about a safety issue. An educational risk-minimisation measure is designed around a defined safety objective and target behaviour.

The distinction matters because an educational measure should be evaluated according to the risk-management objective for which it was introduced.

59. Educational Material Versus Training

A document can support education without constituting formal competency-based training.

Where safe use depends on a practical skill, the organisation should consider whether the selected intervention actually develops and verifies that skill. Providing written instructions may not demonstrate that the recipient can perform a complex procedure correctly.

The intervention should therefore match the mechanism of risk.

60. Educational Material Versus Patient Information

Routine patient information supports appropriate use of the medicinal product. An additional educational intervention addresses a specific residual risk requiring further risk minimisation.

The two should remain consistent, but their purposes are different.

A new educational document should not automatically be created simply because information already exists in the package leaflet.

61. Inspection Perspective

An effective inspection trail should allow an inspector to move backwards and forwards through the intervention lifecycle:

Risk
 ↕
RMP objective
 ↕
Educational measure
 ↕
Implementation
 ↕
Effectiveness
 ↕
Regulatory follow-up

The key question is whether the organisation can demonstrate that the educational measure is a controlled, evidence-based intervention rather than simply a document that was produced and distributed.

62. Practical Review Questions

For a significant educational risk-minimisation measure, the organisation should be able to answer:

1. What important risk is the measure addressing?
2. What residual risk justified an additional measure?
3. What is the precise risk-minimisation objective?
4. What behaviour or decision is expected to change?
5. Who must change that behaviour?
6. Why was education selected as the appropriate intervention?
7. What does the material add beyond routine product information?
8. How was the material reviewed and approved?
9. How is the current version controlled?
10. How is implementation demonstrated?
11. What evidence will determine effectiveness?
12. Is there a baseline or suitable comparator where appropriate?
13. How are confounding and other explanations considered?
14. What happens if the measure is ineffective?
15. When will the intervention be reassessed?

These questions provide a practical test of whether the educational programme is connected to the risk it is intended to control.

Key Takeaways

Educational materials are additional risk-minimisation interventions, not simply additional product information. Their design should begin with an important residual risk and proceed through a defined objective, required behaviour, target audience and intervention.

The material must remain scientifically accurate and aligned with authorised product information while adding the targeted content needed to support the risk-minimisation objective. EU-level and national regulatory requirements must be distinguished, particularly for Member State implementation.

Implementation and effectiveness are separate concepts. Distribution can demonstrate delivery, but it cannot by itself demonstrate that the audience understood the message, changed behaviour or that the clinical risk was reduced.

A mature educational programme therefore has a prospective evaluation strategy, controlled versioning, traceable implementation, appropriate effectiveness indicators and a defined mechanism for adaptation when evidence shows that the intervention is inadequate or no longer proportionate.

References

1. European Medicines Agency. Good Pharmacovigilance Practices (GVP), Module XVI — Risk minimisation measures, Revision 3.
2. European Medicines Agency. GVP Module XVI Addendum II — Methods for evaluating effectiveness of risk minimisation measures.
3. European Medicines Agency. GVP Module XVI Addendum I — Risk minimisation measures for medicinal products with embryo-fetal risks.
4. European Medicines Agency. GVP Module V — Risk management systems.
5. Regulation (EC) No 726/2004, as amended.
6. Directive 2001/83/EC, as amended.
7. Commission Implementing Regulation (EU) No 520/2012, as amended.

Regulatory Note

This article distinguishes binding EU legal requirements, GVP guidance, regulatory procedures and recommended operational practice. The current applicable GVP Module XVI and relevant national competent-authority requirements should be verified when implementing an educational risk-minimisation measure for a specific medicinal product.

Inspection scenarios in this article are illustrative and are not presented as documented regulatory findings.