Educational Materials in Pharmacovigilance

Introduction

Educational materials are the most frequently used additional risk minimisation measures within the European Union. They supplement routine product information by providing targeted safety information to healthcare professionals, patients or caregivers when routine measures alone are unlikely to adequately minimise an important safety concern.

Unlike promotional or training materials, educational materials developed under GVP Module XVI are regulatory tools designed to improve the safe and appropriate use of medicinal products. They form part of the Risk Management Plan and should be scientifically justified, proportionate to the identified risk and supported by appropriate methods for evaluating their effectiveness.

This article explains the regulatory framework, development process, implementation, governance and evaluation of educational materials used in pharmacovigilance.

Learning Objectives

After reading this article you should be able to:

• explain the purpose of educational materials;
• distinguish educational materials from routine product information;
• identify situations in which educational materials are appropriate;
• understand the lifecycle of educational materials;
• describe regulatory expectations;
• understand methods used to evaluate effectiveness;
• recognise common implementation challenges;
• prepare for pharmacovigilance inspections relating to educational materials.

History and Evolution of Educational Materials

Educational materials evolved from the recognition that routine product information is not always sufficient to ensure the safe and appropriate use of medicinal products. Although the Summary of Product Characteristics (SmPC), Package Leaflet (PL) and product labelling communicate essential safety information, experience from pharmacovigilance activities demonstrated that certain important risks require additional communication directed towards specific healthcare professionals, patients or caregivers.

The increasing use of Risk Management Plans within the European Union led to a more structured approach to risk minimisation. As regulatory expectations developed, educational materials became recognised as one of the principal additional risk minimisation measures available to Marketing Authorisation Holders.

Today, educational materials are integrated within the broader Risk Management System described in GVP Module V and are implemented according to the principles outlined in GVP Module XVI. Their role is no longer limited to providing information but extends to supporting measurable improvements in the safe use of medicinal products.

Regulatory Framework

Educational materials are developed within the European pharmacovigilance framework governing risk management and additional risk minimisation measures.

Their use is supported by legislation and regulatory guidance including:

• Directive 2001/83/EC, as amended;
• Regulation (EC) No 726/2004, as amended;
• Commission Implementing Regulation (EU) No 520/2012;
• Good Pharmacovigilance Practices (GVP) Module V – Risk Management Systems;
• Good Pharmacovigilance Practices (GVP) Module XVI – Risk Minimisation Measures: Selection of Tools and Effectiveness Indicators.

These documents establish the legal and scientific framework within which educational materials are developed, implemented, maintained and evaluated.

Relationship with GVP Module XVI

Educational materials represent one category of additional risk minimisation measure described in GVP Module XVI.

Module XVI does not require educational materials for every medicinal product. Instead, it requires Marketing Authorisation Holders to determine whether routine risk minimisation measures are sufficient to manage important safety concerns. Educational materials should only be introduced when additional communication is expected to improve the safe and appropriate use of the medicinal product.

The selection of educational materials should therefore be based upon:

• the characteristics of the identified safety concern;
• the intended audience;
• the behaviour requiring modification;
• the expected public health benefit;
• the feasibility of implementation;
• predefined methods for evaluating effectiveness.

Educational materials should always form part of a broader risk minimisation strategy rather than functioning as isolated interventions.

Objectives of Educational Materials

Educational materials are intended to support the safe and appropriate use of medicinal products by providing targeted information that complements routine product information.

Depending upon the identified safety concern, educational materials may seek to:

• improve awareness of important risks;
• reinforce key prescribing recommendations;
• promote appropriate patient selection;
• support required monitoring activities;
• reduce medication errors;
• encourage timely recognition of serious adverse reactions;
• improve patient understanding of treatment-related risks.

The objective should always be clearly defined before educational materials are developed, as it provides the basis for evaluating their effectiveness following implementation.

Educational Materials Within the Risk Management Plan

Educational materials should not be developed independently of the Risk Management Plan.

Instead, they should be linked directly to the important identified risks, important potential risks or, where appropriate, missing information that they are intended to address.

The Risk Management Plan should describe:

• the scientific rationale for the educational materials;
• the intended audience;
• the proposed implementation strategy;
• methods for distribution;
• planned effectiveness evaluation;
• criteria for future review.

This integration ensures that educational materials remain aligned with the overall Risk Management System and continue to evolve as new pharmacovigilance knowledge becomes available.

Scientific Foundation

Educational materials are structured additional risk minimisation measures developed within the European pharmacovigilance framework to address important safety concerns that cannot be managed adequately through routine product information alone. Their selection should be scientifically justified, integrated within the Risk Management Plan and supported by objective methods for evaluating their contribution to the safe and appropriate use of medicinal products.

When Are Educational Materials Required?

Educational materials should only be introduced when routine risk minimisation measures are unlikely to adequately support the safe and appropriate use of a medicinal product. They are not intended to accompany every authorised medicine and should not be regarded as standard pharmacovigilance documentation.

The decision to develop educational materials should be based upon a structured assessment of the identified safety concern, the characteristics of the medicinal product and the likelihood that additional communication will improve clinical practice or patient behaviour.

Accordingly, educational materials should represent a scientifically justified intervention designed to address clearly defined risk minimisation objectives.

Routine Measures Should Always Be Considered First

Before proposing educational materials, Marketing Authorisation Holders should determine whether routine risk minimisation measures can adequately address the identified safety concern.

Routine measures include:

• the Summary of Product Characteristics (SmPC);
• the Package Leaflet (PL);
• product labelling;
• legal classification of the medicinal product;
• routine clinical practice.

Only when these measures are considered insufficient should educational materials be proposed as an additional risk minimisation measure.

This approach reflects the principle of proportionality described throughout GVP Module XVI.

Educational Materials Should Address a Defined Safety Concern

Educational materials should always be linked to one or more important safety concerns identified within the Risk Management Plan.

Examples include:

• important identified risks;
• important potential risks;
• situations requiring specialised monitoring;
• preventable medication errors;
• complex prescribing requirements;
• clinically significant contraindications;
• serious adverse reactions requiring early recognition.

The purpose of the educational material should be directly related to reducing the likelihood or severity of the identified risk.

Educational Materials Should Support Behavioural Change

The objective of educational materials is not simply to provide additional information.

Instead, they should encourage specific behaviours that improve patient safety.

Examples include:

• selecting appropriate patients for treatment;
• performing recommended laboratory monitoring;
• recognising early symptoms of serious adverse reactions;
• following specific prescribing restrictions;
• counselling patients consistently;
• responding promptly to safety concerns.

Educational materials should therefore be designed with a clearly defined behavioural objective rather than a general educational purpose.

Identifying the Appropriate Audience

Educational materials should only be provided to individuals capable of influencing the identified safety concern.

Depending upon the medicinal product, the target audience may include:

• specialist physicians;
• general practitioners;
• pharmacists;
• nurses;
• patients;
• caregivers.

Different audiences require different communication strategies, levels of technical detail and presentation formats.

The content should therefore be tailored to the knowledge, responsibilities and decision-making role of the intended recipients.

Scientific Justification

Marketing Authorisation Holders should be able to explain why educational materials are expected to reduce the identified risk.

The scientific justification may be supported by:

• clinical trial evidence;
• spontaneous adverse reaction reports;
• signal evaluations;
• pharmacoepidemiological studies;
• published scientific literature;
• post-authorisation safety studies;
• previous experience with comparable medicinal products.

The rationale should demonstrate a logical relationship between the identified safety concern, the proposed educational intervention and the anticipated improvement in the safe use of the medicinal product.

Considering Practical Implementation

Educational materials should also be practical to implement within routine healthcare.

Before introducing educational materials, organisations should consider:

• how the materials will be distributed;
• whether the intended audience can realistically access them;
• how updates will be communicated;
• how implementation will be monitored;
• how effectiveness will be evaluated.

Educational materials that cannot be implemented consistently are unlikely to achieve meaningful improvements in patient safety.

Avoiding Unnecessary Educational Materials

Providing more educational materials does not necessarily improve risk minimisation.

Unnecessary or excessive documentation may:

• reduce engagement by healthcare professionals;
• overwhelm patients with information;
• duplicate routine product information;
• increase administrative burden;
• reduce the visibility of genuinely important safety messages.

Educational materials should therefore remain focused, proportionate and directly relevant to the identified safety concern.

Educational Materials Should Be Planned as Lifecycle Interventions

The decision to develop educational materials should include planning for their future maintenance.

Marketing Authorisation Holders should determine:

• when the materials will be reviewed;
• circumstances requiring revision;
• methods for evaluating effectiveness;
• criteria for discontinuation if no longer required.

Educational materials should evolve alongside the medicinal product and the associated Risk Management Plan throughout the product lifecycle.

Scientific Foundation

Educational materials should be developed only when routine risk minimisation measures are insufficient to manage important safety concerns. Their selection should be supported by scientific evidence, directed towards clearly defined behavioural objectives, targeted to the appropriate audience and integrated within the lifecycle of the Risk Management Plan. Appropriate use of educational materials reflects the principles of proportionality, scientific justification and continuous improvement described in GVP Module XVI.

Developing Educational Materials

Developing educational materials is a multidisciplinary process requiring collaboration between pharmacovigilance, regulatory affairs, medical affairs, medical writing, quality assurance, commercial functions where appropriate and external stakeholders. The objective is to develop scientifically accurate, practical and understandable materials that contribute to meaningful improvements in the safe use of medicinal products.

Educational materials should not be developed solely because a regulatory authority requests additional risk minimisation measures. Instead, every document should be designed to address a clearly defined safety concern, promote a specific behavioural objective and support the overall Risk Management Plan.

Development should follow a structured lifecycle that begins with identifying the need for additional communication and continues throughout the medicinal product lifecycle.

Step 1 – Define the Safety Concern

Development should always begin by defining the specific safety concern that requires additional communication.

This should include:

• the important identified or potential risk;
• the underlying clinical mechanism;
• the patients affected;
• the preventability of the risk;
• the behaviour contributing to the risk;
• the anticipated public health impact.

A clear understanding of the safety concern ensures that educational materials remain focused and proportionate.

Step 2 – Define the Objectives

Educational materials should have clearly defined and measurable objectives.

Examples include:

• improving patient selection;
• reducing contraindicated prescribing;
• increasing compliance with laboratory monitoring;
• improving recognition of serious adverse reactions;
• reducing medication errors;
• improving patient understanding of treatment risks.

Objectives should describe the desired behavioural outcome rather than simply the information to be communicated.

Step 3 – Identify the Target Audience

Different audiences require different educational approaches.

Development should identify:

• primary users;
• secondary users;
• healthcare settings;
• expected clinical knowledge;
• literacy requirements;
• language requirements.

Separate educational materials may be required for healthcare professionals, pharmacists, nurses, patients and caregivers to ensure that information is appropriate for each audience.

Step 4 – Develop the Scientific Content

Scientific content should be based upon current evidence and remain consistent with approved regulatory documents.

Sources commonly include:

• the Summary of Product Characteristics;
• the Risk Management Plan;
• clinical study reports;
• safety specifications;
• regulatory assessment reports;
• published scientific literature;
• pharmacovigilance data.

The content should communicate only the information necessary to achieve the defined risk minimisation objectives while avoiding unnecessary duplication of routine product information.

Step 5 – Apply Medical Writing Principles

Educational materials should communicate complex scientific information accurately while remaining understandable to the intended audience.

Medical writing should therefore prioritise:

• accuracy;
• clarity;
• consistency;
• logical organisation;
• concise language;
• practical recommendations;
• avoidance of ambiguity.

Information should be organised according to clinical workflows so that important safety messages are identified rapidly during routine healthcare practice.

Step 6 – Design for Readability and Usability

The effectiveness of educational materials depends not only upon scientific accuracy but also upon usability.

Design considerations include:

• clear headings;
• logical structure;
• readable typography;
• appropriate use of colour and graphics;
• sufficient white space;
• accessible language;
• consistent terminology.

Materials intended for patients should consider health literacy and avoid unnecessary medical terminology wherever possible.

Step 7 – Review and Approval

Educational materials should undergo multidisciplinary review before implementation.

Review commonly involves:

• pharmacovigilance;
• medical affairs;
• regulatory affairs;
• quality assurance;
• medical writing;
• legal review where appropriate.

The review process should verify that the materials:

• accurately reflect approved product information;
• support the objectives of the Risk Management Plan;
• remain scientifically accurate;
• comply with applicable regulatory requirements.

Step 8 – Version Control

Educational materials are controlled regulatory documents and should be managed accordingly.

Document control should include:

• unique document identifiers;
• version numbers;
• approval dates;
• effective dates;
• review schedules;
• document owners;
• change histories.

Effective document control ensures that healthcare professionals and patients receive current and approved information.

Step 9 – Translation and Localisation

Educational materials distributed across multiple countries may require translation and adaptation.

Translation should preserve:

• scientific accuracy;
• regulatory consistency;
• intended meaning;
• approved terminology;
• readability.

Local adaptation should consider national regulatory requirements, healthcare systems and cultural factors without compromising the scientific integrity of the educational content.

Step 10 – Lifecycle Maintenance

Educational materials should undergo periodic review throughout the medicinal product lifecycle.

Review may be required following:

• updates to the Summary of Product Characteristics;
• important safety signals;
• regulatory recommendations;
• revisions to the Risk Management Plan;
• effectiveness evaluation findings;
• inspection observations;
• new scientific evidence.

Lifecycle maintenance ensures that educational materials remain scientifically accurate, operationally relevant and aligned with current regulatory expectations.

Educational Materials as Living Documents

Experienced pharmacovigilance professionals recognise that educational materials are not static publications. They evolve alongside the medicinal product, reflecting new scientific evidence, changes in clinical practice and refinements to the overall risk minimisation strategy.

Development should therefore be viewed as the beginning of a continuous improvement cycle rather than the completion of a regulatory deliverable.

Scientific Foundation

The development of educational materials should follow a structured lifecycle beginning with a clearly defined safety concern and continuing through objective setting, audience analysis, scientific content development, multidisciplinary review, implementation and ongoing maintenance. Applying this lifecycle approach ensures that educational materials remain scientifically accurate, proportionate to the identified risks and capable of supporting effective risk minimisation throughout the medicinal product lifecycle.

Design Principles for Educational Materials

The scientific accuracy of educational materials is essential but does not, by itself, ensure that they will improve patient safety. Educational materials must also be understandable, accessible and capable of influencing behaviour within routine healthcare practice.

An effective educational document is therefore one that enables the intended audience to identify, understand and apply important safety information correctly when making clinical decisions or managing treatment.

For this reason, the design of educational materials should incorporate principles from medical communication, health literacy, adult learning, behavioural science and human factors engineering.

Begin With the Desired Behaviour

Educational materials should be designed around the behaviour they are intended to influence rather than the information they contain.

For every educational document, organisations should identify:

• the behaviour contributing to the identified risk;
• the behaviour that should replace it;
• the information required to support that change;
• potential barriers to implementation.

This behavioural focus helps ensure that educational materials remain practical and relevant to clinical practice.

Apply Plain Language Principles

Educational materials should communicate complex scientific information using language appropriate for the intended audience.

Good practice includes:

• short sentences;
• familiar terminology where possible;
• active voice;
• consistent vocabulary;
• clear instructions;
• avoidance of unnecessary abbreviations.

Technical terminology should be retained when required for scientific accuracy but should be explained clearly when the audience includes patients or caregivers.

Support Health Literacy

Health literacy influences a person's ability to obtain, understand and apply health information.

Educational materials intended for patients should therefore:

• explain medical concepts clearly;
• avoid unnecessary jargon;
• present one concept at a time;
• reinforce key messages;
• use practical examples where appropriate;
• encourage discussion with healthcare professionals.

Materials that exceed the health literacy of the intended audience are unlikely to achieve meaningful behavioural change.

Organise Information Logically

Healthcare professionals and patients often consult educational materials while making time-sensitive decisions.

Information should therefore be organised so that critical safety messages are immediately visible.

A logical structure commonly includes:

• purpose of the document;
• important safety concern;
• actions required;
• monitoring recommendations;
• situations requiring urgent medical review;
• reporting requirements;
• additional sources of information.

Important messages should not be hidden within lengthy paragraphs or excessive background information.

Reduce Cognitive Load

Individuals have limited capacity to process new information, particularly during busy clinical practice or stressful situations.

Educational materials should therefore minimise unnecessary cognitive load by:

• focusing on essential information;
• avoiding repetition;
• grouping related concepts;
• using informative headings;
• presenting information in manageable sections.

Reducing cognitive load improves comprehension and facilitates appropriate decision-making.

Use Visual Design to Support Understanding

Visual presentation should improve comprehension rather than decorate the document.

Useful design techniques include:

• descriptive headings;
• bullet lists;
• summary tables;
• flow diagrams;
• warning boxes;
• consistent typography;
• adequate white space.

Visual elements should emphasise important safety information without distracting from the primary educational objectives.

Maintain Consistency

Educational materials should remain consistent with:

• the Summary of Product Characteristics;
• the Package Leaflet;
• the Risk Management Plan;
• approved regulatory wording;
• other educational materials developed for the same medicinal product.

Inconsistencies may create confusion among healthcare professionals and patients and reduce confidence in the overall risk minimisation programme.

Design for Practical Clinical Use

Educational materials should integrate naturally into routine healthcare workflows.

Healthcare professionals should be able to locate relevant information quickly during:

• prescribing;
• dispensing;
• patient counselling;
• medicine administration;
• clinical review.

Documents requiring extensive reading before identifying key safety messages are less likely to influence routine practice.

Consider Digital Delivery

Educational materials are increasingly delivered electronically through websites, mobile applications, electronic prescribing systems and patient portals.

Digital formats offer several advantages, including:

• rapid updates;
• wider distribution;
• interactive content;
• multimedia learning;
• integration with clinical systems.

However, digital delivery should preserve scientific accuracy, accessibility and version control while ensuring that all intended users can access the information.

Validate Before Widespread Implementation

Educational materials should be evaluated before large-scale implementation whenever feasible.

Validation activities may include:

• expert review;
• readability assessment;
• user testing;
• pilot implementation;
• healthcare professional feedback;
• patient feedback.

Early evaluation enables organisations to identify potential misunderstandings before the materials become part of routine clinical practice.

Good Design Improves Patient Safety

The quality of educational materials should be judged not by their appearance or length but by their ability to improve clinical decision-making and reduce preventable harm.

Well-designed educational materials communicate the right information, to the right audience, at the right time, using language and presentation that support safe and appropriate use of medicinal products.

Scientific Foundation

Effective educational materials combine scientific accuracy with evidence-based communication principles. By applying concepts from health literacy, behavioural science, adult learning and human factors engineering, Marketing Authorisation Holders can develop educational materials that are understandable, practical and capable of supporting measurable improvements in patient safety.

Implementation, Distribution and Lifecycle Management

Development of educational materials represents only the beginning of the risk minimisation process. Their contribution to patient safety depends upon effective implementation, appropriate distribution, ongoing governance and periodic review throughout the medicinal product lifecycle.

Educational materials should therefore be managed as controlled regulatory documents that form part of the overall Risk Management System. Every stage, from approval through retirement, should be planned, documented and subject to appropriate quality oversight.

Regulatory Approval

Educational materials should undergo formal review and approval before implementation.

The approval process commonly includes representatives from:

• Pharmacovigilance;
• Regulatory Affairs;
• Medical Affairs;
• Medical Writing;
• Quality Assurance;
• Legal functions where appropriate.

Approval should confirm that the materials:

• are scientifically accurate;
• are consistent with the approved Summary of Product Characteristics;
• support the objectives of the Risk Management Plan;
• comply with applicable regulatory requirements;
• remain appropriate for the intended audience.

Only approved versions should be distributed.

Distribution Strategy

An effective educational document has little value if it does not reach the intended audience.

Distribution planning should therefore define:

• the target audience;
• distribution channels;
• timing of distribution;
• responsibilities;
• documentation requirements;
• methods for confirming successful implementation.

Distribution should occur before or at the point where important clinical decisions are made.

Distribution Channels

Educational materials may be distributed through one or more mechanisms depending upon the medicinal product and healthcare system.

Examples include:

• direct distribution to healthcare professionals;
• distribution through wholesalers;
• community pharmacies;
• hospital pharmacies;
• specialist centres;
• electronic prescribing systems;
• company medical information websites;
• regulatory authority websites;
• patient support programmes.

Selection of distribution channels should maximise accessibility while maintaining appropriate document control.

Printed and Digital Educational Materials

Educational materials may be produced in printed, electronic or hybrid formats.

Printed materials offer:

• immediate availability;
• ease of use during consultations;
• independence from electronic systems.

Digital materials offer:

• rapid updates;
• improved accessibility;
• interactive content;
• multimedia support;
• integration with clinical software;
• usage analytics.

Many organisations now adopt hybrid approaches that combine printed and electronic resources according to user needs.

Version Control

Educational materials should be managed using formal document control procedures.

Each document should include:

• document title;
• unique document identifier;
• version number;
• approval date;
• effective date;
• review date;
• document owner.

Version control prevents obsolete educational materials from remaining in circulation after important safety information has changed.

Change Management

Educational materials should be revised whenever significant changes affect their scientific accuracy or regulatory status.

Common triggers include:

• updates to the Summary of Product Characteristics;
• important safety signals;
• changes to important identified risks;
• revisions to the Risk Management Plan;
• new regulatory recommendations;
• inspection findings;
• effectiveness evaluation results.

All revisions should follow the organisation's document control and change management procedures.

Periodic Review

Educational materials should undergo scheduled review even when no major safety concerns have emerged.

Periodic review should evaluate whether:

• the scientific content remains current;
• regulatory references remain accurate;
• implementation continues as planned;
• the intended audience remains appropriate;
• effectiveness objectives continue to be achieved.

Routine review reduces the likelihood that outdated educational materials remain in use.

Retirement of Educational Materials

Educational materials should be formally withdrawn when they are no longer required.

Reasons for retirement may include:

• removal of the associated safety concern;
• changes in the benefit-risk profile;
• replacement by alternative risk minimisation measures;
• product discontinuation;
• withdrawal of the marketing authorisation.

Retirement should be documented and obsolete versions should be removed from distribution channels wherever possible.

Governance Throughout the Lifecycle

Educational materials should remain subject to ongoing governance throughout their lifecycle.

Marketing Authorisation Holders should clearly define:

• document ownership;
• review responsibilities;
• approval authorities;
• distribution responsibilities;
• effectiveness evaluation responsibilities;
• archiving requirements.

Defined governance promotes consistency, accountability and regulatory compliance.

Educational Materials as Controlled Regulatory Documents

Experienced pharmacovigilance organisations manage educational materials using the same disciplined lifecycle approach applied to other regulated documents.

From initial development through implementation, revision and retirement, every stage should be documented, scientifically justified and integrated within the broader pharmacovigilance quality system.

Effective governance ensures that educational materials continue to support meaningful risk minimisation throughout the lifecycle of the medicinal product.

Scientific Foundation

Educational materials require structured lifecycle management to ensure that they remain scientifically accurate, appropriately distributed and aligned with the evolving Risk Management Plan. Formal governance, document control, version management, periodic review and evidence-based revision support the continued effectiveness of educational materials as additional risk minimisation measures within the European pharmacovigilance system.

Evaluating the Effectiveness of Educational Materials

The implementation of educational materials does not, by itself, demonstrate successful risk minimisation. Their effectiveness depends upon whether they achieve their intended objective of improving the safe and appropriate use of medicinal products.

Consequently, GVP Module XVI requires Marketing Authorisation Holders to evaluate educational materials using scientifically appropriate methods capable of demonstrating whether the intervention has influenced knowledge, behaviour or clinical outcomes.

Effectiveness evaluation should therefore be regarded as an integral component of the educational material lifecycle rather than an activity performed only to satisfy regulatory requirements.

Why Effectiveness Evaluation Is Necessary

Educational materials consume significant organisational resources and impose additional responsibilities upon healthcare professionals and patients.

Accordingly, organisations should be able to demonstrate that the educational intervention provides measurable public health benefit.

Evaluation should answer questions such as:

• Did the intended audience receive the educational materials?
• Was the information understood?
• Did prescribing or patient behaviour change?
• Was the identified safety concern reduced?
• Should the educational materials be modified or withdrawn?

These questions cannot be answered through document distribution records alone.

Define Success Before Distribution

Evaluation should begin during the planning phase.

Before educational materials are implemented, organisations should define:

• the identified safety concern;
• the purpose of the educational materials;
• the intended audience;
• the expected behavioural change;
• the evaluation methodology;
• predefined success criteria;
• timelines for review.

Clearly defined objectives provide the foundation for meaningful effectiveness evaluation.

Process Indicators

Process indicators evaluate whether educational materials have been implemented as planned.

Typical process indicators include:

• number of educational materials distributed;
• proportion of target healthcare professionals reached;
• patient receipt of educational materials;
• completion of educational programmes;
• website downloads;
• electronic access statistics;
• attendance at educational meetings.

These indicators demonstrate implementation but do not establish that patient safety has improved.

Outcome Indicators

Outcome indicators evaluate whether educational materials have influenced behaviour or clinical outcomes.

Examples include:

• improved prescribing practices;
• increased compliance with monitoring recommendations;
• improved patient adherence;
• earlier recognition of adverse reactions;
• reduction in medication errors;
• reduction in contraindicated prescribing;
• reduction in preventable adverse reactions.

Outcome indicators generally provide stronger evidence of effectiveness because they evaluate the consequences of the educational intervention rather than its implementation.

Knowledge Assessment

Knowledge surveys are commonly used to determine whether educational materials have improved understanding among healthcare professionals or patients.

Surveys may evaluate:

• awareness of important risks;
• understanding of contraindications;
• recognition of adverse reactions;
• knowledge of monitoring requirements;
• understanding of counselling recommendations.

Knowledge alone does not demonstrate behavioural change but may provide useful supporting evidence.

Behavioural Assessment

Many educational materials are intended to modify clinical behaviour.

Behavioural assessment may therefore evaluate:

• prescribing decisions;
• laboratory monitoring practices;
• patient counselling;
• dispensing procedures;
• use of clinical checklists;
• compliance with pregnancy prevention requirements.

Behavioural measures often provide more meaningful evidence of effectiveness than knowledge assessments alone.

Clinical Outcome Assessment

Where appropriate, organisations should evaluate whether educational materials contribute to measurable improvements in patient safety.

Potential clinical outcomes include:

• reduced incidence of preventable adverse reactions;
• reduced pregnancy exposure;
• earlier diagnosis of important adverse reactions;
• reduced medication errors;
• improved benefit-risk balance.

Clinical outcomes should be interpreted carefully because multiple factors may influence observed changes.

Sources of Evaluation Data

Evaluation may utilise multiple complementary sources.

Examples include:

• spontaneous adverse reaction reports;
• post-authorisation safety studies;
• drug utilisation studies;
• patient registries;
• electronic healthcare databases;
• prescribing databases;
• surveys;
• medical record reviews;
• published scientific literature.

Combining multiple data sources generally provides stronger evidence than reliance upon a single methodology.

Interpreting Evaluation Results

Evaluation findings should be interpreted within the wider pharmacovigilance context.

Organisations should consider:

• changes in prescribing practice;
• changes in clinical guidelines;
• increased awareness following regulatory action;
• media attention;
• changes in disease epidemiology;
• healthcare system differences.

Observed improvements should not automatically be attributed solely to educational materials without appropriate scientific justification.

Using Evaluation Findings

Evaluation results should support continuous improvement of educational materials.

Depending upon the findings, organisations may decide to:

• retain existing materials;
• revise the content;
• modify distribution strategies;
• simplify communication;
• strengthen educational interventions;
• introduce additional risk minimisation measures;
• discontinue educational materials that no longer provide meaningful benefit.

The objective is continual optimisation rather than permanent maintenance of existing documents.

Common Pitfalls

Effectiveness evaluations frequently encounter methodological limitations.

Common pitfalls include:

• measuring distribution rather than behaviour;
• relying solely on knowledge surveys;
• poorly defined success criteria;
• inadequate baseline measurements;
• insufficient follow-up;
• failure to account for confounding factors;
• overinterpretation of limited data.

Recognising these limitations strengthens both study design and interpretation of results.

Continuous Improvement

Educational materials should evolve in response to new evidence.

Effectiveness evaluations should inform:

• updates to educational content;
• revisions to the Risk Management Plan;
• improvements in distribution strategies;
• changes to evaluation methodologies;
• future risk minimisation activities.

Continuous evaluation supports the long-term effectiveness of educational materials and contributes to maintaining a favourable benefit-risk balance.

Scientific Foundation

Educational materials should be evaluated using objective, scientifically appropriate methods capable of determining whether they influence knowledge, behaviour and clinical outcomes. Combining process indicators, outcome indicators and multiple sources of pharmacovigilance evidence enables Marketing Authorisation Holders to optimise educational materials throughout the medicinal product lifecycle while supporting effective risk minimisation and improved patient safety.

Common Challenges

Developing scientifically accurate educational materials is only one component of an effective risk minimisation programme. Organisations frequently encounter practical, operational and behavioural challenges that influence whether educational materials ultimately contribute to improved patient safety.

These challenges may arise during development, regulatory review, distribution, implementation, effectiveness evaluation or lifecycle management. Recognising potential obstacles early enables Marketing Authorisation Holders to develop more robust educational programmes and implement appropriate corrective actions when deficiencies are identified.

Reaching the Intended Audience

Educational materials can only influence behaviour if they reach the individuals responsible for reducing the identified risk.

Challenges may include:

• incomplete distribution lists;
• changes in prescribing practices;
• staff turnover;
• inconsistent distribution across healthcare settings;
• limited awareness of available materials.

Organisations should establish mechanisms to maximise distribution while periodically confirming that educational materials continue to reach the intended audience.

Maintaining Scientific Accuracy

Medicinal product safety information evolves continuously throughout the product lifecycle.

Educational materials may become outdated following:

• important safety signals;
• updates to the Summary of Product Characteristics;
• changes to contraindications;
• revised monitoring recommendations;
• new regulatory requirements.

Failure to update educational materials promptly may reduce their effectiveness and increase the risk of inconsistent clinical practice.

Encouraging Behavioural Change

Knowledge alone does not necessarily alter clinical behaviour.

Healthcare professionals may:

• rely upon previous clinical experience;
• overlook educational materials during busy practice;
• interpret recommendations differently;
• prioritise competing clinical demands.

Similarly, patients may understand important safety messages but fail to follow recommended precautions because of misunderstanding, treatment burden or personal circumstances.

Educational materials should therefore support practical decision-making rather than simply communicating additional information.

Maintaining Consistency Across Countries

Many educational programmes support products authorised in multiple countries.

International implementation introduces additional challenges including:

• language translation;
• differing healthcare systems;
• national regulatory requirements;
• local clinical practice;
• cultural expectations;
• varying distribution channels.

While local adaptation may be necessary, the underlying scientific messages should remain consistent across jurisdictions.

Measuring Real Impact

One of the greatest challenges is demonstrating that educational materials have improved patient safety rather than simply documenting their distribution.

Organisations should distinguish between:

• successful implementation;
• increased knowledge;
• behavioural change;
• measurable improvements in clinical outcomes.

Evaluation strategies should therefore combine multiple complementary methods capable of demonstrating meaningful effectiveness.

Maintaining Long-Term Engagement

Educational materials often remain in use for many years.

Maintaining engagement over extended periods may become difficult because:

• familiarity reduces attention;
• new healthcare professionals enter clinical practice;
• treatment guidelines evolve;
• competing educational initiatives emerge.

Periodic review and appropriate updating help maintain the relevance and visibility of educational materials.

Integrating Educational Materials Within the Pharmacovigilance System

Educational materials should not operate independently of other pharmacovigilance activities.

They should remain aligned with:

• the Risk Management Plan;
• signal management;
• benefit-risk evaluation;
• post-authorisation safety studies;
• safety communications;
• aggregate reporting;
• inspection findings.

Integration supports consistency throughout the pharmacovigilance system and facilitates coordinated responses when new safety information becomes available.

Learning From Experience

Every effectiveness evaluation, inspection, regulatory assessment and safety review provides opportunities to improve future educational materials.

Experienced organisations routinely incorporate lessons learned into:

• document design;
• implementation strategies;
• evaluation methodologies;
• governance processes;
• communication approaches.

Continuous organisational learning strengthens future risk minimisation programmes and supports the long-term protection of public health.

Scientific Foundation

Educational materials operate within complex healthcare systems where scientific accuracy alone is insufficient to ensure successful risk minimisation. Addressing challenges relating to implementation, behavioural change, governance and continuous improvement enables Marketing Authorisation Holders to maximise the effectiveness of educational materials while supporting the safe and appropriate use of medicinal products throughout their lifecycle.

Inspection Perspective

Educational materials frequently form part of pharmacovigilance inspections because they represent regulated additional risk minimisation measures intended to protect public health. Inspectors assess not only the educational materials themselves but also the systems used to justify, develop, approve, distribute, maintain and evaluate them throughout the medicinal product lifecycle.

The objective of an inspection is not to determine whether attractive educational materials have been produced. Instead, inspectors seek evidence that the materials form part of a scientifically justified, well-governed and effective risk minimisation programme capable of reducing important product-related risks.

Accordingly, educational materials should be viewed as components of the wider pharmacovigilance system rather than isolated documents.

Inspection Objectives

When reviewing educational materials, inspectors generally seek to determine whether the Marketing Authorisation Holder has:

• identified an important safety concern requiring additional communication;
• justified the use of educational materials within the Risk Management Plan;
• developed scientifically accurate and consistent content;
• implemented the approved educational programme appropriately;
• established suitable governance and document control;
• evaluated effectiveness using appropriate methodologies;
• maintained the educational materials throughout the product lifecycle.

The inspection therefore considers the complete lifecycle of the educational materials rather than their content alone.

Documentation Commonly Reviewed

Inspectors may review documentation demonstrating both the development and operational management of educational materials.

Examples include:

• Risk Management Plans;
• educational material master files;
• document approval records;
• version histories;
• change control records;
• implementation plans;
• distribution records;
• translation records;
• effectiveness evaluation protocols;
• survey reports;
• audit reports;
• CAPA records.

Collectively, these documents demonstrate whether educational materials are managed using an appropriate quality system.

Scientific Justification

Inspectors frequently examine the scientific rationale supporting the educational materials.

Typical questions include:

• Why were educational materials considered necessary?
• Which important safety concern do they address?
• Why were routine risk minimisation measures considered insufficient?
• What evidence supports the proposed intervention?
• How were the educational objectives defined?

A clear scientific rationale demonstrates that educational materials have been selected using a structured risk management approach rather than organisational preference.

Consistency With Approved Product Information

Educational materials should remain fully consistent with approved regulatory documents.

Inspectors commonly verify alignment with:

• the Summary of Product Characteristics;
• the Package Leaflet;
• the Risk Management Plan;
• regulatory assessment reports;
• approved safety communications.

Any inconsistencies may result in confusion among healthcare professionals or patients and may indicate weaknesses in document governance.

Governance and Document Control

Educational materials should be managed using formal document control procedures.

Inspectors commonly evaluate whether organisations have established:

• document ownership;
• approval procedures;
• version control;
• periodic review schedules;
• change management processes;
• archival procedures;
• responsibilities for lifecycle management.

Strong governance demonstrates that educational materials remain accurate and current throughout the product lifecycle.

Implementation and Distribution

Implementation is another important area of inspection.

Inspectors may review whether:

• educational materials reached the intended audience;
• distribution occurred according to approved plans;
• implementation records are complete;
• revised versions replaced obsolete documents;
• distribution strategies remain effective over time.

Evidence of implementation should extend beyond the existence of the educational materials themselves.

Effectiveness Evaluation

One of the principal expectations under GVP Module XVI is that educational materials should demonstrate measurable effectiveness.

Inspectors may therefore review:

• evaluation protocols;
• predefined objectives;
• process indicators;
• outcome indicators;
• survey methodologies;
• statistical analyses;
• interpretation of findings;
• resulting programme modifications.

The absence of meaningful effectiveness evaluation may indicate that the organisation cannot demonstrate whether the educational materials contribute to safer use of the medicinal product.

Common Inspection Findings

Educational materials may become the subject of inspection observations where deficiencies are identified.

Examples include:

• inadequate scientific justification;
• inconsistent educational content;
• outdated documents remaining in circulation;
• inadequate document control;
• poor implementation records;
• ineffective distribution strategies;
• absence of effectiveness evaluation;
• failure to revise educational materials following important safety information.

Many of these deficiencies reflect weaknesses in governance rather than deficiencies within the educational materials themselves.

Inspection Readiness

Inspection readiness should be maintained continuously.

Marketing Authorisation Holders should ensure that:

• educational materials remain current;
• documentation is complete;
• responsibilities are clearly defined;
• effectiveness evaluations are performed according to plan;
• changes are documented appropriately;
• lessons learned are incorporated into future revisions.

Maintaining inspection readiness throughout the product lifecycle enables organisations to demonstrate ongoing compliance and continuous improvement.

What Inspectors Ultimately Evaluate

Although inspectors review educational materials, surveys, implementation records and evaluation reports, their overarching objective is to determine whether the organisation has established an effective system for using educational materials to minimise important medicinal product risks.

Ultimately, inspectors seek evidence that educational materials:

• are scientifically justified;
• are appropriately governed;
• reach the intended audience;
• influence clinical practice where appropriate;
• contribute to measurable improvements in patient safety.

The emphasis is therefore placed on demonstrating effectiveness rather than simply demonstrating implementation.

Inspection Insight

During pharmacovigilance inspections, educational materials are evaluated as components of the overall Risk Management System rather than as standalone documents. Organisations should be prepared to demonstrate the complete lifecycle of educational materials, from scientific justification and regulatory approval through implementation, effectiveness evaluation and continuous improvement, using objective evidence that the materials contribute to safer and more appropriate use of medicinal products.

How an Experienced Safety Physician Thinks About Educational Materials

Experienced Safety Physicians do not begin by asking whether educational materials should be developed. They begin by asking why a particular safety concern continues to occur despite existing risk minimisation measures.

Their objective is not to produce documents, satisfy regulatory commitments or increase the volume of information available to healthcare professionals. Instead, they seek to understand the clinical circumstances that give rise to preventable harm and determine whether education is likely to modify those circumstances.

Consequently, educational materials are viewed as clinical interventions intended to influence decision-making rather than as regulatory publications.

They Start With the Clinical Problem

Every educational programme should begin with a clearly defined clinical problem.

Experienced Safety Physicians ask questions such as:

• What adverse outcome are we trying to prevent?
• Why is the adverse outcome occurring?
• Is the risk predictable?
• Is the risk preventable?
• Which healthcare decisions influence the risk?
• Which patients are most vulnerable?

Only after answering these questions do they consider whether educational materials are likely to provide an effective solution.

They Identify the Behaviour That Must Change

Educational materials should support a specific behavioural change.

Examples include:

• selecting appropriate patients;
• recognising contraindications;
• ordering appropriate laboratory tests;
• counselling patients consistently;
• recognising early symptoms of serious adverse reactions;
• responding appropriately to abnormal clinical findings.

Experienced Safety Physicians therefore define behavioural objectives before writing educational content.

If no realistic behavioural change can be identified, educational materials alone are unlikely to improve patient safety.

They Prefer Targeted Communication

More information is not necessarily better information.

Experienced Safety Physicians prefer educational materials that communicate a limited number of clinically important messages rather than attempting to reproduce the entire Summary of Product Characteristics.

Targeted communication:

• improves recall;
• reduces cognitive burden;
• supports rapid clinical decision-making;
• highlights actions that reduce preventable harm.

Every additional page should justify its inclusion by improving clinical practice.

They Integrate Educational Materials Into Routine Care

Educational materials are most effective when they fit naturally into established clinical workflows.

Experienced Safety Physicians therefore consider:

• when prescribing decisions are made;
• when patients receive counselling;
• when monitoring occurs;
• when pharmacists dispense medicines;
• when adverse reactions are most likely to be recognised.

Educational materials should support these clinical activities rather than interrupt them.

They Measure Success Through Patient Outcomes

The success of educational materials is not measured by:

• the number of documents distributed;
• the number of healthcare professionals trained;
• the number of downloads from a website.

Instead, experienced Safety Physicians ask whether the intervention resulted in:

• safer prescribing;
• improved monitoring;
• earlier recognition of adverse reactions;
• fewer preventable medication errors;
• better patient outcomes.

Ultimately, educational materials should contribute to measurable improvements in clinical practice.

They Expect Educational Materials to Evolve

Scientific knowledge changes continuously throughout the lifecycle of a medicinal product.

Experienced Safety Physicians therefore expect educational materials to evolve in response to:

• new safety signals;
• updated clinical evidence;
• regulatory recommendations;
• changes to treatment guidelines;
• effectiveness evaluations;
• inspection findings.

Educational materials should remain dynamic components of the overall risk management strategy rather than static regulatory documents.

They View Educational Materials as Part of a Larger System

Educational materials cannot function effectively in isolation.

Experienced Safety Physicians integrate them with:

• Risk Management Plans;
• signal management;
• safety communications;
• post-authorisation safety studies;
• benefit-risk evaluations;
• healthcare professional training;
• pharmacovigilance governance.

This systems-based approach ensures that educational materials reinforce, rather than duplicate, other pharmacovigilance activities.

They Focus on Clinical Decision-Making

Ultimately, experienced Safety Physicians judge educational materials by a single criterion:

"Will this document help a healthcare professional or patient make a better decision at the moment it matters most?"

If the answer is yes, the educational material has the potential to reduce preventable harm.

If the answer is no, the document should be redesigned regardless of how scientifically accurate or visually appealing it may be.

Professional Reflection

Experienced Safety Physicians regard educational materials as evidence-based clinical interventions that support safer decision-making rather than as regulatory obligations. By focusing on clearly defined behavioural objectives, integrating educational materials into routine healthcare and continually evaluating their impact on patient outcomes, they ensure that educational programmes contribute meaningfully to the maintenance of a favourable benefit-risk balance throughout the medicinal product lifecycle.

How an Experienced QPPV Thinks About Educational Materials

Experienced Qualified Persons Responsible for Pharmacovigilance (QPPVs) view educational materials as one component of an integrated pharmacovigilance system rather than as standalone documents. While Safety Physicians focus on the clinical effectiveness of educational interventions, QPPVs are responsible for ensuring that educational materials are appropriately governed, scientifically justified, effectively implemented and continuously evaluated throughout the medicinal product lifecycle.

From a QPPV perspective, educational materials should demonstrate that the organisation has translated important safety concerns identified within the Risk Management Plan into practical interventions capable of reducing preventable harm.

Educational materials therefore represent evidence of an effective pharmacovigilance system rather than simply evidence of regulatory compliance.

They Begin With the Risk Management Plan

Experienced QPPVs do not ask whether educational materials should be produced.

Instead, they ask:

• Which important safety concern requires additional risk minimisation?
• Why are routine measures insufficient?
• Which behaviour requires modification?
• Which intervention is most likely to achieve that objective?

Educational materials are selected only when they represent the most appropriate solution for a clearly defined risk management problem.

Every educational programme should therefore have a direct and traceable relationship with the Risk Management Plan.

They Think About Governance

Educational materials require governance throughout their lifecycle.

Experienced QPPVs establish clear responsibilities for:

• document ownership;
• scientific review;
• regulatory review;
• approval;
• implementation;
• distribution;
• effectiveness evaluation;
• periodic review;
• retirement.

Governance ensures that educational materials remain scientifically accurate, operationally effective and aligned with current regulatory expectations.

They Expect Evidence for Every Decision

Experienced QPPVs expect important decisions relating to educational materials to be supported by objective evidence.

Examples include:

• why educational materials were selected;
• why a particular audience was chosen;
• why specific messages were included;
• why distribution methods were adopted;
• why revisions were made;
• why educational materials remain necessary.

Evidence-based governance promotes consistency, transparency and regulatory confidence.

They Integrate Educational Materials Across the Pharmacovigilance System

Educational materials should never operate independently of other pharmacovigilance activities.

Experienced QPPVs integrate educational programmes with:

• Risk Management Plans;
• signal management;
• aggregate reporting;
• post-authorisation safety studies;
• benefit-risk evaluation;
• safety communications;
• quality management systems;
• pharmacovigilance inspections.

Integration ensures that new pharmacovigilance knowledge is translated rapidly into updated educational content where appropriate.

They Focus on Continuous Improvement

Educational materials should improve continuously throughout the medicinal product lifecycle.

Experienced QPPVs routinely review:

• effectiveness evaluation reports;
• inspection observations;
• CAPA implementation;
• healthcare professional feedback;
• patient feedback;
• emerging scientific evidence;
• regulatory recommendations.

Continuous improvement ensures that educational programmes remain relevant as the understanding of the medicinal product evolves.

They Measure Organisational Performance

Experienced QPPVs recognise that educational materials provide valuable insight into the performance of the pharmacovigilance system itself.

Recurring deficiencies in educational programmes may indicate weaknesses in:

• governance;
• communication;
• document management;
• implementation;
• effectiveness evaluation;
• organisational oversight.

Accordingly, educational materials should be reviewed not only for their own performance but also for what they reveal about the wider pharmacovigilance system.

They Prepare for Inspection Continuously

Inspection readiness begins long before inspectors request educational materials.

Experienced QPPVs ensure that organisations can demonstrate:

• why educational materials exist;
• how they were developed;
• who approved them;
• how they were distributed;
• how effectiveness was evaluated;
• what improvements resulted from evaluation findings.

Maintaining this evidence throughout the product lifecycle enables organisations to demonstrate that educational materials remain scientifically justified and operationally effective.

They Define Success Differently

To an experienced QPPV, successful educational materials are not those that satisfy regulatory commitments or complete implementation milestones.

Successful educational materials are those that:

• remain aligned with important safety concerns;
• support meaningful behavioural change;
• integrate with the broader pharmacovigilance system;
• demonstrate measurable effectiveness;
• evolve in response to new evidence;
• contribute to protecting patients throughout the product lifecycle.

This broader perspective ensures that educational materials continue to support both regulatory compliance and public health objectives.

The QPPV Perspective

Ultimately, experienced QPPVs ask one question:

"Can our organisation demonstrate, through objective evidence, that our educational materials remain scientifically justified, effectively governed and capable of contributing to the safe and appropriate use of our medicinal products?"

If that question can be answered confidently, educational materials have fulfilled their role within the pharmacovigilance system.

Professional Reflection

Experienced QPPVs regard educational materials as strategic components of pharmacovigilance governance rather than individual regulatory documents. Through robust oversight, evidence-based decision-making, lifecycle management and continuous evaluation, they ensure that educational materials remain aligned with the evolving benefit-risk profile of medicinal products while supporting the protection of patients and the objectives of the Risk Management Plan.

Key Takeaways

Educational materials are among the most widely used additional risk minimisation measures within the European pharmacovigilance system. Their purpose is not to duplicate routine product information but to address important safety concerns that cannot be adequately managed through routine risk minimisation measures alone.

The decision to develop educational materials should always be based upon a structured assessment of the identified safety concern, the behaviour requiring modification and the likelihood that targeted communication will improve the safe and appropriate use of the medicinal product.

Effective educational materials are scientifically accurate, proportionate to the identified risk, designed for the intended audience and integrated within the Risk Management Plan. Their development requires multidisciplinary collaboration involving pharmacovigilance, regulatory affairs, medical affairs, medical writing and quality functions.

Implementation alone does not demonstrate success. Educational materials should be evaluated using predefined process and outcome indicators capable of demonstrating improvements in knowledge, behaviour and, where appropriate, patient outcomes. Evaluation findings should inform continual refinement of educational content and broader risk minimisation strategies.

Educational materials should be managed as controlled regulatory documents throughout their lifecycle. Governance, version control, periodic review, change management and formal retirement are essential components of maintaining their scientific accuracy and regulatory compliance.

From a Safety Physician's perspective, educational materials are clinical interventions intended to improve decision-making and reduce preventable harm. From a QPPV's perspective, they are governed components of an integrated pharmacovigilance system that supports the maintenance of a favourable benefit-risk balance throughout the medicinal product lifecycle.

Ultimately, educational materials achieve their purpose only when they contribute to measurable improvements in the safe and appropriate use of medicinal products. Their value lies not in the documents themselves but in their ability to support better decisions by healthcare professionals and patients.

Continue Reading

Readers interested in expanding their understanding of educational materials and additional risk minimisation measures should also explore the following topics:

Risk Management

• GVP Module V – Risk Management Systems
• GVP Module XVI – Risk Minimisation Measures
• Risk Management Plans (RMPs)
• Important Identified Risks
• Important Potential Risks
• Missing Information

Additional Risk Minimisation Measures

• Patient Alert Cards
• Pregnancy Prevention Programmes
• Controlled Access Programmes
• Controlled Distribution Programmes
• Prescriber Checklists
• Pharmacist Checklists
• Digital Risk Minimisation Measures

Effectiveness Evaluation

• Process Indicators
• Outcome Indicators
• Knowledge Surveys
• Behavioural Assessments
• Drug Utilisation Studies
• Post-Authorisation Safety Studies (PASS)
• Real-World Evidence in Pharmacovigilance

Pharmacovigilance Systems

• Signal Management
• Benefit-Risk Assessment
• Safety Communications
• Pharmacovigilance Inspections
• Pharmacovigilance Audits
• Pharmacovigilance Quality Systems

Together, these topics provide a comprehensive understanding of how educational interventions support risk minimisation within modern pharmacovigilance systems.

References

The preparation of this article should be supported by the current versions of the following authoritative references:

1. European Medicines Agency. Good Pharmacovigilance Practices (GVP) Module XVI – Risk Minimisation Measures: Selection of Tools and Effectiveness Indicators.

2. European Medicines Agency. Good Pharmacovigilance Practices (GVP) Module V – Risk Management Systems.

3. Directive 2001/83/EC of the European Parliament and of the Council on the Community code relating to medicinal products for human use, as amended.

4. Regulation (EC) No 726/2004 of the European Parliament and of the Council, as amended.

5. Commission Implementing Regulation (EU) No 520/2012 on the performance of pharmacovigilance activities.

6. European Medicines Agency. Guidance and templates relating to Risk Management Plans and additional risk minimisation measures.

7. International Council for Harmonisation (ICH). Relevant Efficacy and Safety Guidelines supporting benefit-risk evaluation and pharmacovigilance.