QPPV.COM

Risk Minimisation Effectiveness Evaluation

A practical guide to evaluating whether risk minimisation measures achieve their intended objectives and improve safe use of medicinal products.

Risk Minimisation Effectiveness Evaluation

Introduction

The implementation of a risk minimisation measure does not guarantee that risk has been reduced.

Educational materials may be distributed but never read. Monitoring recommendations may be included in prescribing information but not followed. Pregnancy prevention programmes may exist but fail to prevent fetal exposure.

For this reason, modern pharmacovigilance systems increasingly focus on effectiveness evaluation.

Risk minimisation effectiveness evaluation seeks to determine whether a risk minimisation measure achieves its intended objective and contributes to safer use of a medicinal product.

The question is no longer:

Was the measure implemented?

The question is:

Did the measure work?

Why Effectiveness Evaluation Matters

Risk minimisation measures often require substantial effort and resources.

Examples include:

Regulators expect evidence that these activities provide value and contribute to public health protection.

Without effectiveness evaluation, it may be impossible to determine whether a programme should:

Regulatory Expectations

Within modern RMPs, effectiveness evaluation has become an important component of risk management.

Regulators increasingly expect organisations to:

The level of evaluation should be proportionate to the importance of the safety concern and the complexity of the intervention.

Fundamental Principle

Evaluation should begin with a clearly defined objective.

For example:

Risk:
Teratogenicity

Objective:
Prevent exposure during pregnancy

Measure:
Pregnancy Prevention Programme

Evaluation:
Has exposure during pregnancy been reduced?

Without a clearly defined objective, meaningful evaluation becomes difficult.

What Does Success Look Like?

A risk minimisation programme should have predefined goals.

Examples may include:

Success criteria should be defined before evaluation begins.

Evaluation Framework

A common framework is:

Safety Concern
        ↓
Risk Minimisation Measure
        ↓
Behaviour Change
        ↓
Clinical Outcome

Evaluation may occur at one or more stages of this pathway.

Process Indicators

Process indicators evaluate implementation.

Typical questions include:

Examples include:

Process indicators are useful but have limitations.

They do not demonstrate that behaviour changed.

Outcome Indicators

Outcome indicators evaluate the effect of the intervention.

Examples include:

Outcome indicators generally provide stronger evidence of effectiveness.

However, they may be more difficult to measure.

Knowledge Surveys

Knowledge surveys are widely used to evaluate educational materials.

Examples of assessed topics include:

Surveys help determine whether key safety messages have been understood.

Knowledge alone, however, does not necessarily translate into behavioural change.

Behavioural Assessments

Behavioural assessments evaluate whether healthcare professionals or patients modify their actions.

Examples include:

These assessments often provide more meaningful information than knowledge surveys alone.

Drug Utilisation Studies

Drug Utilisation Studies (DUS) are frequently used to evaluate risk minimisation measures.

Examples include assessment of:

DUS studies provide insight into real-world implementation.

PASS and Effectiveness Evaluation

Post-Authorisation Safety Studies may support effectiveness evaluation.

Examples include:

PASS methodologies are particularly useful when evaluation requires large populations or long-term follow-up.

Pregnancy Prevention Programmes

Pregnancy Prevention Programmes often require extensive effectiveness evaluation.

Possible measures include:

Because fetal exposure may have serious consequences, regulators frequently expect robust evaluation.

Educational Material Evaluation

Educational programmes may be evaluated using:

A useful principle is:

Distributed
≠
Read

Read
≠
Understood

Understood
≠
Behaviour Changed

Evaluation should extend beyond simple distribution metrics whenever possible.

Measuring Rare Outcomes

Some risks occur infrequently.

Examples include:

In such situations, direct outcome measurement may be difficult.

Alternative approaches may include:

The chosen approach should be scientifically justified.

Defining Success Criteria

Success criteria should be established prospectively.

Examples may include:

>90% awareness among prescribers

<5% prescribing outside authorised conditions

Reduction in pregnancy exposures

Predefined criteria improve interpretation of findings.

Lifecycle Management

Evaluation findings should influence programme management.

Possible outcomes include:

Continue

Programme remains effective and necessary.

Modify

Improvements are required.

Expand

Additional interventions are needed.

Discontinue

Programme no longer justified.

Evaluation should support decision-making rather than exist solely for regulatory reporting.

Challenges in Effectiveness Evaluation

Several practical challenges exist.

Attribution

Changes may result from multiple factors.

Rare Events

Outcomes may be difficult to measure directly.

Data Availability

Relevant information may be unavailable.

Survey Bias

Participants may not represent the wider population.

Resource Requirements

Robust evaluations may require substantial investment.

These limitations should be recognised when interpreting findings.

Common Regulatory Deficiencies

Recurring deficiencies include:

No Defined Objective

Programme purpose is unclear.

Reliance on Distribution Metrics Alone

No assessment of understanding or behaviour.

Weak Success Criteria

Evaluation lacks meaningful endpoints.

Failure to Use Results

Findings do not influence programme management.

Inadequate Documentation

Evaluation methods and conclusions are poorly documented.

These issues frequently generate regulatory questions.

Inspection and Audit Considerations

Inspectors may review:

The emphasis is often on demonstrating a systematic approach rather than achieving perfect outcomes.

Role of the QPPV

The QPPV should understand:

Inspectors frequently assess QPPV awareness of major risk management activities and their effectiveness.

Characteristics of Effective Evaluation Programmes

Effective programmes generally demonstrate:

The objective is to understand whether risk minimisation measures improve patient safety.

Key Takeaways

Risk minimisation effectiveness evaluation assesses whether risk minimisation measures achieve their intended objectives.

Process indicators measure implementation, while outcome indicators assess behavioural or clinical effects.

Knowledge surveys, Drug Utilisation Studies, PASS studies and behavioural assessments are commonly used evaluation tools.

Evaluation findings should influence lifecycle management decisions regarding continuation, modification or discontinuation of programmes.

Regulators increasingly expect evidence that risk minimisation measures are effective rather than simply implemented.

References

  1. EMA Good Pharmacovigilance Practices (GVP) Module V – Risk Management Systems.
  2. CIOMS IX Practical Approaches to Risk Minimisation.
  3. EMA Risk Management Plan Template.
  4. Commission Implementing Regulation (EU) No 520/2012.
  5. EMA Guidance on Risk Minimisation Measures.
  6. ENCePP Guide on Methodological Standards in Pharmacoepidemiology.
  7. ICH E2E Pharmacovigilance Planning.

Related Articles

Additional Risk Minimisation Measures

A practical guide to Additional Risk Minimisation Measures, including educational materials, pregnancy prevention programmes, controlled access systems and effectiveness evaluation.

Additional Pharmacovigilance Activities

A practical guide to Additional Pharmacovigilance Activities, including PASS studies, registries, enhanced monitoring and regulatory expectations.

PASS and Risk Management Plans

A practical guide to the role of PASS studies in Risk Management Plans, including study selection, regulatory expectations, governance and lifecycle management.

Last reviewed: 2026-06-11