Signal Prioritisation in Pharmacovigilance

Introduction

Signal prioritisation is the process through which validated signals are evaluated to determine the level of attention, resources and urgency that should be assigned to further assessment activities.

Not all validated signals carry the same potential significance. Some signals may involve serious adverse reactions with possible public health implications and require immediate review. Others may involve observations that are clinically important but unlikely to require urgent action. Some signals may require continued monitoring while additional information becomes available.

Prioritisation provides a structured framework for allocating resources appropriately and ensuring that potentially important safety concerns receive timely attention.

The objective is not to determine whether a signal is causal. That question is addressed during signal assessment. Instead, prioritisation seeks to determine how urgently and extensively a signal should be investigated.

Signal Prioritisation Within the Signal Management Process

Signal prioritisation generally occurs after validation and before detailed assessment.

A simplified process can be represented as:

Signal Detection
        ↓
Signal Validation
        ↓
Signal Prioritisation
        ↓
Signal Assessment
        ↓
Recommendation
        ↓
Action or Closure

Although not always described as a separate stage, prioritisation occurs implicitly or explicitly within most signal management systems.

Without prioritisation, organisations may struggle to distinguish between observations requiring immediate attention and those suitable for routine evaluation.

Why Prioritisation Is Necessary

Modern pharmacovigilance systems generate substantial volumes of signal-related information.

Potential signals may arise from:

• Spontaneous reports
• Literature surveillance
• Clinical studies
• Epidemiological research
• Regulatory communications
• EudraVigilance analyses

Even after validation, the number of signals requiring assessment may exceed available resources.

Prioritisation therefore serves several purposes:

• Efficient allocation of resources
• Timely management of significant risks
• Consistent decision-making
• Improved governance
• Enhanced public health protection

The process helps organisations focus attention where it is likely to have the greatest impact.

Principles of Risk-Based Prioritisation

Most prioritisation systems utilise a risk-based approach.

The purpose is not to rank signals according to statistical strength alone.

Instead, prioritisation considers broader factors that may influence the potential significance of the observation.

These factors often include:

• Clinical severity
• Public health impact
• Strength of evidence
• Extent of exposure
• Regulatory implications
• Benefit-risk considerations

A relatively small number of reports may warrant high prioritisation if the potential consequences are sufficiently serious.

Clinical Severity

The seriousness of the event is often one of the most important prioritisation factors.

Signals involving:

• Fatal outcomes
• Life-threatening events
• Permanent disability
• Congenital anomalies
• Serious organ toxicity

may warrant accelerated assessment even when evidence remains limited.

Clinical severity frequently influences both prioritisation decisions and escalation pathways.

However, seriousness alone should not determine priority. Other factors should also be considered.

Public Health Impact

Public health impact refers to the potential consequences of a signal at the population level.

Factors that may influence public health impact include:

• Number of exposed patients
• Vulnerable populations
• Widespread product use
• Potential preventability
• Availability of alternatives

A moderately severe risk affecting millions of patients may warrant greater attention than a severe risk affecting a very small population.

Assessment of public health impact therefore requires consideration of both severity and exposure.

Strength of Evidence

Prioritisation should consider the quality and consistency of available evidence.

Relevant factors may include:

• Number of reports
• Quality of reports
• Consistency across sources
• Biological plausibility
• Supporting literature
• Epidemiological evidence

Signals supported by multiple independent evidence sources may receive higher priority than observations based upon limited or uncertain information.

However, strong evidence is not always necessary for high prioritisation if the potential consequences are sufficiently serious.

Novelty

Novelty may influence prioritisation decisions.

Questions commonly considered include:

• Is the event already recognised?
• Does the signal represent a new risk?
• Does the signal represent a new aspect of a known risk?
• Has the issue been assessed previously?

Completely new safety concerns may warrant greater attention than issues that have already been extensively characterised.

Novelty is particularly important when considering potential regulatory implications.

Benefit-Risk Implications

Prioritisation should consider whether a signal may influence the benefit-risk balance of the medicinal product.

Questions may include:

• Could the signal alter prescribing decisions?
• Could the signal affect approved indications?
• Could the signal require additional monitoring?
• Could the signal affect patient safety significantly?

Signals with potential benefit-risk implications often require visibility within broader pharmacovigilance governance structures.

Regulatory Significance

Certain signals may have greater regulatory significance than others.

Examples include signals that may:

• Trigger regulatory communications
• Require product information updates
• Lead to risk minimisation measures
• Generate requests for additional studies
• Influence ongoing regulatory procedures

Potential regulatory impact frequently contributes to prioritisation decisions.

Regulatory context: prioritisation should align with requirements described in EMA GVP Module IX (Signal Management), Module I (Pharmacovigilance Systems and Their Quality Systems), and related regional guidances. For example, potential emerging safety issues that may lead to urgent regulatory communications or licence changes must be escalated to the QPPV and regulatory affairs in line with legal reporting obligations (e.g., expedited reporting timelines, PSUR/PBRER considerations).

Emerging Safety Issues

Potential emerging safety issues generally represent the highest level of prioritisation.

These situations may require:

• Accelerated assessment
• Senior management visibility
• QPPV awareness
• Rapid regulatory communication

Because emerging safety issues may affect public health directly, governance systems should support rapid prioritisation and escalation.

Prioritisation Methodologies

Organisations utilise a variety of prioritisation approaches.

Some employ formal scoring systems.

Others rely primarily on structured medical review.

Common approaches include:

• Risk matrices
• Priority categories
• Scoring algorithms
• Expert review panels

The specific methodology is generally less important than consistency and scientific justification.

Inspectors typically focus on whether prioritisation decisions are understandable and reproducible.

Governance of Prioritisation

Signal prioritisation should operate within a defined governance framework.

Governance arrangements commonly define:

• Review responsibilities
• Escalation criteria
• Priority categories
• Decision-making authority
• Documentation requirements

Prioritisation decisions may be reviewed by:

• Signal review committees
• Safety management teams
• Product safety committees
• Benefit-risk governance groups

Formal governance helps ensure consistency across products and therapeutic areas.

Governance considerations for inspection readiness: - Define and publish a prioritisation charter in SOPs, identifying who may assign priority, who must be notified at each priority level, and when the QPPV is to be informed. - Ensure committees have terms of reference (ToR) with attendance lists, quorum requirements and documented decision authorities. - Maintain audit trails of scoring, reviewer identities, committee minutes and actions assigned. - Provide periodic independent review of scoring thresholds and the prioritisation process (e.g., annual effectiveness review) and document outcomes.

Documentation Requirements

Prioritisation decisions should be documented appropriately.

Records may include:

• Signal description
• Evidence reviewed
• Priority classification
• Supporting rationale
• Escalation decisions
• Assigned actions

Documentation should enable reconstruction of the prioritisation process.

Inspectors frequently examine whether priority assignments can be justified using available records.

Essential inspection evidence: - SOP(s) describing prioritisation method and thresholds - Completed prioritisation scoring forms in the signal management system - Committee minutes or triage logs showing rationale for priority - Notifications to QPPV and regulatory affairs where required - Metrics reports showing adherence to prioritisation timelines

Role of the QPPV

The QPPV is not typically responsible for assigning priority classifications to individual signals.

However, governance arrangements should ensure that highly prioritised signals and potential emerging safety issues become visible to the QPPV.

The QPPV should understand:

• How prioritisation decisions are made
• Which signals require escalation
• How urgent concerns are managed
• How prioritisation influences assessment activities

Inspectors commonly explore these topics during discussions of signal management oversight.

Prioritisation During Inspections

Signal prioritisation may be reviewed explicitly or indirectly during inspections.

Inspectors may examine:

• Prioritisation procedures
• Escalation records
• Governance documentation
• Assessment timelines
• Resource allocation decisions

Inspection findings frequently arise when organisations cannot explain why certain signals received limited attention or why escalation decisions were made.

The rationale supporting prioritisation decisions should therefore be clear and documented.

Common Prioritisation Failures

Several weaknesses occur repeatedly across organisations.

Over-Reliance on Statistical Strength

Signals are prioritised solely according to disproportionality metrics.

Failure to Consider Public Health Impact

Exposure and population-level consequences are ignored.

Inconsistent Decision-Making

Similar signals receive different prioritisation outcomes.

Poor Documentation

Priority assignments cannot be justified retrospectively.

Weak Escalation Processes

Highly significant signals are not escalated appropriately.

Limited Governance

Prioritisation decisions occur without appropriate oversight.

These weaknesses may affect both compliance and safety oversight.

Characteristics of Effective Prioritisation Systems

Effective prioritisation systems generally demonstrate:

• Risk-based decision-making
• Consistent application
• Defined governance structures
• Appropriate escalation pathways
• Clear documentation
• Integration with benefit-risk evaluation

The objective is not to predict regulatory outcomes but to ensure that resources are directed toward the most significant safety concerns.

Practical Prioritisation Matrix (Operational)

Below is a practical, inspection-ready prioritisation matrix suitable for operationalising prioritisation in SOPs and signal management systems. The matrix provides scoring ranges, priority level definitions, required actions, timelines and required notifications. It is designed to be reproducible and auditable.

Notes for implementation: - Use the scoring weights and thresholds as part of the SOP; record every score and the reviewer identity in the signal management system. - Adapt exposure figures and thresholds to corporate portfolio context (e.g., small patient population vs widely used OTC product) but keep governance-approved thresholds documented and version controlled.

Scoring rubric (example)

• Clinical severity: 0–5
• 0 = non-serious, transient minor event
• 2 = medically significant but non-life-threatening
• 4 = serious (requires hospitalisation, disability)
• 5 = death, life-threatening, congenital anomaly
• Public health impact (exposure & population): 0–4
• 0 = single case/localised, rare exposure
• 1 = small exposed population
• 2 = moderate exposure or vulnerable subgroups
• 3 = widespread use in national population
• 4 = international/widespread, high potential impact
• Strength of evidence: 0–4
• 0 = single poor-quality report
• 1 = limited single-source reports
• 2 = several reports or supportive literature
• 3 = consistent multi-source evidence or pharmacoepidemiology
• 4 = robust epidemiological evidence / reproducible signal
• Novelty: 0–2
• 0 = well-known and characterised AE
• 1 = new aspect of known AE
• 2 = entirely new/unrecognised safety issue
• Exposure trend (increase in reporting/exposure): 0–2
• 0 = stable
• 1 = moderate increase
• 2 = sharp increase or clusters
• Regulatory/label implications: 0–3
• 0 = no regulatory implication
• 1 = possible label clarifications
• 2 = likely label change or RMM consideration
• 3 = potential for urgent regulatory communication or suspension

Maximum possible score (example) = 20.

Priority thresholds and operational responses

Inspection relevance: - The matrix and thresholds must be described in the SOP and signed off by governance (Head of PV, QPPV). - All scoring worksheets and justification narratives should be retrievable and linked to signal identifiers. - Provide evidence that reviewers applied the matrix consistently (e.g., cross-audits, inter-rater reliability checks).

Practical Examples of Matrix Use (brief)

• Example A: Single death reported in a widely used OTC analgesic with plausible biological mechanism but limited reports — Clinical severity 5 + Public health impact 4 + Evidence 2 + Novelty 2 + Exposure trend 1 + Regulatory implication 2 = score 16 → Priority 1: urgent assessment, QPPV notified.
• Example B: Cluster of non-serious rash in a clinical trial for a rare disease therapy — Clinical severity 1 + Public health 1 + Evidence 2 + Novelty 1 + Exposure trend 1 + Regulatory implication 0 = score 6 → Priority 4: monitor but no immediate escalation; record and re-review if new reports.

One-Page Implementation Checklist (SOP steps, roles, timelines, KPIs)

This checklist is formatted to be included as an SOP appendix or quick-reference card. It aligns operational steps with roles, required timelines and measurable KPIs for inspection readiness.

Note: populate the checklist with organisation-specific names and timing if required by local regulations. Ensure this checklist is version controlled and referenced in the SOP.

Quick reference checklist (compact)

• SOP title/version: Signal Prioritisation SOP v__ (record)
• Governance approvals: Head of PV / QPPV sign-off date: __

• Primary signal intake system: [system name] — ensure audit trail enabled

• Signal validation completed

• Responsible: Signal Triage Reviewer (Safety Scientist)
• Timeline: within 7 calendar days of detection
• Output: Validated signal record in system (ID, source)

• KPI: 95% of incoming potential signals validated within 7 days

• Prioritisation scoring applied using approved matrix

• Responsible: Signal Triage Reviewer + Clinical Assessor
• Timeline: within 24 hours of validation for suspected serious events; within 7 days otherwise
• Output: Completed prioritisation sheet with scores, rationale, reviewer name/time-stamp

• KPI: 100% of validated signals scored; median time-to-score ≤ 2 days

• Initial assessment & assignment of next steps

• Responsible: Safety Physician / Signal Management Lead
• Timeline: per priority matrix (see table)
• Output: Assessment memo, planned data collection, assigned owner

• KPI: 90% of Priority 1 signals receive initial assessment within 24 hours; 90% Priority 2 within 48 hours

• Escalation to governance bodies as required

• Responsible: Signal Management Lead / Head of PV
• Timeline: immediate for Priority 1; within 72 hours for Priority 2
• Output: Notification email to QPPV/Regulatory Affairs, convening of Signal Review Committee if indicated

• KPI: 100% of Priority 1 signals escalated to QPPV within required period

• Convene Signal Review Committee (SRC) / Safety Management Team

• Responsible: Chair (Head of PV / Delegate)
• Timeline: Emergency meeting within 72 hours for Priority 1; scheduled within 7 calendar days for Priority 2
• Output: Committee minutes with decisions, assigned actions, timelines

• KPI: Minutes stored within 2 business days of meeting; 100% action owners assigned

• Perform detailed assessment (clinical review, epidemiology, literature)

• Responsible: Multi-disciplinary team (Safety Physician, Epidemiologist, Medical Affairs, RA)
• Timeline: Priority 1 — preliminary within 72 hours, full within 14 days; Priority 2 — full within 30 days; Priority 3 — within 90 days
• Output: Assessment report with conclusions and recommendation(s)

• KPI: Completion rates by priority within SLA (e.g., 90% Priority 1 assessments within SLA)

• Decision & recommendations (communication, RMM, label changes, studies)

• Responsible: Signal Review Committee / Safety Governance
• Timeline: immediately on completion of assessment
• Output: Decision record, communication plan, regulatory submissions if required

• KPI: Time from assessment completion to decision ≤ 7 days

• Regulatory interaction & external communications

• Responsible: Regulatory Affairs in coordination with QPPV
• Timeline: Within legally required reporting timelines; notify regulators as agreed
• Output: Regulatory submission, safety communications, DH notifications

• KPI: 100% compliance with mandatory reporting timelines

• Closure or continued monitoring

• Responsible: Signal Owner
• Timeline: Closure when criteria met; re-evaluate periodically (quarterly or per SOP)
• Output: Closure memo, archived data, monitoring plan

• KPI: % signals closed within defined timeframe; % re-opened due to new evidence

• Metrics, quality review and governance reporting

  • Responsible: Head of PV / PV Quality Assurance
  • Timeline: Monthly dashboards; quarterly governance reviews; annual SOP effectiveness review
  • Output: KPIs dashboard, audit findings, improvement actions
  • KPI: Defined targets met (e.g., % compliance with timelines, % escalations logged, average scoring concordance)

Roles summary (for the checklist)

• Signal Triage Reviewer / Safety Scientist: First-line scoring and documentation.
• Clinical Assessor / Safety Physician: Clinical review, interpretation, scoring support.
• Epidemiologist / Data Scientist: Exposure assessment, trend analysis.
• Signal Management Lead: Oversees prioritisation, assigns actions, convenes committees.
• Head of PV / QPPV: Governance oversight, receives escalations, regulatory interface.
• Regulatory Affairs: Prepares regulatory submissions and external communications.
• Medical Affairs / Product Team: Provides product context, market exposure data.
• PV Quality Assurance: Audit, KPI monitoring and SOP maintenance.

Timelines (summary table)

Inspection relevance: - These timelines should be included in SOPs and monitored via KPI reports. Inspectors will expect to see adherence evidence (system timestamps, emails, minutes) and escalation logs for Priority 1/2 signals.

Governance and Quality Considerations

• Define authority levels: SOP must specify who can change priority after scoring, who approves upward escalations, and how disagreements are resolved (e.g., appeal to QPPV).
• Periodic calibration: Governance should mandate periodic calibration exercises (e.g., quarterly) where multiple reviewers score historical signals to assess inter-rater reliability and adjust matrix weights if needed.
• Change control and versioning: Any change to the matrix, scoring weights or thresholds must follow documented change control, with impact assessment and retraining records.
• Training: All staff involved in prioritisation must be trained with records retained and refresher training at least annually or after SOP changes.
• Audit and monitoring: PV QA should perform regular audits of prioritisation decisions and KPI performance; findings should be reported to senior management and used to refine processes.
• Integration with risk management: High-priority signals must be visible to RMP/PDCO/PRAC activities as appropriate; outcomes should feed into PBRER/PSUR and RMP updates.

Characteristics of an Inspection-Ready Prioritisation System

• SOP referencing applicable regulatory guidances (EMA GVP Modules) and local law.
• Documented scoring matrix included as an appendix to the SOP.
• System-generated audit trail linking signal ID to scores, comments, reviewer identity, timestamps.
• Committee terms of reference, attendance, minutes and decision records.
• Evidence of timely escalation to QPPV and Regulatory Affairs for high-priority signals.
• KPI dashboards demonstrating adherence to timelines and trend analyses used to adjust resource allocation.
• Training and calibration records for personnel applying the matrix.

Key Takeaways

Signal prioritisation is the process through which validated signals are assigned an appropriate level of urgency and attention.

Prioritisation considers factors such as clinical severity, public health impact, strength of evidence, novelty and potential benefit-risk implications.

The process supports efficient resource allocation and timely management of significant safety concerns.

Governance, documentation and escalation pathways are important components of effective prioritisation systems.

QPPVs should maintain visibility of highly prioritised signals and potential emerging safety issues through established governance mechanisms.

A practical prioritisation matrix combined with a concise implementation checklist makes the process reproducible, auditable and inspection-ready.

References

1. EMA Good Pharmacovigilance Practices (GVP) Module IX – Signal Management.
2. EMA Good Pharmacovigilance Practices (GVP) Module I – Pharmacovigilance Systems and Their Quality Systems.
3. EMA Good Pharmacovigilance Practices (GVP) Module V – Risk Management Systems.
4. Commission Implementing Regulation (EU) No 520/2012.
5. CIOMS VIII Practical Aspects of Signal Detection in Pharmacovigilance.
6. ICH E2E Pharmacovigilance Planning.
7. ICH E2C(R2) Periodic Benefit-Risk Evaluation Report.