Signal Management KPIs
Signal-management systems generate many measurements: numbers of observations screened, signals validated, assessments opened, actions completed and cases reviewed. Only some of these measurements deserve to be called key performance indicators (KPIs). A KPI is useful when it helps the organisation understand whether an important part of the signal-management system is functioning as intended and when an unfavourable result can trigger proportionate action.
- Signal Management KPIs
- Purpose and Regulatory Context
- Metric Versus KPI
- Start With the Risk, Not the Dashboard
- Timeliness KPIs
- Backlog and Ageing
- Quality and Documentation KPIs
- Escalation and Governance KPIs
- Downstream Action KPIs
- Vendor and Partner KPIs
- QPPV Dashboard Design
- Thresholds and Traffic-Light Status
- Leading and Lagging Indicators
- Interpreting Trends
- KPI Failure Modes
- Inspection and Audit Considerations
- Recommended KPI Design Checklist
- Key Takeaways
- References
- Regulatory Note
Purpose and Regulatory Context
EU pharmacovigilance legislation and GVP require MAHs to operate effective pharmacovigilance systems and quality systems. GVP Module IX describes signal-management responsibilities, while GVP Module I describes quality-system monitoring and management responsibilities.
The framework does not prescribe a universal set of signal-management KPIs, fixed green/amber/red thresholds, or a particular dashboard format. These are organisation-specific controls.
The regulatory question is whether the MAH can demonstrate that its signal-management process is effective, controlled and appropriately overseen. Metrics and KPIs can help provide that evidence.
Metric Versus KPI
A metric is a measurement. A KPI is a selected indicator linked to an important process objective or risk.
Examples:
| Metric | Possible KPI interpretation |
|---|---|
| number of open assessments | useful only if interpreted against portfolio size, age and priority |
| number of overdue assessments | can indicate accumulating process risk |
| number of committee meetings | rarely meaningful alone |
| proportion of high-priority actions overdue | can indicate governance failure |
| number of signals closed | cannot by itself demonstrate performance |
The difference is therefore not mathematical. It is whether the measurement helps management understand and act on system performance.
Start With the Risk, Not the Dashboard
A useful KPI should answer a defined oversight question.
Examples include:
- Are important assessments becoming overdue?
- Are urgent escalations reaching the appropriate governance level?
- Are signal decisions being translated into downstream actions?
- Is a vendor creating persistent quality or timeliness risk?
- Are documentation defects recurring?
- Is regulatory change being implemented effectively?
The KPI should be selected only after the question is clear.
Timeliness KPIs
Timeliness can matter because delayed signal activity may delay risk management. Possible indicators include:
- proportion of assessments exceeding the organisation's target;
- age distribution of open assessments;
- number of high-priority items beyond target;
- time from decision to implementation of required downstream action; and
- time taken to resolve significant signal-related CAPAs.
Internal targets should be distinguished from legal or procedural deadlines. An organisation may adopt stricter targets as a quality control, but those targets should not be described as EMA requirements unless they actually are.
Backlog and Ageing
A simple count of open signals is often misleading. Ageing information is usually more useful.
For example, twenty open assessments may be acceptable if most are recent and progressing normally, while five long-overdue high-priority assessments may represent a more serious control problem.
Useful views include:
- age bands;
- priority or risk classification;
- reason for delay;
- responsible process or vendor; and
- trend over time.
This converts backlog from a volume measure into a risk-based oversight tool.
Quality and Documentation KPIs
Signal management depends on the quality of the scientific record. Possible quality indicators include:
- proportion of sampled assessments requiring substantial rework;
- recurring missing rationale in validation or closure records;
- repeated inconsistencies between signal records and downstream documents;
- proportion of sampled records with incomplete evidence traceability; and
- recurring deviations associated with the same process step.
These indicators are most useful when the organisation can distinguish isolated errors from systemic patterns.
Escalation and Governance KPIs
Governance indicators may include:
- significant escalations not completed within internal targets;
- high-priority actions overdue after governance decisions;
- repeated decisions reopened because required expertise or evidence was missing;
- unresolved differences between vendor and MAH conclusions; and
- material issues not visible to the QPPV within the intended governance pathway.
Meeting attendance or quorum compliance may be operationally useful where the organisation uses formal committees, but they do not demonstrate scientific effectiveness by themselves.
Downstream Action KPIs
The signal lifecycle does not end with the assessment conclusion. A useful dashboard can track whether resulting actions are actually implemented.
Examples include:
- product-information impact assessments pending;
- RMP updates or safety-concern reviews not completed;
- PSUR/PBRER integration actions overdue;
- risk-minimisation actions awaiting implementation;
- regulatory responses or commitments approaching due dates; and
- follow-up monitoring plans not initiated as agreed.
This helps prevent a common governance blind spot in which the signal record is closed while consequential work remains incomplete.
Vendor and Partner KPIs
Where signal activities are outsourced or shared, indicators may focus on:
- timeliness of agreed deliverables;
- error or rework rates;
- missed escalations;
- recurring data-transfer issues;
- quality of supporting rationale; and
- unresolved deviations or CAPAs.
A service-level agreement metric becomes a meaningful pharmacovigilance KPI only when it reflects a risk relevant to the MAH's signal-management obligations.
QPPV Dashboard Design
The QPPV generally needs a concise, risk-focused view rather than every available operational metric.
A practical dashboard may combine:
- current high-impact signals;
- materially overdue assessments or actions;
- emerging safety concerns;
- significant regulatory interactions;
- major vendor or quality issues;
- downstream implementation status; and
- trend information showing whether performance is improving or deteriorating.
The dashboard should support drill-down to the underlying records when the QPPV needs more detail.
Thresholds and Traffic-Light Status
Thresholds can make dashboards easier to interpret, but they can also create false precision.
A threshold should have a rationale. It may be based on:
- process capability;
- risk tolerance;
- historical performance;
- regulatory or contractual deadlines;
- portfolio complexity; or
- the clinical significance of delay.
A universal rule such as "95% equals green" has no regulatory meaning unless the organisation can explain why that level is adequate for the process being monitored.
Leading and Lagging Indicators
A useful KPI set often combines leading indicators, which may warn that failure is developing, with lagging indicators, which show that failure has already occurred.
Examples:
| Leading indicator | Lagging indicator |
|---|---|
| increasing assessment age | missed regulatory action |
| rising vendor rework | formal quality deviation |
| growing action backlog | overdue product-information implementation |
| repeated missing data in assessment drafts | audit finding or CAPA |
Leading indicators are valuable because they allow intervention before a compliance failure becomes established.
Interpreting Trends
A single month's result may be misleading. Trend interpretation should consider:
- changes in portfolio size;
- product launches or acquisitions;
- regulatory changes;
- temporary workload peaks;
- methodology changes;
- vendor transitions; and
- changes to KPI definitions or thresholds.
If the denominator or process changes, apparent improvement may not represent real improvement.
KPI Failure Modes
The following are illustrative failure modes, not reported inspection findings.
| Failure mode | Why it matters |
|---|---|
| dashboard contains dozens of metrics with no decision purpose | reporting burden increases without improving oversight |
| green status depends on an arbitrary or excessively lenient target | KPI can conceal process risk |
| raw signal counts are interpreted as system quality | portfolio size and detection sensitivity are ignored |
| only averages are reported | a small number of severely overdue high-risk items can be hidden |
| KPI definition changes without preserving trend context | apparent improvement may be artificial |
| vendor SLA is green while scientific rework remains high | contractual performance is mistaken for pharmacovigilance effectiveness |
| action completion is measured but effectiveness is not | administrative closure is mistaken for control |
Inspection and Audit Considerations
An inspector or auditor may ask:
- Why were these KPIs selected?
- Which risks does each KPI monitor?
- What happens when a threshold is breached?
- Are thresholds regulatory, contractual or internal?
- Can the organisation trace a dashboard figure to underlying records?
- Are important high-risk items visible even when the aggregate KPI is green?
- How are KPI trends used in resource, vendor or CAPA decisions?
- Does the QPPV receive the level of detail needed for effective oversight?
- Were KPI definitions updated after the 2025–2026 changes to the signal-management framework where relevant?
A KPI is stronger evidence when there is a visible chain from measurement → interpretation → decision → action.
Recommended KPI Design Checklist
The following is recommended operational practice, not an EMA-mandated template.
- What specific risk or process objective does the KPI monitor?
- Is the numerator and denominator defined unambiguously?
- Is the data source controlled and reproducible?
- Is the threshold scientifically or operationally justified?
- Are legal deadlines distinguished from internal targets?
- Can high-risk outliers be seen rather than hidden in averages?
- Is trend context preserved when the portfolio or process changes?
- Is the KPI actionable when performance deteriorates?
- Does the QPPV dashboard emphasise risk rather than volume?
- Are vendor indicators linked to actual MAH pharmacovigilance risk?
- Are downstream signal actions included where they create important residual risk?
- Are KPI definitions periodically reassessed when regulation, systems or processes change?
Key Takeaways
Signal-management KPIs are management controls, not a prescribed regulatory scorecard.
A useful KPI begins with a risk or oversight question and ends with a decision or action when performance deteriorates.
Timeliness, ageing, quality, escalation, vendor performance and downstream implementation may all be useful, but raw counts and arbitrary traffic-light thresholds can be misleading.
The QPPV generally benefits from a concise risk-focused dashboard that permits drill-down rather than a large inventory of operational statistics.
For inspection purposes, the important evidence is not the appearance of the dashboard but whether the organisation understands what its indicators mean and acts when they reveal a loss of control.
References
- European Medicines Agency. Guideline on good pharmacovigilance practices (GVP) Module I — Pharmacovigilance systems and their quality systems. EMA/541760/2011.
- European Medicines Agency. Guideline on good pharmacovigilance practices (GVP) Module IX — Signal management (Rev. 1). EMA/827661/2011 Rev. 1.
- European Medicines Agency. Questions and answers on signal management. EMA/261758/2013 Rev. 5, updated 20 January 2026.
- European Medicines Agency. Signal management. Current EMA procedural page.
- European Union. Commission Implementing Regulation (EU) No 520/2012, as amended by Commission Implementing Regulation (EU) 2025/1466.
- European Union. Directive 2001/83/EC, as amended.
- European Union. Regulation (EC) No 726/2004, as amended.
Regulatory Note
EU legislation and GVP require an effective pharmacovigilance quality system and controlled signal management, but they do not prescribe a universal signal-management KPI set, target percentages or dashboard format. The indicators in this article are examples of recommended operational controls. Organisations should define measures proportionately and keep them aligned with the current regulatory framework.