Advancing Pharmaceutical Quality

APQ logoISPE’s Advancing Pharmaceutical Quality (APQ) program is an industry-led quality management maturity assessment and benchmarking program that provides a practical set of tools and systematic approaches for organizations to advance the effectiveness of their PQS. The program is aligned with international initiatives that promote quality excellence, as well as with the FDA’s focus on quality management maturity and rating the maturity of manufacturing facilities.

ISPE’s APQ Program:

  • Recognizes that the ability to advance quality management maturity lies within the industry itself (developed by industry representatives for use by industry)
  • Builds upon the ICH Q10 model and enhances the PQS elements with the aspects of cultural excellence, operational excellence (OPEX), knowledge management, and continual improvement
  • Provides a comprehensive approach for assessing and improving an organization’s quality management maturity to advance the state of quality within the organization

APQ Framework Overview

ISPE AAAA Framework

At the core of the APQ Program is the Assess, Aspire, Act and Advance framework. Each APQ Guide contains quantitative and qualitative tools to assess the organization’s current state of quality, diagnose gaps, and identify improvement targets – Assess and Aspire. The Guides explain how to use this information to develop an Improvement Action Plan that the organization can execute and evaluate for effectiveness – Act and Advance.

The APQ Program was developed by ISPE members and evolved from the ISPE Quality Metrics pilot programs, representing extensive industry engagement, collaboration with academia and other associations, and knowledge sharing with regulatory agencies.


APQ Guide Series

The program consists of five Good Practice Guides: one for each of the four elements of an ICH Q10 Pharmaceutical Quality System plus Cultural Excellence, bookended by an optional benchmarking tool developed by University of St. Gallen.

The APQ Guides series proves a set of tool and systematic approaches – the Assess, Aspire, Act, and Advance Framework – for organizations to advance the maturity and effectiveness of these PQS elements.


Articles and Blogs

Articles

Webinars

Related Publications

Cultural Excellence ReportCultural Excellence Report

Examining the powerful force that culture exerts on day-to-day operations within organizations, ISPE’s Quality Culture Team has established that although for many the concept of quality culture remains abstract, the behavioral impacts are very real indeed. The Cultural Excellence Report contains a collection of practical, powerful tools and a comprehensive behavior-based approach for improving quality culture as a means of delivering enhanced quality outcomes.

Download

Module1: Root Cause Analysis Guide to Improving Quality Culture in Pharmaceutical Manufacturing Facilities: Root Cause AnalysisGuide to Improving Quality Culture in Pharmaceutical Manufacturing Facilities: Root Cause Analysis

Published: 2019
Pages: 10

Quality Culture has always been important within pharmaceutical manufacturing operations. Strong companies know this and have invested resources in systems and personnel to support and promote a focus on quality processes, product quality, and meeting patient needs. More recently, health authorities have placed additional emphasis on quality culture by including it in guidance documents and inspection protocols such as PIC/S Data Integrity Guidance , FDA New Inspection Protocol Project (NIPP) , and MHRA Data Integrity Guideline.

ISPE and the Parenteral Drug Association (PDA) have jointly developed this guide which identifies specific aspects of quality systems and culture and recommendations for tools, techniques, and processes.

Download


ISPE continues to support quality metrics and quality management maturity programs that have value to regulators, industry and patients. ISPE’s input is experiential and data driven, drawn from:

  • A quality metrics initiative initiated in 2013 by a core team and senior leaders representing more than 10 companies
  • An extensive pilot program conducted in cooperation with McKinsey and Company with participation from 28 companies and 83 sites. These companies and sites represented a wide range of technologies and included contract manufacturing organizations (CMOs) and laboratories, and drug substance manufacturing sites.
  • Ongoing robust dialog with pilot companies and the industry at large at ISPE conferences, workshops, and forums

Insights gained over the past nine years remain consistent:

  • Definitions and terminology must be exact in order to avoid multiple interpretations by participants, and to enable consistency in reporting and ability to conduct analysis
  • Many companies currently collect metric data at a site level and often utilize definitions different from the FDA or agreed ISPE harmonized definitions. Moreover, there are often different definitions or variations in interpretations of a definition between sites in the same company. Consequently, there is a significant burden for companies to collect data against harmonized definitions.
  • Frequency of data collection (e.g., quarterly, annually) has a major impact; analytic and reporting burden is proportional to the number of data points collected
  • Producing metric data on a product basis is difficult for products manufactured with complex supply chains and for companies with a large number of products. Historically, these data were not commonly produced or included in periodic product reviews (PPRs).
DATEINPUT
Dec 2023Quality Management Maturity Program for Drug Manufacturing Establishments
Nov 2022ISPE presentation to FDA Pharmaceutical Science and Clinical Pharmacology Advisory Committee Meeting
Jun 2022ISPE response to FDA Quality Metrics Reporting Program
Oct 2018ISPE response to FDA Modernizing Pharmaceutical Quality Systems, Studying Quality Metrics and Quality Culture, Quality Metrics Feedback Program
Mar 2017ISPE response to FDA revised draft Guidance, Submission of Quality Metrics Data
Sep 2016ISPE response to FDA Quality Metrics Technical Conformance Guide
Nov 2015ISPE response to FDA draft Guidance, Request for Quality Metrics
Nov 2025Cross-Industry Quality Metrics Collaboration Group comments on Request for Quality Metrics
Aug 2015ISPE presentation at FDA Quality Metrics Public Meeting
Dec 2013ISPE whitepaper: ISPE Proposals for FDA Quality Metrics Program

ISPE Quality Metrics Pilot Program

In 2013 ISPE proposed to FDA in the whitepaper ISPE Proposals for FDA Quality Metrics Program  that a pilot program should be conducted within industry to further understand the implementation opportunities, challenges and benefits of a standardized quality metrics program.

ISPE, in cooperation with McKinsey and Company, undertook the extensive quality metrics pilot program from 2014 – 2016. Findings from the pilot have enabled ISPE and industry to provide data-driven input to the FDA on a proposed metrics program.

Download the Complete Reports:

ISPE Quality Metrics Pilot Project—Wave 1

Wave 1 of the Pilot ran from June through November 2014 and included data collected at 44 sites from 18 participating companies. Nearly all metrics collected were reported at site level; three were collected at product level within each site.

The objective of Wave 1 was to provide real world experience with metrics definitions, data collection and reporting burden for the benefit of both industry and regulators.

Metrics tested in Wave 1:

  • Quantitative Metrics
    • Lot acceptance rate B
    • Complaints rate (total B and critical)
    • Confirmed OOS rate B
    • US recall events (total and by class) B
    • Stability Failure rate B
    • Invalidated (unconfirmed)  OOS rate B
    • Right first time (Rework/Reprocessing) rate B
    • APQR reviews completed on time
    • Recurring deviations rate
    • CAPA effectiveness rate
    • Media fill (for sterile aseptic sites) failures B
    • Environmental monitoring (for sterile aseptic sites) B
  • Technology-specific Metrics
    • Media fill (for sterile aseptic sites) failures B
    • Environmental monitoring (for sterile aseptic sites) B
  • Survey-based metrics
    • Process capability
    • Quality culture
  • Two more quantitative metrics calculated from data collected for Wave 1:
    • Deviations rate
    • Incoming material OOS

ISPE Quality Metrics Pilot Project—Wave 2

Wave 2 of the pilot ran from August through November 2015 with expanded industry segments, geographies, and time to provide deeper understanding of the relationships revealed in Wave 1.

During the planning of the Wave 2 pilot, the USFDA issued its Request for Quality Metrics draft Guidance. The Wave 2 pilot was adjusted to include:

  • Testing the proposed FDA metrics as defined as well as testing alternative definitions applied to the FDA Draft Guidance metrics
  • Evaluating the logistics and effort of gathering data at a product-application level

Metrics Tested in Wave 2:

  • Qualitative metrics
    • Product Quality (Total) Complaint Rate
    • Critical Complaints Rate
    • Recall Events
    • Lot Acceptance Rate
    • Invalidated OOS Rate
    • Right-First-Time Rate
    • Deviations Rate1
    • Recurring Deviations Rate
  • Culture indicators
    • CAPAs with Preventive Actions
    • Planned Maintenance
    • Employee Turnover
    • Human Error Deviations
    • Deviations with no Assigned Root Cause
  • Surveys
    • Quality Culture2
    • Process Capability
    • Questions to assess whether standardized metrics can assist prediction of drug shortages

Insights from the Pilot

  • Definitions and terminology must be exact; in particular, denominators can have a big impact on a company’s ability to report on the metric with either ease or difficulty
  • Even common terms like “lot”, “deviations”, “complaints” and “reviews” must be specified in great detail to minimize multiple interpretations
  • Product and process differences will generate differences and variations in metric ranges
  • Commentary on data points is essential to data interpretation and analysis
  • Frequency of data collection (e.g. quarterly, annually) has a major impact; analytic and reporting burden is proportional to the number of data points collected
  • Site-level metrics are more easily systematized for collection
  • Product-level metrics are significantly more complicated to collect; typically require a company to pull data from multiple systems and can rapidly result in large data management requirements

Quality Metrics Pilot Program Reports

Learnings from the ISPE Quality Metrics Pilot Program are fully documented in two reports, including:

  • Analysis of metrics data and relationships to internal and external quality outcomes
  • The actual time and effort required to collect FDA Draft Guidance metrics as compared to the FDA estimate.
  • Aggregated data from the participating companies, useful for benchmarking
  • Culture findings and relationships
  • Process Capability landscape
  • Success factors for a quality metrics program

Articles and Blogs