Five elements of KPI lifecycle

Key Performance Indicators (KPIs) have a lifecycle with a similarly cyclic pattern: from definition to collection to set composition to implementation to assessment and back to definition. Manufacturers who use KPIs naturally implement this lifecycle, but there is some real value to clearly and carefully articulate the elements of the lifecycle.

05/26/2016



Humans go through distinct phases of life: from dependence to learning to producing to sharing and back to dependence. We call this a lifecycle. The phases of life keep repeating as new persons are born and the elderly complete their lives. 

Key Performance Indicators (KPIs) also have a lifecycle with a similarly cyclic pattern: from definition to collection to set composition to implementation to assessment and back to definition

Manufacturers who use KPIs naturally implement this lifecycle, but there is some real value to clearly and carefully articulate the elements of the lifecycle. 

Key Performance Indicators (KPIs) have a lifecycle with a similarly cyclic pattern: from definition to collection to set composition to implementation to assessment and back to definition. Courtesy: MESA

An accurate and detailed model of the KPI Lifecycle:

  • Enables efficient and effective performance management 
  • Enables a cottage industry of performance methods and software tools
  • Provides a basis for open standards on KPI use.

Assuming the target processes have been identified, here is an outline of five elements to consider to successfully use KPIs in your manufacturing process throughout their entire lifecycle. 

KPI lifecycle element 1: definition

The first element of the KPI lifecycle is KPI definition. Since there are probably tens of thousands of different KPIs used by manufacturers, one might think that all the KPIs that need to be defined have been defined. To be sure, KPIs like quality ratio, overall equipment efectiveness index, scrap ratio and rework ratio are not going away any time soon, but KPIs may sometimes need to be redefined as a more focused or aggregate KPI. 

Furthermore, as corporate objectives change over time, KPIs change. Corporate objectives drive the definition and use of KPIs—remember how the sustainability objective quickly became an increasingly important metric? But, it’s important to follow good KPI definition practices, otherwise interoperability will suffer throughout your supply chain. 

KPI lifecycle element 2: collection

The second element of the lifecycle is KPI collection. Collection consists largely of excluding obvious outlier KPIs from consideration like irrelevant KPIs. Still, one can easily end up with far too many candidate KPIs. 

Keep in mind that humans typically monitor KPIs, but humans can only comprehend and process five to nine distinct items simultaneously (the “seven plus or minus two” rule from psychologist George Miller). Therefore, we have a need for KPI set composition, our next step in the lifecycle.

KPI lifecycle element 3: set composition

The third element of the lifecycle is KPI set composition, which is substantially more complicated than KPI collection. The following guidelines should be followed: 

  • Select appropriate KPI performance criteria (ISO 22400 Part 1).
  • Follow the “seven plus or minus two” rule for the number of KPIs selected.
  • Find the sweet spot between detailed versus aggregate KPIs. 
  • Ensure that the chosen KPIs satisfy all the stated critical objectives of the process.

A structured criteria-based method to satisfy these guidelines has been generated at the National Institute of Standards and Technology. It enables a group of stakeholders to form an effective subset of KPIs from a larger set of candidate KPIs, whether the KPIs are currently in use or not. It also employs value-based decision-making for accurate stakeholder elicitation. 

The criteria chosen constitute a comprehensive, unambiguous and independent set. Along with the criteria, user-defined critical objectives are used to guide KPI set composition. The particular decision-making approach was selected to keep the number of process stakeholder measurements manageable while allowing the maximum number of relevant and independent criteria. The method has been tested at a chemical process plant on the environment, health and safety process. One of the benefits of KPI set composition is that it may reveal that new KPIs need to be generated. 

KPI lifecycle element 4: implementation

Implementation starts with a selected set of KPIs that will keep the process operating optimally in the face of variation. These chosen KPIs can now be properly implemented within the target process. In this fourth element of the lifecycle, the stakeholders need to:

  • Ensure that the KPIs implemented are accurate, actionable, aligned, documented, independent, inexpensive, predictive, quantifiable, relevant, standardized, timely, traceable, understandable, verified and have buy-in from stakeholders.
  • Ensure that candidate KPI sets satisfy critical objectives and that set size is kept small.
  • Define and implement stakeholder training.
  • Define and conduct process-performance assessments, examining KPI values and trends periodically.
  • Define procedures for handling changing circumstances, such as customer requirements, machine health, critical objectives, KPI definitions, new stakeholders, etc.
  • Define procedures for using knowledge about KPI-to-KPI relationships and dependencies and for describing action plans for improving process control from KPI values.

KPI lifecycle element 5: assessment

The final activity in the lifecycle is KPI assessment. This is when stakeholders take time to examine how relevant the KPIs are performing (different than process performance). It is also the time to examine how well have the KPIs been implemented. KPI assessment is typically done over longer time spans as compared with assessment of KPI values. The following are the key elements in the assessment: 

  • Determine how well the KPIs align with current performance objectives for the process. 
  • Determine how well the KPIs perform with respect to the criteria.

Take these results and generate a prioritized list of action items by KPI, criterion  pairs formed by measuring the importance of the KPI to the process. And then list how well the KPI performs with respect to the criteria. Plot the KPI, criterion performance with the KPI, critical objective performance and assess ways to improve the performance of the KPIs. 

— John Horst, MESA member, National Institute of Standards and Technology (NIST) and Barry Ezell, Virginia Modeling, Analysis and Simulation Center (VMASC). This article originally appeared on MESA’s blog. MESA is a CFE Media content partner. Edited by Erin Dunne, production coordinator, CFE Media, edunne@cfemedia.com.



The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
Maximize ROI with integrated control system approach; Microcontrollers vs. PLCs; Power quality; Accelerate and rewire IIoT; Traits for excellent engineers
HMI effectiveness; Distributed I/O; Engineers' Choice Award finalists; System Integrator advice; Inside Machines
Women in engineering; Engineering Leaders Under 40; PID benefits and drawbacks; Ladder logic; Cloud computing
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. As we know, PLCs aren’t the only option for making decisions in a control loop, but they are likely why you’re here.
This digital report explains how plant engineers and subject matter experts (SME) need support for time series data and its many challenges.
This article collection contains several articles on how advancements in vision system designs, computing power, algorithms, optics, and communications are making machine vision more cost effective than ever before.

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

Control room technology innovation; Practical approaches to corrosion protection; Pipeline regulator revises quality programs
Cloud, mobility, and remote operations; SCADA and contextual mobility; Custom UPS empowering a secure pipeline
Infrastructure for natural gas expansion; Artificial lift methods; Disruptive technology and fugitive gas emissions
Automation Engineer; Wood Group
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
Maximize ROI with integrated control system approach; Microcontrollers vs. PLCs; Power quality; Accelerate and rewire IIoT; Traits for excellent engineers
HMI effectiveness; Distributed I/O; Engineers' Choice Award finalists; System Integrator advice; Inside Machines
Women in engineering; Engineering Leaders Under 40; PID benefits and drawbacks; Ladder logic; Cloud computing
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. As we know, PLCs aren’t the only option for making decisions in a control loop, but they are likely why you’re here.
This digital report explains how plant engineers and subject matter experts (SME) need support for time series data and its many challenges.
This article collection contains several articles on how advancements in vision system designs, computing power, algorithms, optics, and communications are making machine vision more cost effective than ever before.

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

Control room technology innovation; Practical approaches to corrosion protection; Pipeline regulator revises quality programs
Cloud, mobility, and remote operations; SCADA and contextual mobility; Custom UPS empowering a secure pipeline
Infrastructure for natural gas expansion; Artificial lift methods; Disruptive technology and fugitive gas emissions
Automation Engineer; Wood Group
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
Maximize ROI with integrated control system approach; Microcontrollers vs. PLCs; Power quality; Accelerate and rewire IIoT; Traits for excellent engineers
HMI effectiveness; Distributed I/O; Engineers' Choice Award finalists; System Integrator advice; Inside Machines
Women in engineering; Engineering Leaders Under 40; PID benefits and drawbacks; Ladder logic; Cloud computing
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. As we know, PLCs aren’t the only option for making decisions in a control loop, but they are likely why you’re here.
This digital report explains how plant engineers and subject matter experts (SME) need support for time series data and its many challenges.
This article collection contains several articles on how advancements in vision system designs, computing power, algorithms, optics, and communications are making machine vision more cost effective than ever before.

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

Control room technology innovation; Practical approaches to corrosion protection; Pipeline regulator revises quality programs
Cloud, mobility, and remote operations; SCADA and contextual mobility; Custom UPS empowering a secure pipeline
Infrastructure for natural gas expansion; Artificial lift methods; Disruptive technology and fugitive gas emissions
Automation Engineer; Wood Group
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me