How AR and VR are transforming training in manufacturing

Augmented reality (VR) and virtual reality (VR) technologies are improving training programs in plant facilities and bridging the skills gap with more efficient training for the incoming workforce – training new workers at 30 to 40% more efficiently and reducing assembly time.

08/09/2018


Figure 1: With augmented reality (AR), remote experts can use their hands to draw and make markings in the digital world on the physical world to help communicate ideas and instructions to workers in the factory. Courtesy: PTCEarly adopters of augmented reality (AR) and virtual reality (VR) in manufacturing have demonstrated the technology delivers value by bridging the skills gap and transforming the way controls engineers are trained and evaluated and how retiring workers are offboarded (the process of retaining and sharing domain knowledge and intellectual property (IP)). AR and VR also show value in improving workforce productivity and safety. For example, a large aerospace and defense company, headquartered in the U.K., leveraged AR to create a more flexible workforce. With AR, the company created guided work instructions in hours at a 10th of the cost, trained new workers 30 to 40% more efficiently, and reduced assembly time by half.

In another case, a global manufacturer of business technology products, headquartered in the U.S., leveraged AR to connect field engineers with experts instead of providing service manuals and telephone support. First-time fix rates increased by 67% and the engineers' efficiency increased by 20%. The average time to resolve problems dropped by more than 2 hours.

Advancements in AR for creating and documenting work procedures for training have shown a 37% reduction in time spent training and a 75% reduction in time required to document work instructions. 

Addressing the labor shortage in manufacturing

Manufacturers are facing a shortage of skilled workers and have been for years—even before the record lows in unemployment. Retiring workers, economic expansion, and a widening skills gap are all contributing factors. According to the U.S. Bureau of Labor Statistics, the average tenure of a new worker in manufacturing is 5.3 years, meaning even if a manufacturer attracts new talent, the likelihood they'll be recruiting again in the future is high. The hardest positions to fill are typically the ones that have the biggest impact on performance. Technical positions such as controls engineers, skilled operators, technicians, and machinists, are critical to expanding operations, implementing digital transformation initiatives, and improving productivity. These are also the positions that require the most training and investment.

Internal training programs are the key to attracting and developing the talent manufacturers need. However, legacy methods such as training manuals, job shadowing, and evaluations and certification processes are outdated, less effective, and time consuming. These methods also don't address the need to cater to different learning styles: visual, aural, verbal, etc. 

Defining AR and VR

AR transforms how information is consumed by overlaying digital content and analytics onto the real world. For example, imagine being in a manufacturing setting and being able to, with the help of 2-D and 3-D eyewear, cell phone, or tablet, view operational data, drawings, documentation, and blueprints overlaid onto the machinery and plant floor. It also can provide step-by-step procedural guidance, operator set-up, and change over instructions, workflows, processes, and more.

On the other hand, VR creates fully immersive experiences. Instead of overlaying data and analytics onto the real world, VR creates a simulated environment. Imagine being able to virtually visit a remote plant or a plant still under construction, such as an offshore oil and gas platform, without having to send trainees on-site. 

AR training use cases

Figure 2: Augmented reality helps workers identify the proper tools and parts required for a task, provide step-by-step instructions, and alert and correct missteps with real-time feedback. Courtesy: PTCTypically, workforce development in manufacturing consists of traditional methods, which is generally a mix of printed manuals, computer-based trainings, role-playing, and shadowing. These methods are time- and cost-intensive and deliver mixed results despite the significant expenses. Printed manuals can be difficult to interpret; videos aren't interactive and can't be tailored to individual needs; and role-playing can be difficult to schedule and can impede production and reduce productivity. These types of training materials are also time- intensive to create and maintain, and, if there isn't offline equipment available, all the knowledge gained from training still needs to be put into real-life context.

AR addresses the needs of multiple learning styles and has many benefits. AR:

  • Makes training visual, auditory, and kinesthetic
  • Provides step-by-step visual and-oral instructions in real-time
  • Helps workers navigate the factory and warehouse more efficiently
  • Identifies the proper tools and parts required for a task
  • Provides step-by-step instructions
  • Alerts and corrects missteps along the way providing real-time feedback
  • Overlays key performance metrics and operational data onto equipment to illustrate how the factory is responding to changes.

For example, if a controls or maintenance engineer is alerted that a motor isn't working, AR can lead an engineer or technician to the spare part in the warehouse, help direct the person to the location of the motor in the factory, provide step-by-step directions on how to safely perform lockout-tagout (LOTO) procedures, and display guided instructions to remove the old motor and install the new one. Upon completion, AR can then show how to properly start-up the machine.

AR versus traditional training methods

After completing coursework, trainees are evaluated to ensure understanding and comprehension of key subjects, including LOTO procedures, process hazard methodologies, OSHA guidelines, and more. In some cases, trainees may be subjected to hands-on assessments; in others, it may only be testing for certifications.

Certifications and hands-on assessments have drawbacks. With paper and digital exams, trainers fail to assess if trainees grasp the real-world concepts required to be successful. With hands-on assessments, trainees are tested on valuable concepts, but data, such as human error and measures of overall performance, is lost. This data is instrumental to improving future training programs.

AR provides a means of combining the best of both evaluation methods by subjecting trainees to hands-on examinations while capturing those essential pieces of data required to enhance training. AR has the power to recognize when the wrong part is leveraged, when assembly steps are completed out of order, when it takes too long to complete a task, or even when a misstep causes a safety risk.

Using VR to prepare and train for emergency scenarios

Regardless of the level of training, in manufacturing there are situations all controls engineers need to be prepared for. Traditional training methods can't or don't adequately address these scenarios.

In process industries, where safety is the utmost priority, operators and controls engineers need to be prepared for situations that they hopefully never encounter in their career, such as a runaway reaction, chemical leak, or explosion. Or situations that may happen only once a year such as shutdown and start-up. In discrete and hybrid manufacturing, operators need to be prepared for product changeovers, equipment upgrades, and emergency situations where quick action is required to mitigate and prevent the risk of damage to property and personnel.

Figure 3: Virtual reality creates immersive experiences with a simulated environment, where an operator could virtually train on a line, unit, or plant under construction, without having to send trainees on-site. Courtesy: PTCThese are situations where VR can add immense value. With immersive digital twins, controls engineers can role-play and practice emergency response scenarios. Within the context of the manufacturing environment, they cannot only train for how to respond, but can also learn how different responses impact operations. Digital twins and VR also offer the opportunity to train operators when a physical environment isn't available, whether the facility is under construction, in a remote location, or is unsafe.

Bridging the skills gap with AR

According to Deloitte, over the next 10 years, more than 2.7 million baby boomers are retiring from manufacturing, taking their embedded knowledge with them. Effective offboarding is critical to developing the next generation of controls engineers. However, developing traditional training materials is time-intensive and materials quickly become out-of-date.

With AR, capturing expert knowledge becomes significantly more efficient. Rather than performing a process and spending hours documenting it later, skilled engineers can create AR experiences passively. AR leverages advanced sensors and computer vision to capture audio and visual cues that document factory location and work processes. Controls engineers can perform a task while wearing a headset and talk through the steps as if they were training someone. At the same time, AR is documenting and translating the information into training materials for future use that can be published either in AR experiences or in more traditional formats such as videos, images, and text documents, (see Figure 1).

In addition to seamless offboarding, AR also can bridge the skills gap by creating a connection between remote experts and manufacturing facilities. Remote experts can wear an AR device that displays the same information and surroundings of someone wearing an AR device in the factory, and they can have a conversation in the context of the factory. Remote experts also can use their hands to draw and make markings in the digital world to help communicate ideas and instructions to workers in the physical world. This type of interactive and visual communication never existed before AR. It can help workers complete unfamiliar or challenging tasks or troubleshoot a problem with expert guidance. It also provides increased flexibility for workers who are eligible for retirement but who may want to continue working, on a part-time or remote basis.

The need to attract, train, and retain the next generation of controls engineers will be challenging; however, AR and VR appeals to the interests of technology-centric millennials and have demonstrated they can improve training and onboarding. With AR and VR, controls engineers can be better equipped for the day-to-day and emergency situations they may never encounter in their careers. Manufacturers should embrace today's technology to bridge the skills gap and ensure a productive, safe transition to the next workforce generation.

Shelby Hegy, senior marketing manager of manufacturing at PTC. Edited by Emily Guenther, associate content manager, Control Engineering, CFE Media, eguenther@cfemedia.com

MORE ANSWERS

KEYWORDS: augmented reality (AR), virtual reality (VR)

  • How AR and VR enhance training in manufacturing
  • The benefits of using AR and VR in manufacturing facilities
  • Using AR and VR to bridge the skills gap between industry experts and the incoming workforce.

Consider this

How would AR and VR technologies improve the training process for incoming employees and bridge the skills gap? 

Online extra

Author Bio: Shelby Hegy, senior marketing manager of manufacturing, at PTC. Shelby is a writer with a passion for and an emphasis on technology for discrete and process manufacturing. She holds a B.S. degree in Chemical Engineering from the University of Minnesota. 

Multimedia Captions & URLs:

Video 1: PTC video: Augmented reality overlays the digital world on the physical world to transform the way information is consumed.

Video 2: PTC video: Experts can help those with less experience problem solve, and teams can quickly collaborate and make changes.



Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers.
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
Augmented reality and virtual reality education, autotuning PID control, cybersecurity advice, educating engineers
July 2018
Ladder logic best practices and object-oriented programming, safety instrumented systems, enclosure design issues and challenges, process control advice
June 2018
Discrete and process sensor fundamentals, autotuning controls, system integrator roundtable
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
Data Center Design
Data centers, data closets, edge and cloud computing, co-location facilities, and similar topics are among the fastest-changing in the industry.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

SCADA standardization, capital expenditures, data-driven drilling and execution
June 2018
Machine learning, produced water benefits, progressive cavity pumps
April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers.
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
Augmented reality and virtual reality education, autotuning PID control, cybersecurity advice, educating engineers
July 2018
Ladder logic best practices and object-oriented programming, safety instrumented systems, enclosure design issues and challenges, process control advice
June 2018
Discrete and process sensor fundamentals, autotuning controls, system integrator roundtable
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
Data Center Design
Data centers, data closets, edge and cloud computing, co-location facilities, and similar topics are among the fastest-changing in the industry.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

SCADA standardization, capital expenditures, data-driven drilling and execution
June 2018
Machine learning, produced water benefits, progressive cavity pumps
April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers.
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
Augmented reality and virtual reality education, autotuning PID control, cybersecurity advice, educating engineers
July 2018
Ladder logic best practices and object-oriented programming, safety instrumented systems, enclosure design issues and challenges, process control advice
June 2018
Discrete and process sensor fundamentals, autotuning controls, system integrator roundtable
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
Data Center Design
Data centers, data closets, edge and cloud computing, co-location facilities, and similar topics are among the fastest-changing in the industry.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

SCADA standardization, capital expenditures, data-driven drilling and execution
June 2018
Machine learning, produced water benefits, progressive cavity pumps
April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me