Augmented reality enhances plant floor view, productivity

Automation Integrator Guide: Technology integration provides augmented reality view of industrial plant floor to streamline equipment maintenance, reduce downtime, and improve bottom line.


This holistic live video display of plant motors is overlaid with live process data as values, trends, and graphs. The Apple iOS application iQagent from iQuest provides an augmented reality view of the plant floor. Kepware’s KepServerEx support iQagent’sA provider of process automation services and solutions develops applications that employ panels, automated equipment, drives, programmable logic controllers (PLCs), human machine interfaces (HMIs), and database, Web, network, and custom components. The company delivers turnkey processes for unique customer specifications, helps design and implement customized control systems, and provides expert consulting and engineering support services for existing systems.

“In any industry that relies on automation, efficiency is the name of the game; otherwise, humans would still be building cars or filling medicine bottles,” said Bob Meads, founder and CEO of iQuest. “At iQuest, we understand the essential need for streamlined operations and strive to help our customers operate at the peak of productivity.”

Efficiency challenge

Customers can and do calculate the value of efficiency in dollars saved, and one of the most detrimental effects to the bottom line is production downtime. Most iQuest customers calculate plant or production line downtime at $1,000 to $40,000 per minute, so keeping machines working—or quickly repairing them when they fail—is of the utmost importance. Downtime represents significant revenue loss.

In most facilities, production and maintenance professionals must maintain and repair automated machinery, relying on disparate resources to monitor and diagnose machinery errors, including operational data, schematics, technical resources, and URLs associated with the equipment process. Gathering and interpreting information from these various resources often resulted in extended downtime before diagnosis and repair. An Apple iOS application provides an augmented reality view of the plant floor, “recognizing” equipment or process area in the user’s vicinity using QR Codes (quick response, data matrix codes that a mobile device can scan) and displays relevant process data, document links, and resources on an Apple iPad or Apple iPhone display. (The iOS platform was chosen for its highly intuitive user interfaces, deep market penetration, superior security standards, and ability to support a mobile, and often geographically divided, technical workforce.) By instantly presenting all available diagnostic information in a highly digestible format in a centralized location, the software application equips plant professionals to make faster and more accurate decisions.

Furthermore, most plant floors consist of hundreds—if not thousands—of different machines, often from a variety of vendors, each speaking a separate language, or software protocol. An application was needed to instantly communicate with any machine in any plant, regardless of the supported protocol. Doing this required integration of an immense collection of device and client drivers and broad support of the OPC standard. [OPC serves as the translator among disparate languages.]


A remote monitoring of a bottling production line is overlaid with process data, including units produced and line speed. Helping with data translation, the Kepware KepServerEx helps with data translation between the iQagent software from iQuest and the mThe software to support the interface with customer machinery included a “comprehensive library of supported native and open communication standards,” said Meads. Engineered to support the OPC standard and over 150 protocols, the integrated software can interact with virtually any piece of machinery within any industrial plant environment.

“In the industrial automation industry, there is no standard language for communications, like the widely known HTTP standard that you see on the Internet,” said Meads. “So you can imagine how difficult it could be to get one application to connect to and communicate with disparate devices in an environment as diverse and complex as an industrial plant floor.”

Instant communications

Through its ability to instantly communicate with any piece of machinery, the software allows field technicians, production maintenance, repair professionals, and others to gather, view, and access all data associated with a machine by simply scanning the device’s QR code. Users can also pull down a menu to retrieve any data, anywhere they have a connection to the plant network. The integrated package can provide live machine process data, turning any plant floor into an efficient, data-rich environment. This anytime, anywhere access to any machine’s live, historical, or resource data builds an encompassing and concise augmented reality view of the plant floor.

Collaborative support with offsite technicians or experts is available using a holistic data display and recording feature. This allows on-site line technicians to capture live video of issues on Apple iPad or iPhone display. Technicians can overlay that video (including audio) with live data from the machine’s HMI or PLC, schematics, parts lists, and user annotations directly on the screen. The resulting mp4 video can then be e-mailed to offsite support for quick analysis and problem resolution, thus allowing remote personnel to support repair as if they were on-site.

Such software streamlines upkeep and repair by eliminating the need to locate technical manuals. With a QR scan, it provides technicians with supporting documentation for any piece of plant machinery. Among the industry’s largest automotive producers and one of the largest health care product developers use the application in a production environment. Initial results regarding time-saving and increased efficiency are significant, and overall feedback has been positive.

The integrated software allows communication with any industrial machine, to instantly consolidate all resources and data necessary to significantly streamline upkeep and repairs, and to reduce revenue loss resulting from downtime.

- Tony Paine is president and CEO of Kepware. Edited by Mark T. Hoske, content manager, CFE Media, Control Engineering, and Plant Engineering, mhoske(at)


At the bottom of the file, see additional, related articles.

No comments
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by...
Each year, a panel of Control Engineering editors and industry expert judges select the System Integrator of the Year Award winners.
Control Engineering Leaders Under 40 identifies and gives recognition to young engineers who...
Learn more about methods used to ensure that the integration between the safety system and the process control...
Adding industrial toughness and reliability to Ethernet eGuide
Technological advances like multiple-in-multiple-out (MIMO) transmitting and receiving
Virtualization advice: 4 ways splitting servers can help manufacturing; Efficient motion controls; Fill the brain drain; Learn from the HART Plant of the Year
Two sides to process safety: Combining human and technical factors in your program; Preparing HMI graphics for migrations; Mechatronics and safety; Engineers' Choice Awards
Detecting security breaches: Forensic invenstigations depend on knowing your networks inside and out; Wireless workers; Opening robotic control; Product exclusive: Robust encoders
The Ask Control Engineering blog covers all aspects of automation, including motors, drives, sensors, motion control, machine control, and embedded systems.
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
News and comments from Control Engineering process industries editor, Peter Welander.
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
This is a blog from the trenches – written by engineers who are implementing and upgrading control systems every day across every industry.
Anthony Baker is a fictitious aggregation of experts from Callisto Integration, providing manufacturing consulting and systems integration.
Integrator Guide

Integrator Guide

Search the online Automation Integrator Guide

Create New Listing

Visit the System Integrators page to view past winners of Control Engineering's System Integrator of the Year Award and learn how to enter the competition. You will also find more information on system integrators and Control System Integrators Association.

Case Study Database

Case Study Database

Get more exposure for your case study by uploading it to the Control Engineering case study database, where end-users can identify relevant solutions and explore what the experts are doing to effectively implement a variety of technology and productivity related projects.

These case studies provide examples of how knowledgeable solution providers have used technology, processes and people to create effective and successful implementations in real-world situations. Case studies can be completed by filling out a simple online form where you can outline the project title, abstract, and full story in 1500 words or less; upload photos, videos and a logo.

Click here to visit the Case Study Database and upload your case study.