Artificial intelligence and its impact on machine vision

Several companies are working on artificial intelligence (AI) solutions for the machine vision industry that will allow AI to think more like humans by employing deep learning techniques and other functions that humans use to develop their brains.

02/17/2017


Image courtesy: Bob Vavra, CFE MediaWhen the concept of "thinking machines" emerged in the 1950s, alarmist warnings about this new field of artificial intelligence (AI) soon followed. The fear of the rise of the machines has played out in pop culture ever since, from the iconic 1968 film 2001: A Space Odyssey to the more recent Ex Machina.

While AI hasn't yet taken over society, improvements in data storage and processing power have enabled cognitive systems like IBM Watson that are designed to take the guesswork out of human decision-making. Most current iterations of AI, however, tackle more modest tasks like object recognition.

The promise of AI looks to enable machine vision to take on challenging applications beyond the capabilities of today's solutions. But is the technology ready for primetime in industrial applications?

Testing the AI waters

AI's applicability in machine vision relies on the affiliated branches of machine learning and, more so, deep learning. At its broadest level, AI is a computer's ability to simulate human intelligence. Diving deeper, machine learning gives computers the ability to act without being explicitly programmed. Deep learning, a subfield of machine learning, enables computers to learn from experience.

Several developments over the last decade have made deep learning a reality, not just a possibility, for machine vision. "Based on new techniques in neural networks, sufficient computational power in GPUs, and an abundance of data, only now can we use artificial intelligence for image processing," said Olivier Despont, business development at ViDi Systems, a Swiss company that makes deep learning-based vision software.

Deep learning holds promise over traditional machine vision because, unlike traditional image processing software that uses a rules-based approach, "AI is the next step where we take things that are not easily characterized or non-linear and give them to the machines to create that next level of repeatability," said Wallace Latimer, Sales Director, customized optical systems at FISBA LLC. "Whereas linear algorithms create a very narrow bucket, AI/deep learning creates bigger buckets that can accept more variation," Latimer continues. "It's widening the acceptance band of what is good or bad, and why it's good or bad. By having the bigger bucket, you can focus on what offers the biggest bang and reduce changes to inputs."

At least one deep learning system is on the market for machine vision users today. ViDi Suite from ViDi Systems is the first commercially available deep learning-based industrial image analysis software. The software, which integrates with standard image processing libraries, learns like a child does.

"You don't teach a child using a rules-based approach by explaining what a house is," Despont said. "Based on few examples, our brains, even at a young age, are able to extract what makes a house. Our system works exactly the same as the human brain."

ViDi Suite is comprised of three different tools. ViDi Blue finds and detects single or multiple features within an image. The tool localizes and identifies complex features and objects by learning from annotated images. ViDi Red detects anomalies by learning the normal appearance of an object, including its variations. The red tool also segments specific regions in images. ViDi Green learns to separate different classes based on a collection of labeled images to classify an object.

In addition to new machine vision solutions that can handle greater product variation, another advantage of deep learning over traditional machine vision solutions is that it can reduce the time necessary to develop a machine vision program. "With the classic vision approach, many applications need 60-plus days of software development and feasibility," Despont said. "ViDi can complete development in half a day."

Unlike Facebook, Google, and IBM AI systems that use server farms to power their software, ViDi uses a single high-end NVIDIA GPU to train the system in a matter of minutes, rather than the days or months it takes to program and parameterize with IBM Watson, according to Despont.

"And instead of using millions or billions of images, we recommend starting with 30 to 50 representative good images to teach the system," Despont said. "We're not sending images to a cloud-based server farm to do the processing or training. Customers are happy they can run everything on a single PC with one GPU and keep ownership of their images."

Opportunities and challenges

Deep learning shows particular promise in applications that present challenges to traditional vision systems. "AI is really suitable in food inspection among others where you want to inspect donuts or a piece of meat that shows significant difference from one instance to another," said Bruno Ménard, software program manager at Teledyne Dalsa.

But it's not just organic inspection applications that will benefit. Ménard cites traditional defect detection applications as another example. "It's difficult to program a computer with traditional algorithms to define the defect without having to redo the settings every time there is a new defect," he says. "But by using artificial intelligence with a lot of samples, you can end up with a really good definition of what is a good part and what isn't."

As AI emerges in machine vision, the technology will find a place in additional inspection tasks and eventually extend beyond the realm of industrial automation. According to Latimer, deep learning will be advantageous in markets such as medical, life sciences, food, counterfeit inspection, and lumber grading.

"These are areas that all have very gray decision points," Latimer said. "Is that apple good enough or not? That's hard to make a linear rule to say it is. Deep learning should enable a lot of applications to become much more efficient and repeatable."

For his part, ViDi Systems' Despont foresees that deep learning will include medical diagnostics, surveillance, autonomous vehicles, and smart agriculture for inspection or map analysis. "AI is the future and will be helping people solve some complex tasks very quickly as computational capabilities are doubling almost every one-and-a half years," Despont said.

Many machine vision professionals recognize the promise that AI and deep learning offer to the vision industry, but they say AI's full potential won't be realized for at least another 3 to 5 years. What's more, AI isn't necessarily the solution for everything that ails traditional vision and image processing.

Ménard noted two major drawbacks in AI systems. "First, you need a lot of training for it to happen, and you need to create the expert to reach the next level of classification," he said. "The second drawback is once it's trained and the classification fails, it's difficult to fix the problem. You have no choice of retraining with a new sample."

Before artificial intelligence becomes commonplace in machine vision, industry experts believe the industry will have to let much bigger players do the heavy lifting. "From our niche segment, we're getting to watch the Googles of the world drive this technology to incredible levels of investment and refinement," Latimer said. "Our industry cannot invest the time and money at the necessary scale. We're going to have to leverage it."

Winn Hardin is contributing editor, AIA. This article originally appeared on the AIA website. The AIA is a part of the Association for Advancing Automation (A3). A3 is a CFE Media content partner. Edited by Chris Vavra, production editor, Control Engineering, CFE Media, cvavra@cfemedia.com.

ONLINE extra

See additional stories from A3 linked below.



Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers.
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
Design of Safe and Reliable Hydraulic Systems for Subsea Applications
This eGuide explains how the operation of hydraulic systems for subsea applications requires the user to consider additional aspects because of the unique conditions that apply to the setting
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
October 2018
HMI hardware evolution, Data acquisition strategies, Matching motors and drives, Machine vision advice
September 2018
Optimize controls via cloud software, ladder logic simulation, industrial wireless best practices
August 2018
Augmented reality and virtual reality education, autotuning PID control, cybersecurity advice, educating engineers
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
Data Center Design
Data centers, data closets, edge and cloud computing, co-location facilities, and similar topics are among the fastest-changing in the industry.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

October 2018
2018 Product of the Year; Subsurface data methodologies; Digital twins; Well lifecycle data
August 2018
SCADA standardization, capital expenditures, data-driven drilling and execution
June 2018
Machine learning, produced water benefits, progressive cavity pumps
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers.
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
Design of Safe and Reliable Hydraulic Systems for Subsea Applications
This eGuide explains how the operation of hydraulic systems for subsea applications requires the user to consider additional aspects because of the unique conditions that apply to the setting
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
October 2018
HMI hardware evolution, Data acquisition strategies, Matching motors and drives, Machine vision advice
September 2018
Optimize controls via cloud software, ladder logic simulation, industrial wireless best practices
August 2018
Augmented reality and virtual reality education, autotuning PID control, cybersecurity advice, educating engineers
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
Data Center Design
Data centers, data closets, edge and cloud computing, co-location facilities, and similar topics are among the fastest-changing in the industry.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

October 2018
2018 Product of the Year; Subsurface data methodologies; Digital twins; Well lifecycle data
August 2018
SCADA standardization, capital expenditures, data-driven drilling and execution
June 2018
Machine learning, produced water benefits, progressive cavity pumps
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers.
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
Design of Safe and Reliable Hydraulic Systems for Subsea Applications
This eGuide explains how the operation of hydraulic systems for subsea applications requires the user to consider additional aspects because of the unique conditions that apply to the setting
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
October 2018
HMI hardware evolution, Data acquisition strategies, Matching motors and drives, Machine vision advice
September 2018
Optimize controls via cloud software, ladder logic simulation, industrial wireless best practices
August 2018
Augmented reality and virtual reality education, autotuning PID control, cybersecurity advice, educating engineers
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
Data Center Design
Data centers, data closets, edge and cloud computing, co-location facilities, and similar topics are among the fastest-changing in the industry.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

October 2018
2018 Product of the Year; Subsurface data methodologies; Digital twins; Well lifecycle data
August 2018
SCADA standardization, capital expenditures, data-driven drilling and execution
June 2018
Machine learning, produced water benefits, progressive cavity pumps
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me