Artificial intelligence and its impact on machine vision

Several companies are working on artificial intelligence (AI) solutions for the machine vision industry that will allow AI to think more like humans by employing deep learning techniques and other functions that humans use to develop their brains.

02/17/2017


Image courtesy: Bob Vavra, CFE MediaWhen the concept of "thinking machines" emerged in the 1950s, alarmist warnings about this new field of artificial intelligence (AI) soon followed. The fear of the rise of the machines has played out in pop culture ever since, from the iconic 1968 film 2001: A Space Odyssey to the more recent Ex Machina.

While AI hasn't yet taken over society, improvements in data storage and processing power have enabled cognitive systems like IBM Watson that are designed to take the guesswork out of human decision-making. Most current iterations of AI, however, tackle more modest tasks like object recognition.

The promise of AI looks to enable machine vision to take on challenging applications beyond the capabilities of today's solutions. But is the technology ready for primetime in industrial applications?

Testing the AI waters

AI's applicability in machine vision relies on the affiliated branches of machine learning and, more so, deep learning. At its broadest level, AI is a computer's ability to simulate human intelligence. Diving deeper, machine learning gives computers the ability to act without being explicitly programmed. Deep learning, a subfield of machine learning, enables computers to learn from experience.

Several developments over the last decade have made deep learning a reality, not just a possibility, for machine vision. "Based on new techniques in neural networks, sufficient computational power in GPUs, and an abundance of data, only now can we use artificial intelligence for image processing," said Olivier Despont, business development at ViDi Systems, a Swiss company that makes deep learning-based vision software.

Deep learning holds promise over traditional machine vision because, unlike traditional image processing software that uses a rules-based approach, "AI is the next step where we take things that are not easily characterized or non-linear and give them to the machines to create that next level of repeatability," said Wallace Latimer, Sales Director, customized optical systems at FISBA LLC. "Whereas linear algorithms create a very narrow bucket, AI/deep learning creates bigger buckets that can accept more variation," Latimer continues. "It's widening the acceptance band of what is good or bad, and why it's good or bad. By having the bigger bucket, you can focus on what offers the biggest bang and reduce changes to inputs."

At least one deep learning system is on the market for machine vision users today. ViDi Suite from ViDi Systems is the first commercially available deep learning-based industrial image analysis software. The software, which integrates with standard image processing libraries, learns like a child does.

"You don't teach a child using a rules-based approach by explaining what a house is," Despont said. "Based on few examples, our brains, even at a young age, are able to extract what makes a house. Our system works exactly the same as the human brain."

ViDi Suite is comprised of three different tools. ViDi Blue finds and detects single or multiple features within an image. The tool localizes and identifies complex features and objects by learning from annotated images. ViDi Red detects anomalies by learning the normal appearance of an object, including its variations. The red tool also segments specific regions in images. ViDi Green learns to separate different classes based on a collection of labeled images to classify an object.

In addition to new machine vision solutions that can handle greater product variation, another advantage of deep learning over traditional machine vision solutions is that it can reduce the time necessary to develop a machine vision program. "With the classic vision approach, many applications need 60-plus days of software development and feasibility," Despont said. "ViDi can complete development in half a day."

Unlike Facebook, Google, and IBM AI systems that use server farms to power their software, ViDi uses a single high-end NVIDIA GPU to train the system in a matter of minutes, rather than the days or months it takes to program and parameterize with IBM Watson, according to Despont.

"And instead of using millions or billions of images, we recommend starting with 30 to 50 representative good images to teach the system," Despont said. "We're not sending images to a cloud-based server farm to do the processing or training. Customers are happy they can run everything on a single PC with one GPU and keep ownership of their images."

Opportunities and challenges

Deep learning shows particular promise in applications that present challenges to traditional vision systems. "AI is really suitable in food inspection among others where you want to inspect donuts or a piece of meat that shows significant difference from one instance to another," said Bruno Ménard, software program manager at Teledyne Dalsa.

But it's not just organic inspection applications that will benefit. Ménard cites traditional defect detection applications as another example. "It's difficult to program a computer with traditional algorithms to define the defect without having to redo the settings every time there is a new defect," he says. "But by using artificial intelligence with a lot of samples, you can end up with a really good definition of what is a good part and what isn't."

As AI emerges in machine vision, the technology will find a place in additional inspection tasks and eventually extend beyond the realm of industrial automation. According to Latimer, deep learning will be advantageous in markets such as medical, life sciences, food, counterfeit inspection, and lumber grading.

"These are areas that all have very gray decision points," Latimer said. "Is that apple good enough or not? That's hard to make a linear rule to say it is. Deep learning should enable a lot of applications to become much more efficient and repeatable."

For his part, ViDi Systems' Despont foresees that deep learning will include medical diagnostics, surveillance, autonomous vehicles, and smart agriculture for inspection or map analysis. "AI is the future and will be helping people solve some complex tasks very quickly as computational capabilities are doubling almost every one-and-a half years," Despont said.

Many machine vision professionals recognize the promise that AI and deep learning offer to the vision industry, but they say AI's full potential won't be realized for at least another 3 to 5 years. What's more, AI isn't necessarily the solution for everything that ails traditional vision and image processing.

Ménard noted two major drawbacks in AI systems. "First, you need a lot of training for it to happen, and you need to create the expert to reach the next level of classification," he said. "The second drawback is once it's trained and the classification fails, it's difficult to fix the problem. You have no choice of retraining with a new sample."

Before artificial intelligence becomes commonplace in machine vision, industry experts believe the industry will have to let much bigger players do the heavy lifting. "From our niche segment, we're getting to watch the Googles of the world drive this technology to incredible levels of investment and refinement," Latimer said. "Our industry cannot invest the time and money at the necessary scale. We're going to have to leverage it."

Winn Hardin is contributing editor, AIA. This article originally appeared on the AIA website. The AIA is a part of the Association for Advancing Automation (A3). A3 is a CFE Media content partner. Edited by Chris Vavra, production editor, Control Engineering, CFE Media, cvavra@cfemedia.com.

ONLINE extra

See additional stories from A3 linked below.



Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
May 2018
Salary and Career Survey, IT and OT convergence, robotic standards and safety, secure circuit protection
April 2018
Cybersecurity best practices, artificial intelligence, robotic additive manufacturing, embedded systems, IIoT integration, energy efficiency
March 2018
Digitalization integration, process sensors, edge computing, fog computing, condition monitoring, and motors
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
May 2018
Salary and Career Survey, IT and OT convergence, robotic standards and safety, secure circuit protection
April 2018
Cybersecurity best practices, artificial intelligence, robotic additive manufacturing, embedded systems, IIoT integration, energy efficiency
March 2018
Digitalization integration, process sensors, edge computing, fog computing, condition monitoring, and motors
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
May 2018
Salary and Career Survey, IT and OT convergence, robotic standards and safety, secure circuit protection
April 2018
Cybersecurity best practices, artificial intelligence, robotic additive manufacturing, embedded systems, IIoT integration, energy efficiency
March 2018
Digitalization integration, process sensors, edge computing, fog computing, condition monitoring, and motors
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me