Machine vision software development steered by speed, simplicity

Image processing software manufacturers are updating their products to meet increased demand and expectations from machine vision customers as the market expands.

08/30/2017


Image courtesy: Bob Vavra, CFE MediaAs machine vision customers continue to expect swift vision application development, ease of use, and adoption of new technologies, image processing software manufacturers are updating their products to meet that demand. That cycle is resulting in numerous opportunities for software makers to show off their products' versatility and muscle.

"The market is not changing as much as it is expanding," said Steve Geraghty, vice president, industrial products division, of Teledyne Dalsa. "The incorporation of newer technologies, such as infrared and 3-D imaging, is increasing the range of applications where machine vision can be applied."

Dr. Olaf Munkelt, Cofounder and Managing Director of MVTec Software GmbH (Munich, Germany), says that machine vision development is "driven by the rapid changes due to the Industrial Internet of Things (IIoT), or Industrie 4.0, demanding integrated production processes enabled by the digital interconnection of systems, machines, objects, and people."

Deep learning, in which computers learn from experience, is poised to meet these demands on the factory floor and beyond. "New software technologies such as deep learning extend application possibilities by learning normal product variation such that robust classification is possible," Geraghty said. "Deep learning allows machine vision to be used to segment and classify objects, or even beings, from cluttered or changing backgrounds, rendering very difficult applications possible."

MVTec has introduced deep learning technologies for optical character recognition (OCR). "With deep learning algorithms becoming more and more manageable, we were able to cast them into a feature that is very important in industrial applications and also within the IIoT—reading characters of any shape and under harsh industrial conditions robustly, fast, and without long training processes by the user," Munkelt said.

At the end of 2017, MVTec will release a new version of its software, which offers a large selection of functions for the use of deep learning out of the box. For example, for the first time it enables customers themselves to conduct training of convolutional neural networks based on deep learning algorithms.

Matrox Imaging has added an OCR tool to its software development kit. which can read challenging dot-matrix text.

Pierantonio Boriero, director of product management for Matrox Imaging, said, "What's more, the use of dot-matrix text for product identification is still extremely common in the packaging industry given the continued effectiveness of inkjet printers." 

Other additions to their software development kit reflect customers' drive for even more precise vision inspection tasks. Matrox started adding dedicated shape-finding tools to its vision library after finding that many pattern-recognition applications required locating only basic, as opposed to complex, geometric shapes. An ellipse-finding tool complements an existing circle-finding tool.

"These dedicated shape-finding tools outperform general geometric pattern recognition in terms of robustness and speed while providing greater degrees of freedom," Boriero said.

For 3-D vision, Matrox added a method for extracting and then measuring a cross section from a point cloud, as many profiling applications are solved simply by analyzing cross sections using 2-D metrology. "We also made calibration more practical with the support of a self-describing calibration target and support for partially visible and extended calibration targets," Boriero said.

Because their customers continually request user-friendly products, vision software manufacturers are easing developers' programming burden. Using data-flow models on a graphical user interface (GUI), software from Silicon Software is designed to simplify the programming of application-specific image preprocessing on field-programmable gate array (FPGA) vision processors. The technology allows software and application engineers to program FPGAs without knowledge of VHSIC hardware description language (VHDL), one of the standard languages used to describe digital systems.

"Writing FPGA-based image processing algorithms with VHDL can take months, since modifying algorithms is also a long process," said Mike Faulkner, Silicon Software's director of business development for the Americas. 

Because most of the image preprocessing takes place directly on the FPGA, vision systems achieve real-time results that PC-based image processing cannot and the software not only allows high-speed and low-latency image processing, but also reduces the volume of data to be transmitted and processed and consistently delivers repeatable performance. It also lowers system development costs by greatly accelerating the development cycle.

Matrox Imaging also has released a program geared toward those who do not want to, or cannot, code. They have developed a flowchart-based interactive development environment that aims to "further streamline the process of developing and maintaining a vision application," Boriero said.

Great expectations

The changes in image processing software have been more gradual than grandiose, and despite machine vision customers' growing list of refinements and requirements, the rules of engagement remain the same. "Developers who use a vision library still want, first, access to tools that are robust, fast, and practical," Boriero said.

Not only do developers expect a library's application programming interface to make it easy to join employee tools together through support of various coordinates' reference frames, for example, they also expect a library to help them with the integration and implementation of the rest of the application, such as through graphical image annotation in the operator interface.

"The vision tools themselves need to be ready to deploy, needing little to no adjustments to settings in order to work in specific cases," Boriero said. That said, "Developers do want the comfort of well-thought-out controls, just in case."

Boriero also indicated that developers don't want to code just to try or investigate something. "They want code generation to get them going more quickly when they are ready to proceed with their application," he said.

Ultimately, software manufacturers attuned to their clients' needs will develop solutions that tackle every vision task from the simple to the complex. "While most applications we encounter can be easily solved with our standard tool set, we do encounter plenty of applications that require something unique," Geraghty said.

That could include developing custom algorithms or tool sequences specific to a customer's application, or changing how to interact with customer programs, since some customers have preferred or predefined methods of integrating with third-party applications.

"We try not to overcomplicate the sales process with a la carte ordering, but we also recognize that users want to purchase what they use," Geraghty said.

Winn Hardin is contributing editor for AIA. This article originally appeared on Vision Online. AIA is a part of the Association for Advancing Automation (A3). A3 is a CFE Media content partner. Edited by Chris Vavra, production editor, CFE Media, cvavra@cfemedia.com.



Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
May 2018
Salary and Career Survey, IT and OT convergence, robotic standards and safety, secure circuit protection
April 2018
Cybersecurity best practices, artificial intelligence, robotic additive manufacturing, embedded systems, IIoT integration, energy efficiency
March 2018
Digitalization integration, process sensors, edge computing, fog computing, condition monitoring, and motors
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
May 2018
Salary and Career Survey, IT and OT convergence, robotic standards and safety, secure circuit protection
April 2018
Cybersecurity best practices, artificial intelligence, robotic additive manufacturing, embedded systems, IIoT integration, energy efficiency
March 2018
Digitalization integration, process sensors, edge computing, fog computing, condition monitoring, and motors
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
May 2018
Salary and Career Survey, IT and OT convergence, robotic standards and safety, secure circuit protection
April 2018
Cybersecurity best practices, artificial intelligence, robotic additive manufacturing, embedded systems, IIoT integration, energy efficiency
March 2018
Digitalization integration, process sensors, edge computing, fog computing, condition monitoring, and motors
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me