Embedded vision emphasizes design flexibility, ease of use

Companies focused on embedded vision are responding to customers' demands that are smaller, cheaper, and faster for industrial applications.

06/03/2017


Companies focused on embedded vision are responding to customers' demands that are smaller, cheaper, and faster for industrial applications. Courtesy: AIACall it the trifecta of machine vision. Customers across any number of industries want vision systems that are smaller, cheaper, and more powerful/faster. Embedded vision heeds the call with small cameras and application-specific processing, resulting in a compact system that is big on processing power but low on per-unit cost and energy consumption.

"Embedded vision expands the reach of robust computer vision from industrial applications to areas outside the factory where smaller processors are a better fit than classic PCs," said Matthew Breit, senior consulting engineer and market analyst at Basler Inc. Application examples include portable medical devices, mobile robotics, and passport kiosks.

In order for these applications to come to fruition, manufacturers of embedded vision components are providing flexibility—and the necessary resources—to the embedded system designer or integrator.

"Today if someone is building an embedded vision system, they would buy only the image sensor and task their engineering team with designing the supporting electronics and firmware," Breit said.

That process can be time-consuming, taking weeks, months, and even longer depending on requirements of the project. "Our job is to look at that embedded designer's situation and find ways to make their life easier, such as taking care of the entire image sensor integration inside the camera itself," Breit said.

The Basler dart board-level camera, measuring 27 x 27 mm and weighing 15 g, aims to make a wide range of embedded vision systems possible. The camera offers two interfaces: USB 3.0 and BCON, Basler's proprietary interface based on LVDS (low-voltage differential signaling).

"Besides taking on the sensor integration, BCON allows the embedded system designer to access the camera in a very direct way without the overhead of a PC-style interface like USB 3.0 or Gigabit Ethernet," Breit said. "The result is that instead of handling a raw sensor, the designer can integrate a completely finished camera module as they would do with any other electrical device. The means adding vision with much less effort than before."

The dart is designed for a broad range of applications, including automated license plate reading. "We're also seeing a larger demand for handheld medical devices," Breit said. "It's much easier on the patient to sit next to a doctor with a handheld scanner versus sitting in a large noisy machine."

Furthermore, embedded vision opens the door to applications that once seemed unachievable. "We've all encountered 'dream' applications over the years, whether it's a camera in a refrigerator, or the idea of a prosthetic eyeball. But now some of those dreams are getting closer to becoming reality. Of course, 'bionic eyes' are still down the line, but you can buy the refrigerator today."

He cited the prospect of interactive digital signage. "When a company pays for advertising space at the bus stop, they usually put up a poster and that's the end of it," Breit said. "But imagine the potential of actually engaging the person while they're waiting."

In this scenario, a camera would identify who is looking at the ad and gauge their reactions. Even a few years ago, an application like that would require a PC, cables, and lighting. "But now, since the power of the processors has improved, and the size and the cost of everything has gotten smaller, we're seeing signage like this today in our shopping malls," Breit said.

Flexing the embedded muscle

For the embedded vision systems and smart cameras it develops, Teledyne Dalsa has emphasized flexibility, ease of use, and a small footprint. The GEVA 3000 embedded vision system provides an alternative to standard PC systems for inspection tasks in harsh industrial environments. GEVA, which accommodates Teledyne Dalsa's Genie Nano GigE Vision CMOS area scan camera, offers customers a choice between two application software suites: the wizard-based iNspect for users requiring easy setup, and Sherlock, for end-users who need flexibility in creating a graphical application.

Meanwhile, BOA Spot vision sensors combine Teledyne Dalsa's BOA vision system with integrated LED lighting, lens cover, and software. The resulting system is low cost, quick to set up, and easy to integrate with equipment on the factory floor. Accessible through a simple point-and-click interface, BOA Spot's embedded vision tools enable automated inspection and identification applications.

"Barcode reading is one of the biggest sellers for us, and we have an improved version that runs on BOA Spot," said Bruno Menard, software program manager, smart products division at Teledyne Dalsa. "It is much faster, more robust, and has high read rates."

Deployment of embedded vision systems that use infrared imaging, whether for inspection in a tight industrial space or on a surveillance drone, also is on the rise. In response, Teledyne Dalsa introduced the Calibir uncooled long wave infrared (LWIR) camera, which measures 29 by 29 mm. While Calibir supports GigE Vision output, customers who want to have a different interface like analog or USB3 Vision can use Teledyne's Engine as the front-end architecture and plug into their own backend.

In addition to traditional machine vision division applications, Calibir is being used in outdoor applications that demand a small form factor, including solar panel inspection by an IR camera-equipped drone and night vision for hunting where the camera is mounted on the firearm.

Teledyne is showing customers the opportunities offered by embedded vision at its Imaging Possibility hub. "Smart cameras coupled with Internet of Things (IoT) will bring many possibilities," Menard said. "For homeowners, it might start with remote home surveillance and control."

A hub for developers

Embedded system designers rely on multiple vendors to develop an embedded vision system, but Basler Inc. identified a critical gap within this group. "Whether you're talking about lenses or image processing algorithms, there are hundreds of forums online about individual topics and tools, but we didn't see one place which brings the entire embedded vision community together," Breit said.

Basler took initiative and launched the website ImagingHub.com. Breit calls the agnostic networking platform a one-stop shop without the shop. "The site is designed for embedded engineers specifically looking to 'get vision on board' so to speak, a place where they can see all the different companies supplying components, find project examples that the community has posted, or start their own, and ask a question in the forum" Breit said.

The website, which has been live for almost a year, receives 10,000 visitors a month. "We think it will help make embedded vision easier and more accessible than it currently is," Breit said.

Diving into deep learning

While many embedded vision installations are taking place outside the factory, the technology is finding its stride in some manufacturing applications-key among them robotics. As a turnkey machine vision integrator in 2-D and 3-D applications, Integro Technologies integrates embedded industrial vision that acts as the robot's eyes for tasks such as pick and place, load and unload, and vision-based quality inspection.

"Robot-mounted vision is not embedded to the degree that a driverless car is, but it serves the same purpose with many of the same software tools and can greatly enhance automation capability," said Scott Holbert, sales engineer at Integro Technologies.

Holbert sees another trend that could enhance industrial inspection: deep learning. "The computer is using smarter and smarter algorithms and interfaces to discern what it is looking at," Holbert said. "Machine vision and embedded vision systems, without being programmed like a traditional computer, are learning by example and increasing their accuracy over time."

Unlike traditional machine learning, which relies on manual feature extraction, deep learning in machine and embedded vision learns features directly from images. "Whenever you have a human making a decision based on what they see, it opens you up to a lot of variability," Holbert said. "We have cameras that can see better than the human eye, computers that make decisions very quickly, and systems that continue to learn and outperform humans doing certain tasks."

As cameras continue to shrink in size and cost without sacrificing power, the Embedded Vision Alliance projects a "rapid proliferation of embedded vision technology into many kinds of systems." Because of economies of scale, the automotive, medical, and retail sectors will continue to drive embedded vision development.

The potential for embedded vision is vast, and embedded designers will develop creative and unique solutions as time goes on. "This is the most exciting aspect for me," Breit said. "Imagine if you put the best brushes and paints in the hands of these artists. What masterpieces will we see?" 

Winn Hardin is contributing editor, AIA. This article originally appeared on the AIA website. The AIA is a part of the Association for Advancing Automation (A3). A3 is a CFE Media content partner. Edited by Chris Vavra, production editor, Control Engineering, CFE Media, cvavra@cfemedia.com.

ONLINE extra

See additional stories from A3 linked below.



Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
May 2018
Salary and Career Survey, IT and OT convergence, robotic standards and safety, secure circuit protection
April 2018
Cybersecurity best practices, artificial intelligence, robotic additive manufacturing, embedded systems, IIoT integration, energy efficiency
March 2018
Digitalization integration, process sensors, edge computing, fog computing, condition monitoring, and motors
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
May 2018
Salary and Career Survey, IT and OT convergence, robotic standards and safety, secure circuit protection
April 2018
Cybersecurity best practices, artificial intelligence, robotic additive manufacturing, embedded systems, IIoT integration, energy efficiency
March 2018
Digitalization integration, process sensors, edge computing, fog computing, condition monitoring, and motors
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Engineers' Choice Awards
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by Control Engineering subscribers. Vote now (if qualified)!
System Integrator Giants
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
How to Maximize Factory Automation Efficiency with Low Cost Machine Vision
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Wireless Reliability in Harsh Environments
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
Human Factors and the Impact on Plant Safety
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
May 2018
Salary and Career Survey, IT and OT convergence, robotic standards and safety, secure circuit protection
April 2018
Cybersecurity best practices, artificial intelligence, robotic additive manufacturing, embedded systems, IIoT integration, energy efficiency
March 2018
Digitalization integration, process sensors, edge computing, fog computing, condition monitoring, and motors
Edge Computing
This article collection contains several articles on how today's technologies heap benefits onto an edge-computing architecture such as faster computing, better networking, more memory, smarter analytics, cloud-based intelligence, and lower costs.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
PLCs
Programmable logic controllers (PLCs) represent the logic (decision) part of the control loop of sense, decide, and actuate. Featured articles in this digital report compare PLCs and programmable automation controllers (PACs), industrial PCs, and robotic controllers.
SIDB

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
John O. Ayuk, PE, CFSE, PMP, CAP
Automation Engineer; Wood Group
Doug Baker
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me