Better vision: Hyperspectral imaging technology research grant awarded

To increase the capabilities of robotic, food sorting, and unmanned aerial vehicles (UAV) vision by 10x, state of Montana awarded research funds to Montana State University, Resonon, and Impulse Accelerated Technologies.


Figure 1: Almonds vs. shells take up only part of the visible spectrum. Courtesy: Impulse Accelerated TechnologiesMontana Governor Steve Bullock and Montana Department of Commerce Director Meg O'Leary announced research grant awards for hyperspectral imaging technology. The grants were awarded to for Montana State University, Resonon, and Impulse Accelerated Technologies. "These state-of-the-art projects will significantly and positively impact Montana's opportunities for economic growth," Bullock said. "Through investments in innovative research and commercialization, we're not only supporting cutting-edge projects and jobs today, but we're also helping to define what Montana's economy looks like for years to come."

Hyperspectral imaging refers to the measurement of hundreds colors at a point (pixel) instead of the typical three colors (RGB) that conventional color cameras measure. This means that hyperspectral cameras can generate 100 times the data as conventional color cameras. In applications that process large quantities of hyperspectral data in real time, such as in food sorting, field programmable gate arrays (FPGAs) are required to process the immense amount of data being generated. Impulse Accelerated uses tools enable FPGAs to be programmed at a high level in the C language.

Other applications might include more accurate robotic machine vision and more capable unmanned aerial vehicles (UAVs).

Figure 2: The Montana State Student Team led by Dr. Ross Snider. Courtesy: Impulse Accelerated TechnologiesResonon's current systems use a PC to process the data from their hyperspectral cameras. However, the data cables from the camera to the PC and the CPU itself limit the data processing to a fraction of what the hyperspectral cameras are capable of generating. Currently, the system has a spatial resolution of 640 pixels, 240 colors, and can take pictures at a frame rate of 140 frames/sec. The MSU team demonstrated that an FPGA based system would be capable of a resolution of 2,048 pixels, 512 colors, and a frame rate of 340 frames/sec. The additional resolution would allow for users to notice smaller defects. The additional colors would allow finer gradients of color to be classified and the faster frame rate would allow the sorting to be done much faster. Rand Swanson, president of Resonon, said that this would be valuable in sorting and inspection applications.

The MSU academic team working under Dr. Ross Snider is helping to shift the PC software to run as multiple parallel streaming processes in FPGA hardware. Montana State is using tools and techniques provided by Impulse Accelerated Technologies of Bellevue Washington.

Impulse Accelerated created the tools and also provided engineering assistance to "refactor" the software code into efficient hardware code. The researchers are  trying to increase parallelism and double the processing throughput with each additional processing pipeline. The team goal is a 10x improvement.

"This technology has surprisingly broad application," said Brian Durwood of Impulse. "The same algorithmic architecture that visually sorts shells from almonds can also be used to more quickly scan the sea and 'sort out' a person overboard as differentiated from the surrounding sea, from an automated camera suspended under a Coast Guard plane."

Impulse Accelerated Technologies 

Montana State University 

Resonon Inc. 

- Edited by Chris Vavra, production editor, Control Engineering, CFE Media, See more Control Engineering discrete sensor and vision stories.

No comments
The Engineers' Choice Awards highlight some of the best new control, instrumentation and automation products as chosen by...
The System Integrator Giants program lists the top 100 system integrators among companies listed in CFE Media's Global System Integrator Database.
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
This eGuide illustrates solutions, applications and benefits of machine vision systems.
Learn how to increase device reliability in harsh environments and decrease unplanned system downtime.
This eGuide contains a series of articles and videos that considers theoretical and practical; immediate needs and a look into the future.
Controller programming; Safety networks; Enclosure design; Power quality; Safety integrity levels; Increasing process efficiency
Additive manufacturing benefits; HMI and sensor tips; System integrator advice; Innovations from the industry
Robotic safety, collaboration, standards; DCS migration tips; IT/OT convergence; 2017 Control Engineering Salary and Career Survey
Featured articles highlight technologies that enable the Industrial Internet of Things, IIoT-related products and strategies to get data more easily to the user.
This article collection contains several articles on how automation and controls are helping human-machine interface (HMI) hardware and software advance.
This digital report will explore several aspects of how IIoT will transform manufacturing in the coming years.

Find and connect with the most suitable service provider for your unique application. Start searching the Global System Integrator Database Now!

Infrastructure for natural gas expansion; Artificial lift methods; Disruptive technology and fugitive gas emissions
Mobility as the means to offshore innovation; Preventing another Deepwater Horizon; ROVs as subsea robots; SCADA and the radio spectrum
Future of oil and gas projects; Reservoir models; The importance of SCADA to oil and gas
Automation Engineer; Wood Group
System Integrator; Cross Integrated Systems Group
Jose S. Vasquez, Jr.
Fire & Life Safety Engineer; Technip USA Inc.
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me