Application Update: Machine vision saves fruit, by better sizing and sorting
More than 30% of fruits and vegetables are discarded before the grocery store; machine vision used in MAF Roda Agrobotic systems can help reduce waste. Images are processed using the Matrox Imaging Library (MIL) toolkit. The sorting system’s intuitive user interface and 3D display gives operators adjust quality and sorting parameters in real-time. October Control Engineering
Advanced, integrated machine vision systems help identify where if fruits and vegetables should be sold whole or for canning or juices. It is estimated that more than 30% of fruits and vegetables grown for North America consumers are discarded before they reach grocery store shelves because of “cosmetic imperfections.” An apple is too small; a pear is the wrong color or a cucumber is misshapen. Imperfect produce that does manage to reach supermarkets remains unsold for the most part and ultimately ends up in landfill sites. In this era of skyrocketing food costs and global shortages it is in everyone’s best interests – growers, packers, distributors, retailers and consumers – to reduce this waste.
MAF Roda Agrobotic (https://www.maf-roda.com) is a French multi-national that designs and manufactures grading, packing, washing, bagging and palletization systems for fresh fruit and vegetable packing houses. MAF Roda helps packers improve processing efficiency, while ensuring that produce is the correct size, shape and color, as well as being free from defects.
Advances in fruit sizing, sorting
In 1962, MAF Roda began manufacturing mechanical graders in the largest fruit growing area in the southwest region of France. In 1979, Philippe Blanc, a graduate of Ecole Nationale d’Ingénieurs (Tarbes, France), along with ten fellow students, produced the first electronic and automatic grading systems to replace those mechanical graders. Today, MAF Roda has 18 subsidiary companies and 40 agents located in the most abundant food producing regions in the Americas, Europe, Africa and Asia. The family-owned and -operated business is now overseen by a third generation – Philippe Blanc’s five sons. In 2008, MAF Roda annual sales were 90732K€ making it one of the largest manufacturers of fruit and vegetable handling equipment in the world.
MAF Roda designs and manufactures different types of “sizers.” These are conveyors with 1 to 10 parallel lanes and 1 to 64 outlets that process different types of fruit ranging from cherry tomatoes to melons. The number of lanes determines the processing capacity of the machine – 10 to 15 pieces of fruit per second, per lane – and the number of outlets defines the number of categories that the machine can sort.
One of these systems is the MAF Roda Globalscan, a sophisticated, fully automatic vision system that sorts fruit as it moves along a sizer. The system allows packers to accurately grade fruit according to pre-established quality and color criteria to meet market requirements. Processing and packaging costs are reduced as substandard fruit is immediately removed from production batches.
The vision system includes proprietary double sensor CMOS high-resolution cameras (one color and one infrared camera per lane), acquisition boards and LED lighting; 20 color pictures and 20 infrared pictures are taken of each piece of fruit over 100% of its surface as it moves and rotates forward. The vision system can perform optical sizing (equatorial or maximum diameter, volume integration), color sorting (eight different criteria) and detection of external defects on the fruit.
The images are then processed using the Matrox Imaging Library (MIL) toolkit. Binarization and blob analysis are used to separate fruit from its background and to obtain dimensions like Feret diameters and elongation, for example. The HLS (hue, luminosity, saturation) color space conversion and statistical functions are used for color processing. And convolutions and custom-designed algorithms recognize stems and cores, and reject fruit with defects on the skin like black spots or russet. The system’s intuitive user interface, which includes a 3D display, lets operators adjust quality and sorting parameters in real-time. Parameters can be stored for future use. Production managers can use the system to analyze data gathered from the vision system and generate statistics by producer, by orchard or field, by species, or by variety of fruit. Reports provide metrics on the batch of fruit that is being processed including size, weight, diameter, color, and quality.
Off-the-shelf vs. proprietary
Prior to using MIL, MAF Roda engineers developed their own image processing library in C, including optimizations using MMX/SSE instruction sets. Initially the company expressed concerns they would sacrifice performance when then started developing using an off-the-shelf library like MIL, because these tools are designed for a more general use than MAF Roda’s “homemade” functions.
“We were happy to see that MIL functions are very fast and powerful. We can now spend more time on our specific job using MIL functions instead of wasting time writing our own functions from scratch. Plus, the stability of the Matrox Imaging Library is also very good, explains Michel Rodière, electronics department manager at MAF Roda. “MIL definitely helped our productivity. Compared with what we did before, MIL saves programming time and MIL code is easier to read and understand when several programmers work on the same project.”
MAF Roda began evaluating Matrox Imaging Library (MIL) 8 at the end of 2007. The first production machine made its debut November 2008. They have begun the process of moving to MIL 9 to benefit from the native Microsoft .NET development and 64-bit Microsoft Windows support. They are also looking at making use of the color analysis tools available as of MIL 9.
MAF Roda Agrobotic
– Also read from Control Engineering:
– Catherine Overbury is a manager with Matrox Imaging at www.matroximaging.com.