top of page

Meet GIGAS, The Robot Using AI To Pick Tomatoes

At Dr Medhat Moussa's laboratory in the University of Guelph's School of Engineering, a yellow-armed robot stands on a platform facing a model tomato plant. It cranes toward the tomato when the start button is clicked.

The robot examines the plant with embedded cameras, tilting its head as if "thinking" with its machine vision algorithm. It grabs the tomato with finger-like grippers and sets the product perfectly into a bin.

This latest iteration of Guelph Intelligent Greenhouse Automation System (GIGAS), a smart robot developed at The Robotics Institute @ Guelph, harvests tomatoes using AI-powered vision and an innovative gripping system. It uses deep learning and an image database to identify the tomato amidst environmental obstacles and to figure out how to grab it from the vine.

The U of G-developed technology was recently showcased to Ontario Premier Doug Ford and Ontario Minister of Colleges and Universities Jill Dunlop, who heard how GIGAS's automation power could soon support difficult greenhouse working conditions and agricultural labor shortages.

The need for advanced agriculture technology is critical. A recent report from the Canadian Agriculture Human Resource Council predicts that one-third of the agricultural workforce will retire by 2030, leaving more than 100,000 jobs needing to be filled.

Innovative technology, according to the report, could be a crucial solution to tackling this chronic labor shortage, and the University of Guelph is leading the charge.

"I would say U of G is ahead in smart robotics for greenhouses and harvesting," project lead Moussa says. "We started this project in 2010. Now, we're ahead of other universities and even industry. This is a very challenging problem, and you'd be hard-pressed to find a robot that's actually being sold for this application."

"No other research lab that we know of is working on robotics for beefsteak tomatoes, which are generally the most difficult to work with," Tarry adds. "The robots closest to commercialization work with cherry tomatoes or cucumbers."

It could be trained to harvest other vegetables, such as peppers and cucumbers. Those are the other two major crops in Leamington, Ont., where this project was first inspired by growers who urged the development of automated solutions.

Other iterations of GIGAS focused on the detection of plant diseases. The technology learns from image datasets that include healthy and diseased leaf shapes to identify a disease and quantify how severe it is. This could pick up on early signs of diseases, a critical skill in an environment like tomato greenhouses.

Catching early signs of disease could reduce the cost of treatment and the amount of chemicals used. It could ultimately save other produce from diseases that can spread and destroy entire crops.

GIGAS could also be used in the manufacturing industry one day, especially as two local Guelph automotive plants have used the technology before. In these applications, the GIGAS AI engine helps identify various hard-to-see manufacturing defects or enables robotics to pick and place solutions for fragile and irregular parts.

Supporting labour shortages and efficiencies is always top of mind for the team. Moussa adds that they're always seeking projects that add economic value.

Moussa and his team hope to bring GIGAS out to greenhouses for long-term field testing next. There, they can collect critical data points needed to strengthen the robot's AI learning and validate the value proposition, bringing it a step closer to commercialization.

Testing will help them find the sweet spot where GIGAS becomes fast and cheap enough to compete with rising labor costs.

"Humans take four to five seconds to harvest a tomato, whereas GIGAS currently takes 15 seconds," research associate Cole Tarry says. "We're hoping to cut that down to eight seconds. Assuming robots can work longer hours and you could have multiple robots, that could be game-changing."

Source: Agritech Future


bottom of page