John Deere Adds SmartDetect Object Detection System to Utility and Production Class Loaders

Editors note: This article has been updated.

John Deere has added its SmartDetect, an object detection system that enhances overall situational awareness for operators, to select utility-class and production-class wheel loaders.

This summer, John Deere introduced the SmartDetect Field Kits for 444-904 P-Tier and X-Tier models. With safety being a constant concern in the construction industry, the technology aims to provide operators with greater visibility.

“SmartDetect is a crucial addition to our portfolio of precision construction technology solutions, designed to help operators confidently navigate and maximize productivity on busy construction sites,” says Katie Voelliger, product marketing manager. “Safety is a shared responsibility, and we’re excited to continue developing solutions that empower operators to work more safely and effectively.”

How to address job site awareness

Recognizing that operator awareness is critical in reducing accidents, John Deere designed SmartDetect to function as an additional set of eyes for loaders. “With upwards of 40% of wheel loader applications being conducted in reverse, additional visibility to job site surroundings can significantly boost awareness and make for safer operations,” Voelliger says.

Rendering of the 3D perception view that can identify bystanders and obstacles behind the loader.

SmartDetect achieves this awareness through strategically positioned cameras. The system includes stereo cameras that work in pairs, delivering a 3D perception view that can identify bystanders and obstacles behind the loader. The technology is complemented by a secondary G5 display, which provides operators with a live digital feed, along with visual and audible alerts.

“The camera positioning is tailored to increase and enhance a wider field of view,” Voelliger says. “In addition, automotive-style dynamic travel path lines during reverse operations and object classification notifications help keep the operator alert and informed.”

SmartDetect also incorporates machine learning for increased visbility. “We had to develop an AI/CVML (computer vision machine learning) model specifically for the construction environment,” Voelliger says. “This solution relies on images taken from job sites to create real-life learnings. No two job sites are the same, and developing a dataset that performs to our customers’ expectations in various conditions was a significant challenge.”

Another component of SmartDetect is its bystander alarm, designed to grab attention quickly, even in the noisy environment of a job site. “The alarm is unique and distinct, allowing it to cut through the common sounds of construction and alert crew members in real time,” says Voelliger.

Future plans for SmartDetect

Looking ahead, John Deere is looking to expand the SmartDetect system. Voelliger mentioned plans for an Assist feature that would enable the machine to slow down and come to a complete stop when it detects an obstruction. “We anticipate this feature being available in the near future,” she said.

In addition to the Assist feature, John Deere is developing SmartDetect Digital through the John Deere Operations Center. This enhancement will include:

Push notifications for near-miss events.
Event-based near-miss reports and video.
Weekly reports on technology usage and event summaries.
Event heat map summaries to aid in operational optimization and trend analysis.

“Initially, we launched this solution on our loader lineup, but this technology can easily be adapted across several hard iron product lines within our portfolio,” Voelliger says. “Looking ahead, we anticipate expanding this tech offering across our portfolio in the next three to five years.”