5 minute read
John Deere Unveils Fully Autonomous Tractor
Adding full autonomy to the John Deere 8R tractor enables farmers to be more productive and better equipped to feed a growing global population.
by Sara Jensen
ALL IMAGES COURTESY OF JOHN DEERE
Use of the fully autonomous 8R tractor can help farmers overcome labor challenges and remain productive.
At CES 2022, John Deere unveiled its fully autonomous 8R tractor. The company said the machine is ready for large-scale production and will be available for customers later in 2022.
Joseph Liefer, Senior Product Manager for Autonomy, John Deere Intelligent Solutions Group, says the company built upon the technologies it already had in the market to develop the autonomous machine. “We’re building on the shoulders of giants. We started with a production 8R that was nearly autonomous ready [as well as] our precision ag components [such as] our Starfire receivers and our GPS network that farmers have been leveraging for 20 years,” he explains. “We had a great base to start from.”
Liefer says John Deere became serious about bringing in-field autonomy to the farm in late 2018. It created a team to tackle the many challenges associated with doing so, the largest of which is perception. Perceiving the environment around the tractor and finding any possible exceptions is key to ensure safe operation.
By weaving together close to 70 of the company’s precision agriculture products—such as auto track and auto track turn automation—into a single seamless experience, as well as the addition of some new technology, Liefer says John Deere was able to create the autonomous tractor.
Leveraging new and existing technology makes autonomy possible
John Deere has spent the last couple of years working with farmers to get field images so it could train the neural
Farmers can remotely monitor and set parameters for the autonomous 8R tractor using a mobile device.
network of the autonomous system to recognize navigable terrain. Doing so enables the system to understand what a farm field looks like as well as any exceptions that might exist.
During this process the company had to determine what sensors to utilize to ensure accurate sensing and data collection. It selected stereo cameras because of their ability to predict depth while bringing a low-cost solution to the market, says Liefer. Six pairs of stereo cameras are included on the autonomous 8R tractor which can provide a 360-degree view around the machine and aid with obstacle detection.
The cameras are one of the new pieces of technology mounted onto the 8R to enable autonomous opera-
tion. Three pairs of stereo cameras are located on the front of the tractor and three pairs at the back. This allows full visibility around the tractor as well as of the implement behind it while also determining how close the machine might be to other objects such as a telephone pole or treeline which Liefer says is the truly unique aspect of the cameras.
These cameras are continuously assessing the environment around them at a rate of three times per second. Information collected is then fed to two NVIDIA graphics processing units (GPU) for analysis of any potential anomalies or exceptions which may have entered the environment. “If we think there is something in the scene, it takes about 100 milliseconds for us to process it,” explains Liefer. “We will request a stop to the tractor, and the tractor software will know what to do to bring the tractor to a stop, and then allow further analysis of that entire environment around [the tractor].”
If there is no issue, the tractor will automatically restart and continue its work. But if a problem or large obstacle is detected, the machine will stop and notify the farmer by providing a picture of the obstacle; the farmer can then make an operational decision on how to proceed.
“That kind of remote management is also something new that we’re bringing to farmers,” says Liefer. “We are leveraging the existing John Deere operation center mobile application that farmers use today to manage their operation. And then they’ll be able to do additional things like approve motion for autonomy off of their cell phone, as well as then make settings adjustments, like change the speed of the tractor remotely, whether they’re back at their farm site or doing some other activity.”
The number one piece of feedback Liefer says he’s received from farmers is their excitement over the autonomous machine and the fact it is an 8R which many already have in their fleet. This ensures familiarity when using the tractor, simplifying any learning curves that might be necessary.
Liefer says the autonomous driving solution is a retrofit option, meaning customers will not have to go out and buy a whole new tractor or a potentially more costly purpose-built machine. “[Farmers] are going to get to leverage existing equipment and existing farming practices to bring autonomy to their farm,” he says.
With the autonomous 8R tractor, farmers will still have to manually drive the tractor to the fields in which it will operate. Once in the field, the tractor can then operate fully autonomously, allowing farmers to focus on other tasks and remotely monitor the tractor from a smart phone, tablet or computer. Farmers also have the option to manually drive the tractor when they want to and use the precision ag technologies they would today. Essentially, the new autonomous solution provides more flexibility for customers.
Farmers will work with their John Deere dealer to have the autonomous driving solution installed. In addition to installing the cameras and some wiring harnesses, the dealer will also install some other components such as a redundant braking system which Liefer says is existing technology the company sells in Europe but is not as common in North America. He notes it takes around 8 hours to equip the tractor for fully autonomous operation.
Read an extended version at oemoh.co/JDAutonomousTractor. |
Six pairs of stereo cameras are placed at the front and rear of the autonomous 8R tractor for 360-degree visibility and object detection.
SENSORS FOR MOBILE MACHINES
Stroke measurement in hydraulic cylinders – no piston-rod rifl e boring required! Robust rotary encoders for safe angle and speed measurement! Up to PLd! Draw Wire-actuated rotary encoders for position measurement utilizing proven technology! Inclinometers for non-contact measurement of vehicle orientation!