CottonSim: A Vision-Guided Autonomous Robotic System for Cotton Harvesting in Gazebo Simulation

ORCID

Xin Zhang: https://orcid.org/0000-0001-9654-3859; Wijewardane: https://orcid.org/0000-0001-8962-9451

MSU Affiliation

College of Agriculture and Life Sciences; Department of Agricultural and Biological Engineering; James Worth Bagley College of Engineering; Department of Computer Science and Engineering; Center for Advanced Vehicular Systems

Creation Date

2026-06-30

Abstract

Cotton is a major cash crop in the United States, with the country being a leading global producer and exporter. Nearly all U.S. cotton is grown in the Cotton Belt, spanning 17 states in the southern region. Harvesting remains a critical yet challenging stage, impacted by the use of costly, environmentally harmful defoliants and heavy, expensive cotton pickers. These factors contribute to yield loss, reduced fiber quality, and soil compaction, which collectively threaten long-term sustainability. To address these issues, this study proposes a lightweight, small-scale, vision-guided autonomous robotic cotton picker as an alternative. An autonomous system, built on Clearpath's Husky platform and integrated with the Cotton-Eye perception system, was developed and tested in the Gazebo simulation environment. A virtual cotton field was designed to facilitate autonomous navigation testing. The navigation system used Global Positioning System (GPS) and map-based guidance, assisted by an RGB-depth camera and a YOLOv8n-seg instance segmentation model. The model achieved a mean Average Precision (mAP) of 85.2%, recall of 88.9%, and precision of 93.0%. The GPS-based approach reached a 100% completion rate (CR) within a (5e-6)° threshold, while the map-based method achieved a 96.7% CR within a 0.25 m threshold. The developed Robot Operating System (ROS) packages enable robust simulation of autonomous cotton picking, offering a scalable baseline for future agricultural robotics. CottonSim code and datasets are publicly available on GitHub: https://github.com/imtheva/CottonSim.

Publication Date

10-6-2025

Publication Title

Computers and Electronics in Agriculture

Publisher

Elsevier

Creative Commons License

Creative Commons Attribution 4.0 International License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Rights

© 2025 The Authors

Link to Full Text

Share

COinS
 

Digital Object Identifier (DOI)

https://doi.org/10.1016/j.compag.2025.110963