This study presents TomatoBot, a semi-autonomous agricultural robot designed for tomato detection, navigation, and harvesting. The system integrates computer vision, semantic understanding, and robotic manipulation to address labor-intensive tomato harvesting tasks. TomatoBot detects and classifies tomatoes into six categories using a custom-trained YOLOv8 model and performs navigation by identifying crop lanes and following a computed centerline. Environmental understanding is achieved through semantic segmentation of soil, crop, and background classes using a U-Net with FCN and a ResNet50 backbone. Lane centerlines are estimated using a Deep Hough Transformer with a MobileNetV2 backbone, where geometric interpolation is applied to generate a stable navigation path. The robot is controlled by a Raspberry Pi 4 and equipped with a 6-DOF robotic arm driven by inverse kinematics for tomato plucking. A mobile application enables real-time monitoring and semi-manual interaction. Experimental results demonstrate a mean average precision (mAP@50) of 88.1% for tomato detection, an overall pixel accuracy of 96.11% for semantic segmentation, and an F-measure of 90.45% for semantic line detection, resulting in improved navigation stability. Overall, TomatoBot demonstrates the feasibility of combining lightweight AI models with robotic manipulation for precision farming and provides a scalable foundation for future autonomous agricultural systems.
목차
Abstract 1. Introduction 2. Related Works 3. Methodology 3.1 Tomato Detection 3.2 TomatoBot Navigation 3.3 Robotic System Hardware 3.4 Robotic System Software 4. Results and Discussion 4.1 Tomato Detection Results 4.2 Semantic Segmentation Result 4.3 Line Detection Result 5. Conclusion References
키워드
Tomato detectionrobotic harvestingcenterline estimationcomputer vision in agricultureprecision agriculture.
저자
Ashish Gupta [ Department of Artificial Intelligence, School of Engineering, Kathmandu University, Nepal ]
Rubina Dango Maharjan [ Department of Artificial Intelligence, School of Engineering, Kathmandu University, Nepal ]
Sandesh Thakuri [ Department of Artificial Intelligence, School of Engineering, Kathmandu University, Nepal ]
Yagya Raj Pandeya [ Department of Artificial Intelligence, School of Engineering, Kathmandu University, Nepal/Artificial Intelligence and Smart System Research laboratory, Kathmandu University, Nepal/Global Society for Advanced Research and Punlication, Kathmandu, Nepa/Guru Technology Pvt. Ltd., Kathmandu, Nepal ]
Corresponding Author
한국AI디지털융합학회(구 한국디지털융합학회) [The Korean Academic Society of AI Digital Convergence]
설립연도
2015
분야
사회과학>경영학
소개
본 학회는 디지털 경영에 관련된 디지털 미디어, 디지털 통신, 디지털 방송, 디지털 콘텐츠, 디지털 문화, 디지털 사회, 디지털 유통, 디지털 금융, 디지털 물류, 디지털 정책, 디지털 기술, 디지털 교육 그리고 디지털과 아날로그의 비교 등에 대한 학제간 연구와 실사구시적인 적용을 통하여 디지털 경영의 발전과 한국이 세계적인 디지털 강국으로 성장하기 위한 학술적인 기반과 실무적인 지침을 조성하는 것을 목적으로 하고 있습니다.
간행물
간행물명
IJICTDC [International Journal of Information Communication Technology and Digital Convergence]