An Overview of the Application of Machine Vision in Recognition and Localization of Fruit and Vegetable Harvesting Robots

doi:10.3390/agriculture13091814

	An Overview of the Application of Machine Vision in Recognition and Localization of Fruit and Vegetable Harvesting Robots
	Hou, Guangyu 2,3; Chen, Haihua 1; Jiang, Mingkun 2,3; Niu, Runxin 3
刊名	AGRICULTURE-BASEL
	2023-09-01
卷号	13
关键词	machine vision fruit and vegetable harvesting robots image recognition visual localization
DOI	10.3390/agriculture13091814
通讯作者	Chen, Haihua(chenhaihua@ict.ac.cn) ; Niu, Runxin(rxniu@iim.ac.cn)
英文摘要	Intelligent agriculture imposes higher requirements on the recognition and localization of fruit and vegetable picking robots. Due to its unique visual information and relatively low hardware cost, machine vision is widely applied in the recognition and localization of fruit and vegetable picking robots. This article provides an overview of the application of machine vision in the recognition and localization of fruit and vegetable picking robots. Firstly, the advantages, disadvantages, and the roles of different visual sensors and machine vision algorithms in the recognition and localization of fruit and vegetable picking robots are introduced, including monocular cameras, stereo cameras, structured light cameras, multispectral cameras, image segmentation algorithms, object detection algorithms, and 3D reconstruction algorithms. Then, the current status and challenges faced by machine vision in the recognition and localization of fruit and vegetable picking robots are summarized. These challenges include the stability of fast recognition under complex background interference, stability of recognition under different lighting environments for the same crop, the reliance of recognition and localization on prior information in the presence of fruit overlap and occlusions caused by leaves and branches, and the uncertainty of picking caused by complex working environments. In current research on algorithms dealing with complex background interference and various occlusion disturbances, good results have been achieved. Different lighting environments have a significant impact on the recognition and positioning of fruits and vegetables, with a minimum accuracy of 59.2%. Finally, this article outlines future research directions to address these challenges.
资助项目	Strategic Priority Research Program of the Chinese Academy of Sciences[XDA28120000] ; Strategic Priority Research Program of the Chinese Academy of Sciences[XDA28040000] ; National Key RD Program[2022YFD2001404-01] ; Natural Science Foundation of Shandong Province[ZR2021MF094] ; Key R&D Plan of Shandong Province[2020CXGC010804] ; Central Leading Local Science and Technology Development Special Fund Project[YDZX2021122] ; Science & Technology Specific Projects in Agricultural High-tech Industrial Demonstration Area of the Yellow River Delta[2022SZX11]
WOS关键词	APPLE DETECTION ; AUTOMATIC RECOGNITION ; INTRINSIC IMAGES ; LITCHI CLUSTERS ; COMPUTER VISION ; ALGORITHM ; SYSTEM ; DECOMPOSITION ; IDENTIFICATION ; EXTRACTION
WOS研究方向	Agriculture
语种	英语
出版者	MDPI
WOS记录号	WOS:001072450700001
资助机构	Strategic Priority Research Program of the Chinese Academy of Sciences ; National Key RD Program ; Natural Science Foundation of Shandong Province ; Key R&D Plan of Shandong Province ; Central Leading Local Science and Technology Development Special Fund Project ; Science & Technology Specific Projects in Agricultural High-tech Industrial Demonstration Area of the Yellow River Delta
内容类型	期刊论文
源URL	[http://ir.hfcas.ac.cn:8080/handle/334002/132483]
专题	中国科学院合肥物质科学研究院
通讯作者	Chen, Haihua; Niu, Runxin
作者单位	1.Chinese Acad Sci, Inst Comp Sci, Beijing 100190, Peoples R China 2.Univ Sci & Technol China, Sci Isl Branch, Hefei 230026, Peoples R China 3.Chinese Acad Sci, Hefei Inst Phys Sci, Hefei 230031, Peoples R China
推荐引用方式 GB/T 7714	Hou, Guangyu,Chen, Haihua,Jiang, Mingkun,et al. An Overview of the Application of Machine Vision in Recognition and Localization of Fruit and Vegetable Harvesting Robots[J]. AGRICULTURE-BASEL,2023,13.
APA	Hou, Guangyu,Chen, Haihua,Jiang, Mingkun,&Niu, Runxin.(2023).An Overview of the Application of Machine Vision in Recognition and Localization of Fruit and Vegetable Harvesting Robots.AGRICULTURE-BASEL,13.
MLA	Hou, Guangyu,et al."An Overview of the Application of Machine Vision in Recognition and Localization of Fruit and Vegetable Harvesting Robots".AGRICULTURE-BASEL 13(2023).