An Extended Method Based on the Geometric Position of Salient Image Features: Solving the Dataset Imbalance Problem in Greenhouse Tomato Growing Scenarios

Machine vision has significant advantages in a wide range of agricultural applications; however, acquiring a large number of high-quality image resources is often challenging in actual agricultural production due to environmental and equipment conditions. Therefore, crop image augmentation techniques are particularly important in crop growth analysis. In this paper, greenhouse tomato plants were used as research subjects to collect images of their different fertility stages with flowers and fruits. Due to the different durations of each fertility period, there is a significant difference in the number of images collected. For this reason, this paper proposes a method for balanced amplification of significant feature information in images based on geometric position. Through the geometric position information of the target in the image, different segmentation strategies are used to process the image and supervised and unsupervised methods are applied to perform balanced augmentation of the image, which is combined with the YOLOv7 algorithm to verify the augmentation effect. In terms of the image dataset, the mixed image dataset (Mix) is supplemented with mobile phone images on top of in situ monitoring images, with precision increased from 70.33% to 82.81% and recall increased from 69.15% to 81.25%. In terms of image augmentation, after supervised balanced amplification, the detection accuracy is improved from 70.33% to 77.29%, which is suitable for supervised balanced amplification. For the mobile phone dataset (MP), after amplification, it was found that better results could be achieved without any amplification method. The detection accuracy of the mixed dataset with different data sources matching the appropriate amplification method increased slightly from 82.81% to 83.59%, and accurate detection could be achieved when the target was shaded by the plant, and in different environments and light conditions.