A fish appetite assessment method based on improved ByteTrack and spatiotemporal graph convolutional network

The appetite of fish significantly influences aquaculture efficiency and fish welfare. However, accurately assessing fish appetite has posed a challenging problem. Currently, the study of fish feeding behaviour relies primarily on the overall information obtained from images of fish schools, often overlooking the distinctive behavioural traits of individual fish. Analysing the behaviour of individual fish is hindered by challenges such as intraclass variation and cross-occlusion within real aquaculture environments. To address these challenges, this paper introduces a novel method for assessing appetite based on individual fish behaviour. The ByteTrack model was improved to enable stable tracking of each fish within a school under complex conditions. Additionally, this paper employs the spatiotemporal graph convolutional neural network (ST-GCN) to extract the movement characteristics of individual fish, facilitating accurate appetite assessment. The experimental results demonstrate that the proposed method achieves 98.47% accuracy in appetite assessment, surpassing the performance of other state-of-the-art methods. This paper provides a new opportunity and effective means for analysing fish behaviour and appetite in intricate environments. •·An appetite assessment method based on YOLOv8-ByteTrack and ST-GCN was proposed.•·The method integrates fish features into spatial-temporal sequences.•·The method prevents data loss caused by fish school stacking.