|
|
| |
|
|
| 本文已被：浏览 729次 下载 783次 |
码上扫一扫！ |
|
|
| 基于Bytetrack的多目标跟踪算法在斑马鱼毒性行为识别中的应用 |
|
赵海翔,崔鸿武,黄桢铭,王磊,李皓,崔正国,曲克明
|
|
1.上海海洋大学水产与生命学院 上海 201306;2.农业农村部海洋渔业与可持续发展重点实验室
中国水产科学研究院黄海水产研究所 山东 青岛 266071;3.中国海洋大学水产学院 山东 青岛 266003;4.农业农村部海洋渔业与可持续发展重点实验室 中国水产科学研究院黄海水产研究所 山东 青岛 266071;5.浙江海洋大学水产学院 浙江 舟山 316022
|
|
| 摘要: |
| 利用计算机视觉技术识别斑马鱼(Danio rerio)在不同污染物暴露下的行为变化是水质毒性评价的常用方法之一，但传统方法存在效率低、面对遮挡和复杂环境时性能差等缺陷。针对这些问题，本研究使用基于Bytetrack的多目标跟踪算法追踪斑马鱼在4种污染物(Zn、Pb、Cr和苯酚)暴露2 h后的行为变化，对斑马鱼在4种浓度梯度中的平均速度、最大速度、最低速度、平均碰撞次数和行为轨迹等指标进行分析。结果显示，算法的追踪精度、漏检率和检测时间(每300帧)分别能达到90.26%、16.33%和0.19 min，检测时间和精度相比于传统目标检测方法有较大提升。同时，根据污染物不同，该方法能准确识别特定污染物环境中斑马鱼相应的运动状态及轨迹变化，可实现精确识别和实时响应，在鱼类毒性行为识别领域具有重要参考意义。 |
| 关键词: 计算机视觉 多目标跟踪 斑马鱼 行为分析 |
| DOI：10.19663/j.issn2095-9869.20231018001 |
| 分类号: |
| 基金项目: |
|
| Application of a Bytetrack-based, multi-target tracking algorithm for zebrafish toxicity-response behavior recognition |
|
ZHAO Haixiang1,2, CUI Hongwu2, HUANG Zhenming2,3, WANG Lei2,4, LI hao2, CUI Zhengguo5, QU Keming6
|
|
1.College of Fisheries and Life Science, Shanghai Ocean University, Shanghai 201306, China;2.Key Laboratory of
Marine Fisheries and Sustainable Development, Ministry of Agriculture and Rural Affairs, Yellow Sea Fisheries Research Institute,
Chinese Academy of Fishery Sciences, Qingdao 266071, China;3.Fisheries College, Ocean University of China, Qingdao 266003, China;4.Fisheries College, Zhejiang Ocean University, Zhoushan 316022, China;5.Key Laboratory of
Marine Fisheries and Sustainable Development, Ministry of Agriculture and Rural Affairs, Yellow Sea Fisheries Research Institute,
Chinese Academy of Fishery Sciences, Qingdao 266072, China;6.Key Laboratory of
Marine Fisheries and Sustainable Development, Ministry of Agriculture and Rural Affairs, Yellow Sea Fisheries Research Institute,
Chinese Academy of Fishery Sciences, Qingdao 266073, China
|
| Abstract: |
| Petrochemical wastewater contains heavy metals and petroleum-based pollutants and is a major environmental and biological health hazard. Zebrafish are sensitive to water quality changes and can be used as biological indicators for water quality monitoring. The type, concentration, and toxicity of pollutants in the water can be inferred by observing zebrafish survival, behavior, activity, and other parameters. However, the traditional method of monitoring zebrafish toxicity-response behavior by manual observation and analysis is subjective, labor-intensive, and inefficient. Therefore, automating the monitoring and identification of zebrafish toxicity-response behavior using computer vision technology is an important and challenging research goal. The common methods of computer vision technology in zebrafish toxicity-response behavior monitoring and recognition can be divided into three steps: Foreground extraction, target tracking, and behavior analysis. However, there are problems such as sensitivity to light changes, inability to deal with occlusion and overlapping phenomena, and low efficiency. Therefore, the aim of this study was to improve efficiency and detection accuracy in complex situations such as fish shading for the automated and real-time identification of zebrafish toxicity- response behavior. In this study, four typical pollutants (zinc, chromium, lead, and phenol) in petrochemical tail water were selected to experimentally observe the swimming behavior of zebrafish at different concentrations and exposure times. A multi-target tracking technique based on YOLOv8+ Bytetrack was used to extract the characteristic values of zebrafish movements (average velocity, maximum velocity, minimum velocity, and average number of collisions). YOLOv8 is a deep learning-based end-to-end target detection algorithm that enables efficient and accurate target detection. Bytetrack is a multi-target tracking algorithm based on target detection that can achieve real-time target tracking coupled with the use of low-scoring frames in the tracking algorithm for secondary matching, which can effectively optimize the problem of switching IDs due to occlusion in the tracking process. The convolutional neural network Resnet was used to analyze the motion trajectory maps of zebrafish. The bounding box and confidence level output from the YOLOv8 model were inputted into the algorithm to obtain a unique ID and trajectory for each zebrafish. Finally, zebrafish features such as position, speed, number of wall touches, and trajectory were extracted based on the tracking results. The experimental results showed that the algorithm's tracking accuracy, missing rate, and detection time (per 300 frames) reached 90.26%, 16.33%, and 0.19 min, respectively, which represented a considerable improvement in detection time and accuracy over those of traditional target-detection methods. The tracking accuracy of manual labeling was up to 100%, and the monitoring time was 125.62 min, which was 661.16 times greater than that of the multi-target tracking method in this study. Moreover, the detection times of the threshold segmentation-based Kalman filter, SOTMOT-based multi-target tracking, and FairMOT-based multi-target tracking were 3.59, 0.41, and 0.37 min, respectively, representing 18.89-, 2.16-, and 1.95-fold increases over that of the proposed method, and the tracking accuracies were 67.09%, 88.52%, and 90.10%, which represented only 74.32%, 98.07%, and 99.82%, respectively, of the accuracy of this method. Moreover, the missing detection rates were 72.80%, 20.69%, and 26.45%, which were 4.46, 1.27, and 1.62 times greater than the missing detection rate of this method. This method outperforms other multi-target tracking methods (SOTMOT and Deepsort) regarding target-tracking accuracy and precision. Meanwhile, the proposed method can accurately identify the corresponding movement status and trajectory changes in zebrafish based on specific pollutants. An increase and then a decrease in velocity were observed in zebrafish exposed to zinc sulfate and lead acetate as compared to that of the control group. A significant difference (P<0.05) exists between the effects of zinc sulfate and lead acetate on the increase in velocity of zebrafish at the beginning of the exposure. The velocity of zebrafish in the potassium dichromate-exposed group showed a fluctuating trend, with values slightly lower than those of the control group. In contrast, the proportion of abnormal trajectories was significantly higher (P<0.05) than that in the other experimental groups. Under phenol exposure conditions, the velocity of zebrafish tended to fluctuate over a wide range, while the number of wall touches was significantly higher than that in the other experimental groups (P<0.05). At the late stage of exposure, the velocity of zebrafish in zinc sulfate, lead acetate, and potassium dichromate exposure groups gradually stabilized. The velocity of zebrafish under zinc sulfate and lead acetate exposure conditions tended to decrease significantly. In the potassium dichromate group, the velocity of zebrafish under 1 and 2 TU phenol exposure increased sharply and then fluctuated within a certain range, and 4 TU phenol exposure resulted in partial mortality of zebrafish. In summary, the multi-target tracking method can quickly identify the type of pollutant to which zebrafish are exposed by setting thresholds for the speed, number of wall touches, and percentage of abnormal trajectories in zebrafish behavior. This method is simple, effective, performs accurate identification, and determines real-time responses, making it highly valuable for reference in fish toxicity-response behavior identification. |
| Key words: Computer vision Multi-target tracking Zebrafish Behavioral analysis |
|
|
|
|