文章摘要
基于Bytetrack的多目标跟踪算法在斑马鱼毒性行为识别中的应用
Application of Bytetrack-based Multi-target Tracking Algorithm for Zebrafish Toxic Behavior Recognition
投稿时间:2023-10-18  修订日期:2023-10-30
DOI:
中文关键词: 计算机视觉  多目标跟踪  斑马鱼  行为分析
英文关键词: Computer vision  Multi-target tracking  Zebrafish  Behavioral analysis
基金项目:国家重点研发计划(2022YFD2001701);中国水产科学研究院基本科研业务费(2020TD49)
作者单位邮编
赵海翔上海海洋大学 201306
崔鸿武①* 农业农村部海洋渔业与可持续发展重点实验室 中国水产科学研究院黄海水产研究所 山东 青岛 266071
黄桢铭中国海洋大学 
王磊浙江海洋大学 
李皓农业农村部海洋渔业与可持续发展重点实验室 中国水产科学研究院黄海水产研究所 山东 青岛 
崔正国农业农村部海洋渔业与可持续发展重点实验室 中国水产科学研究院黄海水产研究所 山东 青岛 
曲克明农业农村部海洋渔业与可持续发展重点实验室 中国水产科学研究院黄海水产研究所 山东 青岛 
摘要点击次数: 115
全文下载次数: 0
中文摘要:
      利用计算机视觉技术识别斑马鱼在不同污染物暴露下行为变化是水质毒性评价的常用方法之一,但传统方法存在效率低,面对遮挡和复杂环境时性能差等缺陷。针对这些问题,本研究使用基于Bytetrack的多目标跟踪算法追踪斑马鱼在4种污染物(Zn2+、Pb2+、铬和苯酚)暴露2h后的行为变化,对4种浓度梯度中斑马鱼的平均速度、最大速度、最低速度、平均碰撞次和行为轨迹等指标进行了分析。实验结果表明,算法的追踪精度、漏检率和检测时间(每300帧)分别能达到90.26%、16.33%和0.19min,在检测时间和精度相比于传统目标检测方法有较大提升。同时,根据污染物不同,该方法能够准确识别特定污染物环境中斑马鱼相应的运动状态及轨迹变化,可实现精确识别和实时响应,在鱼类毒性行为识别领域具有重要参考意义。
英文摘要:
      Petrochemical wastewater, which contains heavy metals and petroleum-based pollutants, is a major environmental and health hazard. Zebrafish are sensitive to water quality changes and can be used as biological indicators for water quality monitoring. By observing their number, behavior, activity and other parameters, the type, concentration and toxicity of pollutants in the water can be inferred. However, the traditional method of monitoring zebrafish toxicity behavior by manual observation and analysis is subjective, labor-intensive and inefficient. Therefore, how to automate the monitoring and identification of zebrafish toxicity behavior using computer vision technology is an important and challenging research topic. The common methods of computer vision technology in zebrafish toxicity behavior monitoring and recognition can be divided into three steps: foreground extraction, target tracking and behavior analysis. However, there are problems such as sensitivity to light changes, inability to deal with occlusion and overlapping phenomena, and low efficiency. Therefore, To improve efficiency and detection accuracy in complex situations such as fish shading for automated and real-time identification of zebrafish toxic behavior. In this study, four typical pollutants (zinc, chromium, lead, and phenol) in petrochemical tail water were selected to experimentally observe the swimming behavior of zebrafish at different concentrations and exposure times. A multi-target tracking technique based on YOLOv8+Bytetrack was used to extract the characteristic values of the zebrafish's movements (average velocity, maximum velocity, minimum velocity, average number of collisions). YOLOv8 is a deep learning-based end-to-end target detection algorithm that enables efficient and accurate target detection. Bytetrack is a multi-target tracking algorithm based on target detection, which can achieve real-time target tracking, and at the same time, the use of low-scoring frames for the tracking algorithm for secondary matching, which can effectively optimize the problem of switching ids due to occlusion in the tracking process. The convolutional neural network Resnet was used to analyze the motion trajectory maps of zebrafish. The bounding box and confidence level output from the YOLOv8 model are inputted into the algorithm to obtain a unique ID and trajectory for each zebrafish. Finally, the zebrafish's features such as position, speed, number of wall touches and trajectory are extracted based on the tracking results. The experimental results show that the algorithm's tracking accuracy, leakage rate and detection time (per 300 frames) can reach 90.26%, 16.33% and 0.19min, respectively, which is a big improvement in detection time and accuracy compared with the traditional target detection methods. The manual labeling tracking accuracy is up to 100%, but the monitoring time is 125.62 min, which is 661.16 times of the multi-target tracking method in this study, and the detection time of the threshold segmentation-based Kalman filter, SOTMOT-based multi-target tracking, and FairMOT-based multi-target tracking are 3.59, 0.41, and 0.37 min respectively, which are 18.89 , 2.16, and 1.95 times, but the tracking accuracies are 67.09, 88.52, and 90.10%, which are 74.32%, 98.07%, and 99.82% of the present method, while the leakage detection rates are 72.80%, 20.69%, and 26.45%, which are 4.46, 1.27, and 1.62 times of the present method. This method also outperforms other multi-target tracking methods (SOTMOT and Deepsort) in terms of target tracking accuracy (MOTA) and target tracking precision (MOTP).Meanwhile, according to the different pollutants, the method can accurately identify the corresponding movement status and trajectory changes of zebrafish in the specific pollutant environments. There was an increase and then a decrease in the velocity of zebrafish exposed to zinc sulfate and lead acetate as compared to the control group. There was a significant difference (P<0.05) between the effects of zinc sulfate and lead acetate on the increase in velocity of zebrafish at the beginning of the exposure. The velocity of zebrafish in the potassium dichromate-exposed group showed a fluctuating trend, which was slightly lower than that of the control group, whereas the proportion of abnormal trajectories was significantly higher (P<0.05) compared with the other experimental groups. Under phenol exposure conditions, the velocity of zebrafish tended to fluctuate over a wide range, while the number of wall touches was significantly higher compared to the other experimental groups (P<0.05). At the later stage of exposure, the velocity of zebrafish in zinc sulfate, lead acetate and potassium dichromate exposure groups gradually stabilized. The velocity of zebrafish under zinc sulfate and lead acetate exposure tended to decrease significantly. In the potassium dichromate group, the velocity of zebrafish under 1 and 2 TU phenol exposure increased sharply and then fluctuated within a certain range. 4 TU phenol exposure resulted in partial mortality of zebrafish. In summary, the multi-target tracking method can quickly identify the type of pollutant to which zebrafish are exposed by setting thresholds for the speed, the number of wall touches, and the percentage of abnormal trajectories in zebrafish behavior. This method is not only simple and effective, but also can realize accurate identification and real-time response, which is of great reference significance in the field of fish toxicity behavior identification.
附件
View Fulltext   查看/发表评论  下载PDF阅读器
关闭