Standard

Classification of Fruit Flies by Gender in Images Using Smartphones and the YOLOv4-Tiny Neural Network. / Genaev, Mikhail A.; Komyshev, Evgenii G.; Shishkina, Olga D. et al.

In: Mathematics, Vol. 10, No. 3, 295, 01.02.2022.

Research output: Contribution to journal › Article › peer-review

Harvard

Genaev, MA, Komyshev, EG, Shishkina, OD, Adonyeva, NV, Karpova, EK, Gruntenko, NE, Zakharenko, LP, Koval, VS & Afonnikov, DA 2022, 'Classification of Fruit Flies by Gender in Images Using Smartphones and the YOLOv4-Tiny Neural Network', Mathematics, vol. 10, no. 3, 295. https://doi.org/10.3390/math10030295

APA

Genaev, M. A., Komyshev, E. G., Shishkina, O. D., Adonyeva, N. V., Karpova, E. K., Gruntenko, N. E., Zakharenko, L. P., Koval, V. S., & Afonnikov, D. A. (2022). Classification of Fruit Flies by Gender in Images Using Smartphones and the YOLOv4-Tiny Neural Network. Mathematics, 10(3), [295]. https://doi.org/10.3390/math10030295

Vancouver

Genaev MA, Komyshev EG, Shishkina OD, Adonyeva NV, Karpova EK, Gruntenko NE et al. Classification of Fruit Flies by Gender in Images Using Smartphones and the YOLOv4-Tiny Neural Network. Mathematics. 2022 Feb 1;10(3):295. doi: 10.3390/math10030295

Author

Genaev, Mikhail A. ; Komyshev, Evgenii G. ; Shishkina, Olga D. et al. / Classification of Fruit Flies by Gender in Images Using Smartphones and the YOLOv4-Tiny Neural Network. In: Mathematics. 2022 ; Vol. 10, No. 3.

BibTeX

@article{15b53ab8c5984801af1bef9acaf9029a,
title = "Classification of Fruit Flies by Gender in Images Using Smartphones and the YOLOv4-Tiny Neural Network",
abstract = "The fruit fly Drosophila melanogaster is a classic research object in genetics and systems biology. In the genetic analysis of flies, a routine task is to determine the offspring size and gender ratio in their populations. Currently, these estimates are made manually, which is a very time-consuming process. The counting and gender determination of flies can be automated by using image analysis with deep learning neural networks on mobile devices. We proposed an algorithm based on the YOLOv4-tiny network to identify Drosophila flies and determine their gender based on the protocol of taking pictures of insects on a white sheet of paper with a cell phone camera. Three strategies with different types of augmentation were used to train the network. The best performance (F1 = 0.838) was achieved using synthetic images with mosaic generation. Females gender determination is worse than that one of males. Among the factors that most strongly influencing the accuracy of fly gender recognition, the fly{\textquoteright}s position on the paper was the most important. Increased light intensity and higher quality of the device cameras have a positive effect on the recognition accuracy. We implement our method in the FlyCounter Android app for mobile devices, which performs all the image processing steps using the device processors only. The time that the YOLOv4-tiny algorithm takes to process one image is less than 4 s.",
keywords = "Android app, Deep learning, Drosophila melanogaster, Gender, Image analysis, Mobile device, Object detection",
author = "Genaev, {Mikhail A.} and Komyshev, {Evgenii G.} and Shishkina, {Olga D.} and Adonyeva, {Natalya V.} and Karpova, {Evgenia K.} and Gruntenko, {Nataly E.} and Zakharenko, {Lyudmila P.} and Koval, {Vasily S.} and Afonnikov, {Dmitry A.}",
note = "Funding Information: Funding: Part of the work (growing of flies, imaging, dataset curation, and labelling) was funded by Ministry of Science and Higher Education of the Russian Federation, project no. FWNR-2022-0019. Publisher Copyright: {\textcopyright} 2022 by the authors. Licensee MDPI, Basel, Switzerland.",
year = "2022",
month = feb,
day = "1",
doi = "10.3390/math10030295",
language = "English",
volume = "10",
journal = "Mathematics",
issn = "2227-7390",
publisher = "MDPI AG",
number = "3",

}

RIS

TY - JOUR

T1 - Classification of Fruit Flies by Gender in Images Using Smartphones and the YOLOv4-Tiny Neural Network

AU - Genaev, Mikhail A.

AU - Komyshev, Evgenii G.

AU - Shishkina, Olga D.

AU - Adonyeva, Natalya V.

AU - Karpova, Evgenia K.

AU - Gruntenko, Nataly E.

AU - Zakharenko, Lyudmila P.

AU - Koval, Vasily S.

AU - Afonnikov, Dmitry A.

N1 - Funding Information: Funding: Part of the work (growing of flies, imaging, dataset curation, and labelling) was funded by Ministry of Science and Higher Education of the Russian Federation, project no. FWNR-2022-0019. Publisher Copyright: © 2022 by the authors. Licensee MDPI, Basel, Switzerland.

PY - 2022/2/1

Y1 - 2022/2/1

N2 - The fruit fly Drosophila melanogaster is a classic research object in genetics and systems biology. In the genetic analysis of flies, a routine task is to determine the offspring size and gender ratio in their populations. Currently, these estimates are made manually, which is a very time-consuming process. The counting and gender determination of flies can be automated by using image analysis with deep learning neural networks on mobile devices. We proposed an algorithm based on the YOLOv4-tiny network to identify Drosophila flies and determine their gender based on the protocol of taking pictures of insects on a white sheet of paper with a cell phone camera. Three strategies with different types of augmentation were used to train the network. The best performance (F1 = 0.838) was achieved using synthetic images with mosaic generation. Females gender determination is worse than that one of males. Among the factors that most strongly influencing the accuracy of fly gender recognition, the fly’s position on the paper was the most important. Increased light intensity and higher quality of the device cameras have a positive effect on the recognition accuracy. We implement our method in the FlyCounter Android app for mobile devices, which performs all the image processing steps using the device processors only. The time that the YOLOv4-tiny algorithm takes to process one image is less than 4 s.

AB - The fruit fly Drosophila melanogaster is a classic research object in genetics and systems biology. In the genetic analysis of flies, a routine task is to determine the offspring size and gender ratio in their populations. Currently, these estimates are made manually, which is a very time-consuming process. The counting and gender determination of flies can be automated by using image analysis with deep learning neural networks on mobile devices. We proposed an algorithm based on the YOLOv4-tiny network to identify Drosophila flies and determine their gender based on the protocol of taking pictures of insects on a white sheet of paper with a cell phone camera. Three strategies with different types of augmentation were used to train the network. The best performance (F1 = 0.838) was achieved using synthetic images with mosaic generation. Females gender determination is worse than that one of males. Among the factors that most strongly influencing the accuracy of fly gender recognition, the fly’s position on the paper was the most important. Increased light intensity and higher quality of the device cameras have a positive effect on the recognition accuracy. We implement our method in the FlyCounter Android app for mobile devices, which performs all the image processing steps using the device processors only. The time that the YOLOv4-tiny algorithm takes to process one image is less than 4 s.

KW - Android app

KW - Deep learning

KW - Drosophila melanogaster

KW - Gender

KW - Image analysis

KW - Mobile device

KW - Object detection

UR - http://www.scopus.com/inward/record.url?scp=85123210312&partnerID=8YFLogxK

U2 - 10.3390/math10030295

DO - 10.3390/math10030295

M3 - Article

AN - SCOPUS:85123210312

VL - 10

JO - Mathematics

JF - Mathematics

SN - 2227-7390

IS - 3

M1 - 295

ER -

ID: 35303779