-
Plant Doctor: A hybrid machine learning and image segmentation software to quantify plant damage in video footage
Authors:
Marc Josep Montagut Marques,
Liu Mingxin,
Kuri Thomas Shiojiri,
Tomika Hagiwara,
Kayo Hirose,
Kaori Shiojiri,
Shinjiro Umezu
Abstract:
Artificial intelligence has significantly advanced the automation of diagnostic processes, benefiting various fields including agriculture. This study introduces an AI-based system for the automatic diagnosis of urban street plants using video footage obtained with accessible camera devices. The system aims to monitor plant health on a day-to-day basis, aiding in the control of disease spreading i…
▽ More
Artificial intelligence has significantly advanced the automation of diagnostic processes, benefiting various fields including agriculture. This study introduces an AI-based system for the automatic diagnosis of urban street plants using video footage obtained with accessible camera devices. The system aims to monitor plant health on a day-to-day basis, aiding in the control of disease spreading in urban areas. By combining two machine vision algorithms, YOLOv8 and DeepSORT, the system efficiently identifies and tracks individual leaves, extracting the optimal images for health analysis. YOLOv8, chosen for its speed and computational efficiency, locates leaves, while DeepSORT ensures robust tracking in complex environments. For detailed health assessment, DeepLabV3Plus, a convolutional neural network, is employed to segment and quantify leaf damage caused by bacteria, pests, and fungi. The hybrid system, named Plant Doctor, has been trained and validated using a diverse dataset including footage from Tokyo urban plants. The results demonstrate the robustness and accuracy of the system in diagnosing leaf damage, with potential applications in large scale urban flora illness monitoring. This approach provides a non-invasive, efficient, and scalable solution for urban tree health management, supporting sustainable urban ecosystems.
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
Examining the Factors of Place Sameness: A Classroom Re-creation Task in a Virtual Environment
Authors:
Saizo Aoyagi,
Satoshi Fukumori,
Kenji Hirose,
Takayoshi Kitamura
Abstract:
Virtual re-creations of real-world places are attractive and becoming more popular. Attractiveness of re-created place is commonly determined by the degree of visual similarity to the original places. Even if the re-creation has poor similarity to the original, there are cases in which people recognize and allow the re-creation to have similarity as the same entity. However, the mechanisms and fac…
▽ More
Virtual re-creations of real-world places are attractive and becoming more popular. Attractiveness of re-created place is commonly determined by the degree of visual similarity to the original places. Even if the re-creation has poor similarity to the original, there are cases in which people recognize and allow the re-creation to have similarity as the same entity. However, the mechanisms and factors behind this contradiction have not yet been studied. This is the first study focusing on the activity and meaningofpeoplewhentheyfeelsamenesstoare-createdplace. Thispaper investigates the concept of place sameness, which is defined as the degree of similarity between an original and a virtual re-creation that represents the original place. Further, the factors of place sameness are explored using a classroom re-creation task with virtual reality (VR) technology. The participants were instructed to recreate two classrooms within virtual environmentsusingvirtualfixtures. Asresults, thedisplaydevicesinRoom B, the student desks in Room A at the memory index, display devices in RoomA,andstudentdesksandothersinRoomBattheaveragedistancehad moderate or large correlations with the place sameness index. The results suggest that the reproducibility of the number of objects related to activities in a place, and the inaccuracy of the positions of objects are factors of place sameness. Our own interpretation of the uncanny valley effect of a place was also partially observed. The main contributions of this study are the proposal of the concept of place sameness as a new perspective for virtual re-creation research and the finding of promising factors for that.
△ Less
Submitted 8 May, 2023;
originally announced May 2023.
-
CASA-Based Speaker Identification Using Cascaded GMM-CNN Classifier in Noisy and Emotional Talking Conditions
Authors:
Ali Bou Nassif,
Ismail Shahin,
Shibani Hamsa,
Nawel Nemmour,
Keikichi Hirose
Abstract:
This work aims at intensifying text-independent speaker identification performance in real application situations such as noisy and emotional talking conditions. This is achieved by incorporating two different modules: a Computational Auditory Scene Analysis CASA based pre-processing module for noise reduction and cascaded Gaussian Mixture Model Convolutional Neural Network GMM-CNN classifier for…
▽ More
This work aims at intensifying text-independent speaker identification performance in real application situations such as noisy and emotional talking conditions. This is achieved by incorporating two different modules: a Computational Auditory Scene Analysis CASA based pre-processing module for noise reduction and cascaded Gaussian Mixture Model Convolutional Neural Network GMM-CNN classifier for speaker identification followed by emotion recognition. This research proposes and evaluates a novel algorithm to improve the accuracy of speaker identification in emotional and highly-noise susceptible conditions. Experiments demonstrate that the proposed model yields promising results in comparison with other classifiers when Speech Under Simulated and Actual Stress SUSAS database, Emirati Speech Database ESD, the Ryerson Audio-Visual Database of Emotional Speech and Song RAVDESS database and the Fluent Speech Commands database are used in a noisy environment.
△ Less
Submitted 11 February, 2021;
originally announced February 2021.
-
Fast and robust multiplane single molecule localization microscopy using deep neural network
Authors:
Toshimitsu Aritake,
Hideitsu Hino,
Shigeyuki Namiki,
Daisuke Asanuma,
Kenzo Hirose,
Noboru Murata
Abstract:
Single molecule localization microscopy is widely used in biological research for measuring the nanostructures of samples smaller than the diffraction limit. This study uses multifocal plane microscopy and addresses the 3D single molecule localization problem, where lateral and axial locations of molecules are estimated. However, when we multifocal plane microscopy is used, the estimation accuracy…
▽ More
Single molecule localization microscopy is widely used in biological research for measuring the nanostructures of samples smaller than the diffraction limit. This study uses multifocal plane microscopy and addresses the 3D single molecule localization problem, where lateral and axial locations of molecules are estimated. However, when we multifocal plane microscopy is used, the estimation accuracy of 3D localization is easily deteriorated by the small lateral drifts of camera positions. We formulate a 3D molecule localization problem along with the estimation of the lateral drifts as a compressed sensing problem, A deep neural network was applied to accurately and efficiently solve this problem. The proposed method is robust to the lateral drifts and achieves an accuracy of 20 nm laterally and 50 nm axially without an explicit drift correction.
△ Less
Submitted 7 January, 2020;
originally announced January 2020.
