Bayesian models are better than frequentist models in identifying differences in small datasets comprising phonetic data
Authors:
Georgios P. Georgiou
Abstract:
While many studies have previously conducted direct comparisons between results obtained from frequentist and Bayesian models, our research introduces a novel perspective by examining these models in the context of a small dataset comprising phonetic data. Specifically, we employed mixed-effects models and Bayesian regression models to explore differences between monolingual and bilingual populati…
▽ More
While many studies have previously conducted direct comparisons between results obtained from frequentist and Bayesian models, our research introduces a novel perspective by examining these models in the context of a small dataset comprising phonetic data. Specifically, we employed mixed-effects models and Bayesian regression models to explore differences between monolingual and bilingual populations in the acoustic values of produced vowels. Our findings revealed that Bayesian hypothesis testing exhibited superior accuracy in identifying evidence for differences compared to the posthoc test, which tended to underestimate the existence of such differences. These results align with a substantial body of previous research highlighting the advantages of Bayesian over frequentist models, thereby emphasizing the need for methodological reform. In conclusion, our study supports the assertion that Bayesian models are more suitable for investigating differences in small datasets of phonetic and/or linguistic data, suggesting that researchers in these fields may find greater reliability in utilizing such models for their analyses.
△ Less
Submitted 2 December, 2023;
originally announced December 2023.
Detection of developmental language disorder in Cypriot Greek children using a neural network algorithm
Authors:
Georgios P. Georgiou,
Elena Theodorou
Abstract:
Children with developmental language disorder (DLD) encounter difficulties in acquiring various language structures. Early identification and intervention are crucial to prevent negative long-term outcomes impacting the academic, social, and emotional development of children. The study aims to develop an automated method for the identification of DLD using artificial intelligence, specifically a n…
▽ More
Children with developmental language disorder (DLD) encounter difficulties in acquiring various language structures. Early identification and intervention are crucial to prevent negative long-term outcomes impacting the academic, social, and emotional development of children. The study aims to develop an automated method for the identification of DLD using artificial intelligence, specifically a neural network machine learning algorithm. This protocol is applied for the first time in a Cypriot Greek child population with DLD. The neural network model was trained using perceptual and production data elicited from 15 children with DLD and 15 healthy controls in the age range of 7;10 until 10;4. The k-fold technique was used to crossvalidate the algorithm. The performance of the model was evaluated using metrics such as accuracy, precision, recall, F1 score, and ROC/AUC curve to assess its ability to make accurate predictions on a set of unseen data. The results demonstrated high classification values for all metrics, indicating the high accuracy of the neural model in classifying children with DLD. Additionally, the variable importance analysis revealed that the language production skills of children had a more significant impact on the performance of the model compared to perception skills. Machine learning paradigms provide effective discrimination between children with DLD and those with TD, with the potential to enhance clinical assessment and facilitate earlier and more efficient detection of the disorder.
△ Less
Submitted 10 February, 2024; v1 submitted 25 November, 2023;
originally announced November 2023.