Neural scaling laws for phenotypic drug discovery
Authors:
Drew Linsley,
John Griffin,
Jason Parker Brown,
Adam N Roose,
Michael Frank,
Peter Linsley,
Steven Finkbeiner,
Jeremy Linsley
Abstract:
Recent breakthroughs by deep neural networks (DNNs) in natural language processing (NLP) and computer vision have been driven by a scale-up of models and data rather than the discovery of novel computing paradigms. Here, we investigate if scale can have a similar impact for models designed to aid small molecule drug discovery. We address this question through a large-scale and systematic analysis…
▽ More
Recent breakthroughs by deep neural networks (DNNs) in natural language processing (NLP) and computer vision have been driven by a scale-up of models and data rather than the discovery of novel computing paradigms. Here, we investigate if scale can have a similar impact for models designed to aid small molecule drug discovery. We address this question through a large-scale and systematic analysis of how DNN size, data diet, and learning routines interact to impact accuracy on our Phenotypic Chemistry Arena (Pheno-CA) benchmark: a diverse set of drug development tasks posed on image-based high content screening data. Surprisingly, we find that DNNs explicitly supervised to solve tasks in the Pheno-CA do not continuously improve as their data and model size is scaled-up. To address this issue, we introduce a novel precursor task, the Inverse Biological Process (IBP), which is designed to resemble the causal objective functions that have proven successful for NLP. We indeed find that DNNs first trained with IBP then probed for performance on the Pheno-CA significantly outperform task-supervised DNNs. More importantly, the performance of these IBP-trained DNNs monotonically improves with data and model scale. Our findings reveal that the DNN ingredients needed to accurately solve small molecule drug development tasks are already in our hands, and project how much more experimental data is needed to achieve any desired level of improvement. We release our Pheno-CA benchmark and code to encourage further study of neural scaling laws for small molecule drug discovery.
△ Less
Submitted 28 September, 2023;
originally announced September 2023.
Instant e-Teaching Framework Model for Live Online Teaching
Authors:
Suhailan Safei,
Mat Atar Mat Amin,
Ahmad Nazari Mohd Rose,
Mohd Nordin Abdul Rahman
Abstract:
Instant e-Teaching is a new concept that supplements e-Teaching and e-Learning environment in providing a full and comprehensive modern education styles. The e-Learning technology depicts the concept of enabling self-learning among students on a certain subject using online reference and materials. While the instant e-teaching requires 'face-to-face' characteristic between teacher and student to s…
▽ More
Instant e-Teaching is a new concept that supplements e-Teaching and e-Learning environment in providing a full and comprehensive modern education styles. The e-Learning technology depicts the concept of enabling self-learning among students on a certain subject using online reference and materials. While the instant e-teaching requires 'face-to-face' characteristic between teacher and student to simultaneously execute actions and gain instant responses. The word instant enhances the e- Teaching with the concept of real time teaching. The challenge to exercise online and instant teaching is not just merely relying on the technologies and system efficiency, but it needs to satisfy the usability and friendliness of the system as to replicate the traditional class environment during the deliveries of the class. For this purpose, an instant e-Teaching framework is been developed that will emulate a dedicated virtual classroom, and primarily designed for synchronous and live sharing of current teaching notes. The model has been demonstrated using a teaching Arabic recitation prototype and evaluated from the professional user profession's perspectives.
△ Less
Submitted 20 June, 2011;
originally announced July 2011.
