-
Artificial Intelligence Enabled Material Behavior Prediction
Authors:
Timothy Hanlon,
Johan Reimann,
Monica A. Soare,
Anjali Singhal,
James Grande,
Marc Edgar,
Kareem S. Aggour,
Joseph Vinciquerra
Abstract:
Artificial Intelligence and Machine Learning algorithms have considerable potential to influence the prediction of material properties. Additive materials have a unique property prediction challenge in the form of surface roughness effects on fatigue behavior of structural components. Traditional approaches using finite element methods to calculate stress risers associated with additively built su…
▽ More
Artificial Intelligence and Machine Learning algorithms have considerable potential to influence the prediction of material properties. Additive materials have a unique property prediction challenge in the form of surface roughness effects on fatigue behavior of structural components. Traditional approaches using finite element methods to calculate stress risers associated with additively built surfaces have been challenging due to the computational resources required, often taking over a day to calculate a single sample prediction. To address this performance challenge, Deep Learning has been employed to enable low cycle fatigue life prediction in additive materials in a matter of seconds.
△ Less
Submitted 12 June, 2019;
originally announced June 2019.
-
Improving drug sensitivity predictions in precision medicine through active expert knowledge elicitation
Authors:
Iiris Sundin,
Tomi Peltola,
Muntasir Mamun Majumder,
Pedram Daee,
Marta Soare,
Homayun Afrabandpey,
Caroline Heckman,
Samuel Kaski,
Pekka Marttinen
Abstract:
Predicting the efficacy of a drug for a given individual, using high-dimensional genomic measurements, is at the core of precision medicine. However, identifying features on which to base the predictions remains a challenge, especially when the sample size is small. Incorporating expert knowledge offers a promising alternative to improve a prediction model, but collecting such knowledge is laborio…
▽ More
Predicting the efficacy of a drug for a given individual, using high-dimensional genomic measurements, is at the core of precision medicine. However, identifying features on which to base the predictions remains a challenge, especially when the sample size is small. Incorporating expert knowledge offers a promising alternative to improve a prediction model, but collecting such knowledge is laborious to the expert if the number of candidate features is very large. We introduce a probabilistic model that can incorporate expert feedback about the impact of genomic measurements on the sensitivity of a cancer cell for a given drug. We also present two methods to intelligently collect this feedback from the expert, using experimental design and multi-armed bandit models. In a multiple myeloma blood cancer data set (n=51), expert knowledge decreased the prediction error by 8%. Furthermore, the intelligent approaches can be used to reduce the workload of feedback collection to less than 30% on average compared to a naive approach.
△ Less
Submitted 9 May, 2017;
originally announced May 2017.
-
Knowledge Elicitation via Sequential Probabilistic Inference for High-Dimensional Prediction
Authors:
Pedram Daee,
Tomi Peltola,
Marta Soare,
Samuel Kaski
Abstract:
Prediction in a small-sized sample with a large number of covariates, the "small n, large p" problem, is challenging. This setting is encountered in multiple applications, such as precision medicine, where obtaining additional samples can be extremely costly or even impossible, and extensive research effort has recently been dedicated to finding principled solutions for accurate prediction. Howeve…
▽ More
Prediction in a small-sized sample with a large number of covariates, the "small n, large p" problem, is challenging. This setting is encountered in multiple applications, such as precision medicine, where obtaining additional samples can be extremely costly or even impossible, and extensive research effort has recently been dedicated to finding principled solutions for accurate prediction. However, a valuable source of additional information, domain experts, has not yet been efficiently exploited. We formulate knowledge elicitation generally as a probabilistic inference process, where expert knowledge is sequentially queried to improve predictions. In the specific case of sparse linear regression, where we assume the expert has knowledge about the values of the regression coefficients or about the relevance of the features, we propose an algorithm and computational approximation for fast and efficient interaction, which sequentially identifies the most informative features on which to query expert knowledge. Evaluations of our method in experiments with simulated and real users show improved prediction accuracy already with a small effort from the expert.
△ Less
Submitted 13 July, 2017; v1 submitted 10 December, 2016;
originally announced December 2016.
-
Interactive Elicitation of Knowledge on Feature Relevance Improves Predictions in Small Data Sets
Authors:
Luana Micallef,
Iiris Sundin,
Pekka Marttinen,
Muhammad Ammad-ud-din,
Tomi Peltola,
Marta Soare,
Giulio Jacucci,
Samuel Kaski
Abstract:
Providing accurate predictions is challenging for machine learning algorithms when the number of features is larger than the number of samples in the data. Prior knowledge can improve machine learning models by indicating relevant variables and parameter values. Yet, this prior knowledge is often tacit and only available from domain experts. We present a novel approach that uses interactive visual…
▽ More
Providing accurate predictions is challenging for machine learning algorithms when the number of features is larger than the number of samples in the data. Prior knowledge can improve machine learning models by indicating relevant variables and parameter values. Yet, this prior knowledge is often tacit and only available from domain experts. We present a novel approach that uses interactive visualization to elicit the tacit prior knowledge and uses it to improve the accuracy of prediction models. The main component of our approach is a user model that models the domain expert's knowledge of the relevance of different features for a prediction task. In particular, based on the expert's earlier input, the user model guides the selection of the features on which to elicit user's knowledge next. The results of a controlled user study show that the user model significantly improves prior knowledge elicitation and prediction accuracy, when predicting the relative citation counts of scientific documents in a specific domain.
△ Less
Submitted 16 January, 2017; v1 submitted 7 December, 2016;
originally announced December 2016.
-
Regression with n$\to$1 by Expert Knowledge Elicitation
Authors:
Marta Soare,
Muhammad Ammad-ud-din,
Samuel Kaski
Abstract:
We consider regression under the "extremely small $n$ large $p$" condition, where the number of samples $n$ is so small compared to the dimensionality $p$ that predictors cannot be estimated without prior knowledge. This setup occurs in personalized medicine, for instance, when predicting treatment outcomes for an individual patient based on noisy high-dimensional genomics data. A remaining source…
▽ More
We consider regression under the "extremely small $n$ large $p$" condition, where the number of samples $n$ is so small compared to the dimensionality $p$ that predictors cannot be estimated without prior knowledge. This setup occurs in personalized medicine, for instance, when predicting treatment outcomes for an individual patient based on noisy high-dimensional genomics data. A remaining source of information is expert knowledge, which has received relatively little attention in recent years. We formulate the inference problem of asking expert feedback on features on a budget, propose an elicitation strategy for a simple "small $n$" setting, and derive conditions under which the elicitation strategy is optimal. Experiments on simulated experts, both on synthetic and genomics data, demonstrate that the proposed strategy can drastically improve prediction accuracy.
△ Less
Submitted 6 February, 2017; v1 submitted 20 May, 2016;
originally announced May 2016.
-
Best-Arm Identification in Linear Bandits
Authors:
Marta Soare,
Alessandro Lazaric,
Rémi Munos
Abstract:
We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $θ^*$ and the objective is to return the arm with the largest reward. We characterize the complexity of the problem and introduce sample allocation strategies that pull arms to identify the best arm with a fixed confidence, while minimizing the sample budget. In part…
▽ More
We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $θ^*$ and the objective is to return the arm with the largest reward. We characterize the complexity of the problem and introduce sample allocation strategies that pull arms to identify the best arm with a fixed confidence, while minimizing the sample budget. In particular, we show the importance of exploiting the global linear structure to improve the estimate of the reward of near-optimal arms. We analyze the proposed strategies and compare their empirical performance. Finally, as a by-product of our analysis, we point out the connection to the $G$-optimality criterion used in optimal experimental design.
△ Less
Submitted 4 November, 2014; v1 submitted 22 September, 2014;
originally announced September 2014.
