Showing 1–13 of 13 results for author: McComb, C

Evaluating Large Language Models for Material Selection

Authors: Daniele Grandi, Yash Patawari Jain, Allin Groom, Brandon Cramer, Christopher McComb

Abstract: Material selection is a crucial step in conceptual design due to its significant impact on the functionality, aesthetics, manufacturability, and sustainability impact of the final product. This study investigates the use of Large Language Models (LLMs) for material selection in the product design process and compares the performance of LLMs against expert choices for various design scenarios. By c… ▽ More Material selection is a crucial step in conceptual design due to its significant impact on the functionality, aesthetics, manufacturability, and sustainability impact of the final product. This study investigates the use of Large Language Models (LLMs) for material selection in the product design process and compares the performance of LLMs against expert choices for various design scenarios. By collecting a dataset of expert material preferences, the study provides a basis for evaluating how well LLMs can align with expert recommendations through prompt engineering and hyperparameter tuning. The divergence between LLM and expert recommendations is measured across different model configurations, prompt strategies, and temperature settings. This approach allows for a detailed analysis of factors influencing the LLMs' effectiveness in recommending materials. The results from this study highlight two failure modes, and identify parallel prompting as a useful prompt-engineering method when using LLMs for material selection. The findings further suggest that, while LLMs can provide valuable assistance, their recommendations often vary significantly from those of human experts. This discrepancy underscores the need for further research into how LLMs can be better tailored to replicate expert decision-making in material selection. This work contributes to the growing body of knowledge on how LLMs can be integrated into the design process, offering insights into their current limitations and potential for future improvements. △ Less

Submitted 23 April, 2024; originally announced May 2024.

Comments: arXiv admin note: text overlap with arXiv:2307.03109 by other authors

Exploring the Capabilities of Large Language Models for Generating Diverse Design Solutions

Authors: Kevin Ma, Daniele Grandi, Christopher McComb, Kosa Goucher-Lambert

Abstract: Access to large amounts of diverse design solutions can support designers during the early stage of the design process. In this paper, we explore the efficacy of large language models (LLM) in producing diverse design solutions, investigating the level of impact that parameter tuning and various prompt engineering techniques can have on the diversity of LLM-generated design solutions. Specifically… ▽ More Access to large amounts of diverse design solutions can support designers during the early stage of the design process. In this paper, we explore the efficacy of large language models (LLM) in producing diverse design solutions, investigating the level of impact that parameter tuning and various prompt engineering techniques can have on the diversity of LLM-generated design solutions. Specifically, LLMs are used to generate a total of 4,000 design solutions across five distinct design topics, eight combinations of parameters, and eight different types of prompt engineering techniques, comparing each combination of parameter and prompt engineering method across four different diversity metrics. LLM-generated solutions are compared against 100 human-crowdsourced solutions in each design topic using the same set of diversity metrics. Results indicate that human-generated solutions consistently have greater diversity scores across all design topics. Using a post hoc logistic regression analysis we investigate whether these differences primarily exist at the semantic level. Results show that there is a divide in some design topics between humans and LLM-generated solutions, while others have no clear divide. Taken together, these results contribute to the understanding of LLMs' capabilities in generating a large volume of diverse design solutions and offer insights for future research that leverages LLMs to generate diverse design solutions for a broad range of design tasks (e.g., inspirational stimuli). △ Less

Submitted 2 May, 2024; originally announced May 2024.

Comments: preprint of journal paper

Data Sco**: Effectively Learning the Evolution of Generic Transport PDEs

Authors: Jiangce Chen, Wenzhuo Xu, Zeda Xu, Noelia Grande Gutiérrez, Sneha Prabha Narra, Christopher McComb

Abstract: Transport phenomena (e.g., fluid flows) are governed by time-dependent partial differential equations (PDEs) describing mass, momentum, and energy conservation, and are ubiquitous in many engineering applications. However, deep learning architectures are fundamentally incompatible with the simulation of these PDEs. This paper clearly articulates and then solves this incompatibility. The local-depe… ▽ More Transport phenomena (e.g., fluid flows) are governed by time-dependent partial differential equations (PDEs) describing mass, momentum, and energy conservation, and are ubiquitous in many engineering applications. However, deep learning architectures are fundamentally incompatible with the simulation of these PDEs. This paper clearly articulates and then solves this incompatibility. The local-dependency of generic transport PDEs implies that it only involves local information to predict the physical properties at a location in the next time step. However, the deep learning architecture will inevitably increase the scope of information to make such predictions as the number of layers increases, which can cause sluggish convergence and compromise generalizability. This paper aims to solve this problem by proposing a distributed data sco** method with linear time complexity to strictly limit the scope of information to predict the local properties. The numerical experiments over multiple physics show that our data sco** method significantly accelerates training convergence and improves the generalizability of benchmark models on large-scale engineering simulations. Specifically, over the geometries not included in the training data for heat transferring simulation, it can increase the accuracy of Convolutional Neural Networks (CNNs) by 21.7 \% and that of Fourier Neural Operators (FNOs) by 38.5 \% on average. △ Less

Submitted 2 May, 2024; originally announced May 2024.

Capturing Local Temperature Evolution during Additive Manufacturing through Fourier Neural Operators

Authors: Jiangce Chen, Wenzhuo Xu, Martha Baldwin, Björn Nijhuis, Ton van den Boogaard, Noelia Grande Gutiérrez, Sneha Prabha Narra, Christopher McComb

Abstract: High-fidelity, data-driven models that can quickly simulate thermal behavior during additive manufacturing (AM) are crucial for improving the performance of AM technologies in multiple areas, such as part design, process planning, monitoring, and control. However, the complexities of part geometries make it challenging for current models to maintain high accuracy across a wide range of geometries.… ▽ More High-fidelity, data-driven models that can quickly simulate thermal behavior during additive manufacturing (AM) are crucial for improving the performance of AM technologies in multiple areas, such as part design, process planning, monitoring, and control. However, the complexities of part geometries make it challenging for current models to maintain high accuracy across a wide range of geometries. Additionally, many models report a low mean square error (MSE) across the entire domain (part). However, in each time step, most areas of the domain do not experience significant changes in temperature, except for the heat-affected zones near recent depositions. Therefore, the MSE-based fidelity measurement of the models may be overestimated. This paper presents a data-driven model that uses Fourier Neural Operator to capture the local temperature evolution during the additive manufacturing process. In addition, the authors propose to evaluate the model using the $R^2$ metric, which provides a relative measure of the model's performance compared to using mean temperature as a prediction. The model was tested on numerical simulations based on the Discontinuous Galerkin Finite Element Method for the Direct Energy Deposition process, and the results demonstrate that the model achieves high fidelity as measured by $R^2$ and maintains generalizability to geometries that were not included in the training process. △ Less

Submitted 4 July, 2023; originally announced July 2023.

Smoothing the Rough Edges: Evaluating Automatically Generated Multi-Lattice Transitions

Authors: Martha Baldwin, Nicholas A. Meisel, Christopher McComb

Abstract: Additive manufacturing is advantageous for producing lightweight components while addressing complex design requirements. This capability has been bolstered by the introduction of unit lattice cells and the gradation of those cells. In cases where loading varies throughout a part, it may be beneficial to use multiple, distinct lattice cell types, resulting in multi-lattice structures. In such stru… ▽ More Additive manufacturing is advantageous for producing lightweight components while addressing complex design requirements. This capability has been bolstered by the introduction of unit lattice cells and the gradation of those cells. In cases where loading varies throughout a part, it may be beneficial to use multiple, distinct lattice cell types, resulting in multi-lattice structures. In such structures, abrupt transitions between unit cell topologies may cause stress concentrations, making the boundary between unit cell types a primary failure point. Thus, these regions require careful design in order to ensure the overall functionality of the part. Although computational design approaches have been proposed, smooth transition regions are still difficult to achieve, especially between lattices of drastically different topologies. This work demonstrates and assesses a method for using variational autoencoders to automate the creation of transitional lattice cells, examining the factors that contribute to smooth transitions. Through computational experimentation, it was found that the smoothness of transition regions was strongly predicted by how closely the endpoints were in the latent space, whereas the number of transition intervals was not a sole predictor. △ Less

Submitted 13 June, 2023; originally announced June 2023.

Comments: 23 Pages, 8 Figures

AircraftVerse: A Large-Scale Multimodal Dataset of Aerial Vehicle Designs

Authors: Adam D. Cobb, Anirban Roy, Daniel Elenius, F. Michael Heim, Brian Swenson, Sydney Whittington, James D. Walker, Theodore Bapty, Joseph Hite, Karthik Ramani, Christopher McComb, Susmit Jha

Abstract: We present AircraftVerse, a publicly available aerial vehicle design dataset. Aircraft design encompasses different physics domains and, hence, multiple modalities of representation. The evaluation of these cyber-physical system (CPS) designs requires the use of scientific analytical and simulation models ranging from computer-aided design tools for structural and manufacturing analysis, computati… ▽ More We present AircraftVerse, a publicly available aerial vehicle design dataset. Aircraft design encompasses different physics domains and, hence, multiple modalities of representation. The evaluation of these cyber-physical system (CPS) designs requires the use of scientific analytical and simulation models ranging from computer-aided design tools for structural and manufacturing analysis, computational fluid dynamics tools for drag and lift computation, battery models for energy estimation, and simulation models for flight control and dynamics. AircraftVerse contains 27,714 diverse air vehicle designs - the largest corpus of engineering designs with this level of complexity. Each design comprises the following artifacts: a symbolic design tree describing topology, propulsion subsystem, battery subsystem, and other design details; a STandard for the Exchange of Product (STEP) model data; a 3D CAD design using a stereolithography (STL) file format; a 3D point cloud for the shape of the design; and evaluation results from high fidelity state-of-the-art physics models that characterize performance metrics such as maximum flight distance and hover-time. We also present baseline surrogate models that use different modalities of design representation to predict design performance metrics, which we provide as part of our dataset release. Finally, we discuss the potential impact of this dataset on the use of learning in aircraft design and, more generally, in CPS. AircraftVerse is accompanied by a data card, and it is released under Creative Commons Attribution-ShareAlike (CC BY-SA) license. The dataset is hosted at https://zenodo.org/record/6525446, baseline models and code at https://github.com/SRI-CSL/AircraftVerse, and the dataset description at https://aircraftverse.onrender.com/. △ Less

Submitted 8 June, 2023; originally announced June 2023.

Comments: The dataset is hosted at https://zenodo.org/record/6525446, baseline models and code at https://github.com/SRI-CSL/AircraftVerse, and the dataset description at https://aircraftverse.onrender.com/

Conceptual Design Generation Using Large Language Models

Authors: Kevin Ma, Daniele Grandi, Christopher McComb, Kosa Goucher-Lambert

Abstract: Concept generation is a creative step in the conceptual design phase, where designers often turn to brainstorming, mindmap**, or crowdsourcing design ideas to complement their own knowledge of the domain. Recent advances in natural language processing (NLP) and machine learning (ML) have led to the rise of Large Language Models (LLMs) capable of generating seemingly creative outputs from textual… ▽ More Concept generation is a creative step in the conceptual design phase, where designers often turn to brainstorming, mindmap**, or crowdsourcing design ideas to complement their own knowledge of the domain. Recent advances in natural language processing (NLP) and machine learning (ML) have led to the rise of Large Language Models (LLMs) capable of generating seemingly creative outputs from textual prompts. The success of these models has led to their integration and application across a variety of domains, including art, entertainment, and other creative work. In this paper, we leverage LLMs to generate solutions for a set of 12 design problems and compare them to a baseline of crowdsourced solutions. We evaluate the differences between generated and crowdsourced design solutions through multiple perspectives, including human expert evaluations and computational metrics. Expert evaluations indicate that the LLM-generated solutions have higher average feasibility and usefulness while the crowdsourced solutions have more novelty. We experiment with prompt engineering and find that leveraging few-shot learning can lead to the generation of solutions that are more similar to the crowdsourced solutions. These findings provide insight into the quality of design solutions generated with LLMs and begins to evaluate prompt engineering techniques that could be leveraged by practitioners to generate higher-quality design solutions synergistically with LLMs. △ Less

Submitted 30 May, 2023; originally announced June 2023.

Comments: Proceedings of the ASME 2023 International Design Engineering Technical Conferences and Computers and Information in Engineering Conferences

Learning to design without prior data: Discovering generalizable design strategies using deep learning and tree search

Authors: Ayush Raina, Jonathan Cagan, Christopher McComb

Abstract: Building an AI agent that can design on its own has been a goal since the 1980s. Recently, deep learning has shown the ability to learn from large-scale data, enabling significant advances in data-driven design. However, learning over prior data limits us only to solve problems that have been solved before and biases data-driven learning towards existing solutions. The ultimate goal for a design a… ▽ More Building an AI agent that can design on its own has been a goal since the 1980s. Recently, deep learning has shown the ability to learn from large-scale data, enabling significant advances in data-driven design. However, learning over prior data limits us only to solve problems that have been solved before and biases data-driven learning towards existing solutions. The ultimate goal for a design agent is the ability to learn generalizable design behavior in a problem space without having seen it before. We introduce a self-learning agent framework in this work that achieves this goal. This framework integrates a deep policy network with a novel tree search algorithm, where the tree search explores the problem space, and the deep policy network leverages self-generated experience to guide the search further. This framework first demonstrates an ability to discover high-performing generative strategies without any prior data, and second, it illustrates a zero-shot generalization of generative strategies across various unseen boundary conditions. This work evaluates the effectiveness and versatility of the framework by solving multiple versions of two engineering design problems without retraining. Overall, this paper presents a methodology to self-learn high-performing and generalizable problem-solving behavior in an arbitrary problem space, circumventing the needs for expert data, existing solutions, and problem-specific learning. △ Less

Submitted 28 November, 2022; originally announced November 2022.

Comments: ASME. J. Mech. Des

Design Strategy Network: A deep hierarchical framework to represent generative design strategies in complex action spaces

Authors: Ayush Raina, Jonathan Cagan, Christopher McComb

Abstract: Generative design problems often encompass complex action spaces that may be divergent over time, contain state-dependent constraints, or involve hybrid (discrete and continuous) domains. To address those challenges, this work introduces Design Strategy Network (DSN), a data-driven deep hierarchical framework that can learn strategies over these arbitrary complex action spaces. The hierarchical ar… ▽ More Generative design problems often encompass complex action spaces that may be divergent over time, contain state-dependent constraints, or involve hybrid (discrete and continuous) domains. To address those challenges, this work introduces Design Strategy Network (DSN), a data-driven deep hierarchical framework that can learn strategies over these arbitrary complex action spaces. The hierarchical architecture decomposes every action decision into first predicting a preferred spatial region in the design space and then outputting a probability distribution over a set of possible actions from that region. This framework comprises a convolutional encoder to work with image-based design state representations, a multi-layer perceptron to predict a spatial region, and a weight-sharing network to generate a probability distribution over unordered set-based inputs of feasible actions. Applied to a truss design study, the framework learns to predict the actions of human designers in the study, capturing their truss generation strategies in the process. Results show that DSNs significantly outperform non-hierarchical methods of policy representation, demonstrating their superiority in complex action space problems. △ Less

Submitted 7 October, 2021; originally announced October 2021.

Comments: Published in Journal of Mechanical Design

Report number: Volume 144 Issue 2

Journal ref: J. Mech. Des. Feb 2022, 144(2): 021404 (12 pages)

Goal-Directed Design Agents: Integrating Visual Imitation with One-Step Lookahead Optimization for Generative Design

Authors: Ayush Raina, Lucas Puentes, Jonathan Cagan, Christopher McComb

Abstract: Engineering design problems often involve large state and action spaces along with highly sparse rewards. Since an exhaustive search of those spaces is not feasible, humans utilize relevant domain knowledge to condense the search space. Previously, deep learning agents (DLAgents) were introduced to use visual imitation learning to model design domain knowledge. This note builds on DLAgents and int… ▽ More Engineering design problems often involve large state and action spaces along with highly sparse rewards. Since an exhaustive search of those spaces is not feasible, humans utilize relevant domain knowledge to condense the search space. Previously, deep learning agents (DLAgents) were introduced to use visual imitation learning to model design domain knowledge. This note builds on DLAgents and integrates them with one-step lookahead search to develop goal-directed agents capable of enhancing learned strategies for sequentially generating designs. Goal-directed DLAgents can employ human strategies learned from data along with optimizing an objective function. The visual imitation network from DLAgents is composed of a convolutional encoder-decoder network, acting as a rough planning step that is agnostic to feedback. Meanwhile, the lookahead search identifies the fine-tuned design action guided by an objective. These design agents are trained on an unconstrained truss design problem that is modeled as a sequential, action-based configuration design problem. The agents are then evaluated on two versions of the problem: the original version used for training and an unseen constrained version with an obstructed construction space. The goal-directed agents outperform the human designers used to train the network as well as the previous objective-agnostic versions of the agent in both scenarios. This illustrates a design agent framework that can efficiently use feedback to not only enhance learned design strategies but also adapt to unseen design problems. △ Less

Submitted 7 October, 2021; originally announced October 2021.

Journal ref: J. Mech. Des. Dec 2021, 143(12): 124501 (6 pages)

Learning to design from humans: Imitating human designers through deep learning

Authors: Ayush Raina, Christopher McComb, Jonathan Cagan

Abstract: Humans as designers have quite versatile problem-solving strategies. Computer agents on the other hand can access large scale computational resources to solve certain design problems. Hence, if agents can learn from human behavior, a synergetic human-agent problem solving team can be created. This paper presents an approach to extract human design strategies and implicit rules, purely from histori… ▽ More Humans as designers have quite versatile problem-solving strategies. Computer agents on the other hand can access large scale computational resources to solve certain design problems. Hence, if agents can learn from human behavior, a synergetic human-agent problem solving team can be created. This paper presents an approach to extract human design strategies and implicit rules, purely from historical human data, and use that for design generation. A two-step framework that learns to imitate human design strategies from observation is proposed and implemented. This framework makes use of deep learning constructs to learn to generate designs without any explicit information about objective and performance metrics. The framework is designed to interact with the problem through a visual interface as humans did when solving the problem. It is trained to imitate a set of human designers by observing their design state sequences without inducing problem-specific modelling bias or extra information about the problem. Furthermore, an end-to-end agent is developed that uses this deep learning framework as its core in conjunction with image processing to map pixel-to-design moves as a mechanism to generate designs. Finally, the designs generated by a computational team of these agents are then compared to actual human data for teams solving a truss design problem. Results demonstrates that these agents are able to create feasible and efficient truss designs without guidance, showing that this methodology allows agents to learn effective design strategies. △ Less

Submitted 2 August, 2019; v1 submitted 26 July, 2019; originally announced July 2019.

Report number: Volume 141 Issue 11

Journal ref: J. Mech. Des, ASME, November 2019

High-resolution, vacuum-ultraviolet absorption spectrum of boron trifluoride

Authors: Patrick P. Hughes, Amy Beasten, Jacob C. McComb, Michael A. Coplan, Alan K. Thompson, Robert E. Vest, Matthew K. Sprague, Karl K. Irikura, Charles W. Clark

Abstract: In the course of investigations of thermal neutron detection based on mixtures of $^{10}$BF$_3$ with other gases, knowledge was required of the photoabsorption cross sections of $^{10}$BF$_3$ for wavelengths between 135 and 205 nm. Large discrepancies in the values reported in existing literature led to the absolute measurements reported in this communication. The measurements were made at the SUR… ▽ More In the course of investigations of thermal neutron detection based on mixtures of $^{10}$BF$_3$ with other gases, knowledge was required of the photoabsorption cross sections of $^{10}$BF$_3$ for wavelengths between 135 and 205 nm. Large discrepancies in the values reported in existing literature led to the absolute measurements reported in this communication. The measurements were made at the SURF III synchrotron radiation facility at the National Institute of Standards and Technology. The measured absorption cross sections vary from 10$^{-20}$ cm$^2$ at 135 nm to less than 10$^{-21}$ cm$^2$ in the region from 165 to 205 nm. Three previously unreported absorption features with resolvable structure were found in the regions 135 to 145 nm, 150 to 165 nm and 190 to 205 nm. Quantum mechanical calculations, using the TD-B3LYP/aug-cc-pVDZ variant of time-dependent density functional theory implemented in Gaussian 09, suggest that the observed absorption features arise from symmetry-changing adiabatic transitions. △ Less

Submitted 17 October, 2014; originally announced October 2014.

Comments: submitted to The Journal of Chemical Physics

Noble gas excimer scintillation following neutron capture in boron thin films

Authors: Jacob C. McComb, Michael A. Coplan, Mohamed al-Sheikhly, Alan K. Thompson, Robert E. Vest, Charles W. Clark

Abstract: Far-ultraviolet (FUV) scintillation signals have been measured in heavy noble gases (argon, krypton, xenon) following boron-neutron capture ($^{10}$B($n,α$)$^7$Li) in $^{10}$B thin films. The observed scintillation yields are comparable to the yields from some liquid and solid neutron scintillators. At noble gas pressures of 107 kPa, the number of photons produced per neutron absorbed following ir… ▽ More Far-ultraviolet (FUV) scintillation signals have been measured in heavy noble gases (argon, krypton, xenon) following boron-neutron capture ($^{10}$B($n,α$)$^7$Li) in $^{10}$B thin films. The observed scintillation yields are comparable to the yields from some liquid and solid neutron scintillators. At noble gas pressures of 107 kPa, the number of photons produced per neutron absorbed following irradiation of a 1200 nm thick $^{10}$B film was 14,000 for xenon, 11,000 for krypton, and 6000 for argon. The absolute scintillation yields from the experimental configuration were calculated using data from (1) experimental irradiations, (2) thin-film characterizations, (3) photomultiplier tube calibrations, and (4) photon collection modeling. Both the boron films and the photomultiplier tube were characterized at the National Institute of Standards and Technology. Monte Carlo modeling of the reaction cell provided estimates of the photon collection efficiency and the transport behavior of $^{10}$B($n,α$)$^7$Li reaction products esca** the thin films. Scintillation yields increased with gas pressure due to increased ionization and excitation densities of the gases from the $^{10}$B($n,α$)$^7$Li reaction products, increased frequency of three-body, excimer-forming collisions, and reduced photon emission volumes (i.e., larger solid angle) at higher pressures. Yields decreased for thicker $^{10}$B thin films due to higher average energy loss of the $^{10}$B($n,α$)$^7$Li reaction products esca** the films. The relative standard uncertainties in the measurements were determined to lie between 14 % and 16 %. The observed scintillation signal demonstrates that noble gas excimer scintillation is promising for use in practical neutron detectors. △ Less

Submitted 24 March, 2014; v1 submitted 19 March, 2014; originally announced March 2014.