-
Measuring the Energy Consumption and Efficiency of Deep Neural Networks: An Empirical Analysis and Design Recommendations
Authors:
Charles Edison Tripp,
Jordan Perr-Sauer,
Jamil Gafur,
Amabarish Nag,
Avi Purkayastha,
Sagi Zisman,
Erik A. Bensen
Abstract:
Addressing the so-called ``Red-AI'' trend of rising energy consumption by large-scale neural networks, this study investigates the actual energy consumption, as measured by node-level watt-meters, of training various fully connected neural network architectures. We introduce the BUTTER-E dataset, an augmentation to the BUTTER Empirical Deep Learning dataset, containing energy consumption and perfo…
▽ More
Addressing the so-called ``Red-AI'' trend of rising energy consumption by large-scale neural networks, this study investigates the actual energy consumption, as measured by node-level watt-meters, of training various fully connected neural network architectures. We introduce the BUTTER-E dataset, an augmentation to the BUTTER Empirical Deep Learning dataset, containing energy consumption and performance data from 63,527 individual experimental runs spanning 30,582 distinct configurations: 13 datasets, 20 sizes (number of trainable parameters), 8 network ``shapes'', and 14 depths on both CPU and GPU hardware collected using node-level watt-meters. This dataset reveals the complex relationship between dataset size, network structure, and energy use, and highlights the impact of cache effects. We propose a straightforward and effective energy model that accounts for network size, computing, and memory hierarchy. Our analysis also uncovers a surprising, hardware-mediated non-linear relationship between energy efficiency and network design, challenging the assumption that reducing the number of parameters or FLOPs is the best way to achieve greater energy efficiency. Highlighting the need for cache-considerate algorithm development, we suggest a combined approach to energy efficient network, algorithm, and hardware design. This work contributes to the fields of sustainable computing and Green AI, offering practical guidance for creating more energy-efficient neural networks and promoting sustainable AI.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
-
A Machine Learning Method for Predicting Traffic Signal Timing from Probe Vehicle Data
Authors:
Juliette Ugirumurera,
Joseph Severino,
Erik A. Bensen,
Qichao Wang,
Jane Macfarlane
Abstract:
Traffic signals play an important role in transportation by enabling traffic flow management, and ensuring safety at intersections. In addition, knowing the traffic signal phase and timing data can allow optimal vehicle routing for time and energy efficiency, eco-driving, and the accurate simulation of signalized road networks. In this paper, we present a machine learning (ML) method for estimatin…
▽ More
Traffic signals play an important role in transportation by enabling traffic flow management, and ensuring safety at intersections. In addition, knowing the traffic signal phase and timing data can allow optimal vehicle routing for time and energy efficiency, eco-driving, and the accurate simulation of signalized road networks. In this paper, we present a machine learning (ML) method for estimating traffic signal timing information from vehicle probe data. To the authors best knowledge, very few works have presented ML techniques for determining traffic signal timing parameters from vehicle probe data. In this work, we develop an Extreme Gradient Boosting (XGBoost) model to estimate signal cycle lengths and a neural network model to determine the corresponding red times per phase from probe data. The green times are then be derived from the cycle length and red times. Our results show an error of less than 0.56 sec for cycle length, and red times predictions within 7.2 sec error on average.
△ Less
Submitted 4 August, 2023;
originally announced August 2023.
-
The Efficacy of the Method of Four Coefficients to Determine Charge Carrier Scattering
Authors:
Caitlin M. Crawford,
Erik A. Bensen,
Haley A. Vinton,
Eric S. Toberer
Abstract:
The investigation of the electronic properties of semiconductors is inherently challenging due to the ensemble averaging of fundamentals to transport measurements (i.e., resistivity, Hall, and Seebeck coefficient measurements). Here, we investigate the incorporation of a fourth measurement of electronic transport, the Nernst coefficient, into the analysis, termed the method of four-coefficients. T…
▽ More
The investigation of the electronic properties of semiconductors is inherently challenging due to the ensemble averaging of fundamentals to transport measurements (i.e., resistivity, Hall, and Seebeck coefficient measurements). Here, we investigate the incorporation of a fourth measurement of electronic transport, the Nernst coefficient, into the analysis, termed the method of four-coefficients. This approach yields the Fermi level, effective mass, scattering exponent, and relaxation time. We begin with a review of the underlying mathematics and investigate the map** between the four-dimensional material property and transport coefficient spaces. We then investigate how the traditional single parabolic band method yields a single, potentially incorrect point on the solution sub-space. This uncertainty can be resolved through Nernst coefficient measurements and we map the span of the ensuing sub-space. We conclude with an investigation of how sensitive the analysis of transport coefficients is to experimental error for different sample types.
△ Less
Submitted 8 March, 2021;
originally announced March 2021.
