-
Non-Generative Energy Based Models
Authors:
Jacob Piland,
Christopher Sweet,
Priscila Saboia,
Charles Vardeman II,
Adam Czajka
Abstract:
Energy-based models (EBM) have become increasingly popular within computer vision. EBMs bring a probabilistic approach to training deep neural networks (DNN) and have been shown to enhance performance in areas such as calibration, out-of-distribution detection, and adversarial resistance. However, these advantages come at the cost of estimating input data probabilities, usually using a Langevin ba…
▽ More
Energy-based models (EBM) have become increasingly popular within computer vision. EBMs bring a probabilistic approach to training deep neural networks (DNN) and have been shown to enhance performance in areas such as calibration, out-of-distribution detection, and adversarial resistance. However, these advantages come at the cost of estimating input data probabilities, usually using a Langevin based method such as Stochastic Gradient Langevin Dynamics (SGLD), which bring additional computational costs, require parameterization, caching methods for efficiency, and can run into stability and scaling issues. EBMs use dynamical methods to draw samples from the probability density function (PDF) defined by the current state of the network and compare them to the training data using a maximum log likelihood approach to learn the correct PDF.
We propose a non-generative training approach, Non-Generative EBM (NG-EBM), that utilizes the {\it{Approximate Mass}}, identified by Grathwohl et al., as a loss term to direct the training. We show that our NG-EBM training strategy retains many of the benefits of EBM in calibration, out-of-distribution detection, and adversarial resistance, but without the computational complexity and overhead of the traditional approaches. In particular, the NG-EBM approach improves the Expected Calibration Error by a factor of 2.5 for CIFAR10 and 7.5 times for CIFAR100, when compared to traditionally trained models.
△ Less
Submitted 3 April, 2023;
originally announced April 2023.
-
Blueprint: Cyberinfrastructure Center of Excellence
Authors:
Ewa Deelman,
Anirban Mandal,
Angela P. Murillo,
Jarek Nabrzyski,
Valerio Pascucci,
Robert Ricci,
Ilya Baldin,
Susan Sons,
Laura Christopherson,
Charles Vardeman,
Rafael Ferreira da Silva,
Jane Wyngaard,
Steve Petruzza,
Mats Rynge,
Karan Vahi,
Wendy R. Whitcup,
Josh Drake,
Erik Scott
Abstract:
In 2018, NSF funded an effort to pilot a Cyberinfrastructure Center of Excellence (CI CoE or Center) that would serve the cyberinfrastructure (CI) needs of the NSF Major Facilities (MFs) and large projects with advanced CI architectures. The goal of the CI CoE Pilot project (Pilot) effort was to develop a model and a blueprint for such a CoE by engaging with the MFs, understanding their CI needs,…
▽ More
In 2018, NSF funded an effort to pilot a Cyberinfrastructure Center of Excellence (CI CoE or Center) that would serve the cyberinfrastructure (CI) needs of the NSF Major Facilities (MFs) and large projects with advanced CI architectures. The goal of the CI CoE Pilot project (Pilot) effort was to develop a model and a blueprint for such a CoE by engaging with the MFs, understanding their CI needs, understanding the contributions the MFs are making to the CI community, and exploring opportunities for building a broader CI community. This document summarizes the results of community engagements conducted during the first two years of the project and describes the identified CI needs of the MFs. To better understand MFs' CI, the Pilot has developed and validated a model of the MF data lifecycle that follows the data generation and management within a facility and gained an understanding of how this model captures the fundamental stages that the facilities' data passes through from the scientific instruments to the principal investigators and their teams, to the broader collaborations and the public. The Pilot also aimed to understand what CI workforce development challenges the MFs face while designing, constructing, and operating their CI and what solutions they are exploring and adopting within their projects. Based on the needs of the MFs in the data lifecycle and workforce development areas, this document outlines a blueprint for a CI CoE that will learn about and share the CI solutions designed, developed, and/or adopted by the MFs, provide expertise to the largest NSF projects with advanced and complex CI architectures, and foster a community of CI practitioners and researchers.
△ Less
Submitted 6 March, 2021;
originally announced March 2021.
-
Green Scale Research Tool for Multi-Criteria and Multi-Metric Energy Analysis Performed During the Architectural Design Process
Authors:
Holly T. Ferguson,
Aimee. P. C. Buccellato,
Samuel Paolucci,
Na Yu,
Charles F. Vardeman II
Abstract:
Prevailing computational tools available to and used by architecture and engineering professionals purport to gather and present thorough and accurate perspectives of the environmental impacts associated with their contributions to the built environment. The presented research of building modeling and analysis software used by the Architecture, Engineering, Construction, and Operations (AECO) indu…
▽ More
Prevailing computational tools available to and used by architecture and engineering professionals purport to gather and present thorough and accurate perspectives of the environmental impacts associated with their contributions to the built environment. The presented research of building modeling and analysis software used by the Architecture, Engineering, Construction, and Operations (AECO) industry reveals that many of the most heavily relied-upon industry tools are isolated in functionality, utilize incomplete models and data, and are disruptive to normative design and building optimization workflows. This paper describes the current models and tools, their primary functions and limitations, and presents our concurrent research to develop more advanced models to assess lifetime building energy consumption alongside operating energy use. A series of case studies describes the current state-of-the-art in tools and building energy analysis followed by the research models and novel design and analysis Tool that the Green Scale Research Group has developed in response. A fundamental goal of this effort is to increase the use and efficacy of building impact studies conducted by architects, engineers, and building owners and operators during the building design process.
△ Less
Submitted 26 February, 2016;
originally announced February 2016.
