-
A Custom IC Layout Generation Engine Based on Dynamic Templates and Grids
Authors:
Taeho Shin,
Dongjun Lee,
Dongwhee Kim,
Gaeryun Sung,
Wook** Shin,
Yunseong Jo,
Hyungjoo Park,
Jaeduk Han
Abstract:
This paper presents an automatic layout generation framework in advanced CMOS technologies. The framework extends the template-and-grid-based layout generation methodology with the following additional techniques applied to produce optimal layouts more effectively. First, layout templates and grids are dynamically created and adjusted during runtime to serve various structural, functional, and des…
▽ More
This paper presents an automatic layout generation framework in advanced CMOS technologies. The framework extends the template-and-grid-based layout generation methodology with the following additional techniques applied to produce optimal layouts more effectively. First, layout templates and grids are dynamically created and adjusted during runtime to serve various structural, functional, and design requirements. Virtual instances support the dynamic template-and-grid-based layout generation process. The framework also implements various post-processing functions to handle process-specific requirements efficiently. The post-processing functions include cut/dummy pattern generation and multiple-patterning adjustment. The generator description capability is enhanced with circular grid indexing/slicing and conditional conversion operators. The layout generation framework is applied to various design examples and generates DRC/LVS clean layouts automatically in multiple CMOS technologies.
△ Less
Submitted 24 July, 2022;
originally announced July 2022.
-
Transformer Network-based Reinforcement Learning Method for Power Distribution Network (PDN) Optimization of High Bandwidth Memory (HBM)
Authors:
Hyunwook Park,
Minsu Kim,
Seongguk Kim,
Keunwoo Kim,
Haeyeon Kim,
Taein Shin,
Keeyoung Son,
Boogyo Sim,
Subin Kim,
Seungtaek Jeong,
Chulsoon Hwang,
Joungho Kim
Abstract:
In this article, for the first time, we propose a transformer network-based reinforcement learning (RL) method for power distribution network (PDN) optimization of high bandwidth memory (HBM). The proposed method can provide an optimal decoupling capacitor (decap) design to maximize the reduction of PDN self- and transfer impedance seen at multiple ports. An attention-based transformer network is…
▽ More
In this article, for the first time, we propose a transformer network-based reinforcement learning (RL) method for power distribution network (PDN) optimization of high bandwidth memory (HBM). The proposed method can provide an optimal decoupling capacitor (decap) design to maximize the reduction of PDN self- and transfer impedance seen at multiple ports. An attention-based transformer network is implemented to directly parameterize decap optimization policy. The optimality performance is significantly improved since the attention mechanism has powerful expression to explore massive combinatorial space for decap assignments. Moreover, it can capture sequential relationships between the decap assignments. The computing time for optimization is dramatically reduced due to the reusable network on positions of probing ports and decap assignment candidates. This is because the transformer network has a context embedding process to capture meta-features including probing ports positions. In addition, the network is trained with randomly generated data sets. Therefore, without additional training, the trained network can solve new decap optimization problems. The computing time for training and data cost are critically decreased due to the scalability of the network. Thanks to its shared weight property, the network can adapt to a larger scale of problems without additional training. For verification, we compare the results with conventional genetic algorithm (GA), random search (RS), and all the previous RL-based methods. As a result, the proposed method outperforms in all the following aspects: optimality performance, computing time, and data efficiency.
△ Less
Submitted 23 August, 2022; v1 submitted 29 March, 2022;
originally announced March 2022.
-
AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts
Authors:
Taylor Shin,
Yasaman Razeghi,
Robert L. Logan IV,
Eric Wallace,
Sameer Singh
Abstract:
The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining. Reformulating tasks as fill-in-the-blanks problems (e.g., cloze tests) is a natural approach for gauging such knowledge, however, its usage is limited by the manual effort and guesswork required to write suitable prompts. To address this, we develop AutoPro…
▽ More
The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining. Reformulating tasks as fill-in-the-blanks problems (e.g., cloze tests) is a natural approach for gauging such knowledge, however, its usage is limited by the manual effort and guesswork required to write suitable prompts. To address this, we develop AutoPrompt, an automated method to create prompts for a diverse set of tasks, based on a gradient-guided search. Using AutoPrompt, we show that masked language models (MLMs) have an inherent capability to perform sentiment analysis and natural language inference without additional parameters or finetuning, sometimes achieving performance on par with recent state-of-the-art supervised models. We also show that our prompts elicit more accurate factual knowledge from MLMs than the manually created prompts on the LAMA benchmark, and that MLMs can be used as relation extractors more effectively than supervised relation extraction models. These results demonstrate that automatically generated prompts are a viable parameter-free alternative to existing probing methods, and as pretrained LMs become more sophisticated and capable, potentially a replacement for finetuning.
△ Less
Submitted 7 November, 2020; v1 submitted 29 October, 2020;
originally announced October 2020.
-
Detailed Dynamic Model of Antagonistic PAM System and its Experimental Validation: Sensor-less Angle and Torque Control with UKF
Authors:
Takaya Shin,
Takumi Ibayashi,
Kiminao Kogiso
Abstract:
This study proposes a detailed nonlinear mathematical model of an antagonistic pneumatic artificial muscle (PAM) actuator system for estimating the joint angle and torque using an unscented Kalman filter (UKF). The proposed model is described in a hybrid state-space representation. It includes the contraction force of the PAM, joint dynamics, fluid dynamics of compressed air, mass flows of a valve…
▽ More
This study proposes a detailed nonlinear mathematical model of an antagonistic pneumatic artificial muscle (PAM) actuator system for estimating the joint angle and torque using an unscented Kalman filter (UKF). The proposed model is described in a hybrid state-space representation. It includes the contraction force of the PAM, joint dynamics, fluid dynamics of compressed air, mass flows of a valve, and friction models. A part of the friction models is modified to obtain a novel form of Coulomb friction depending on the inner pressure of the PAM. For model validation, offline and online UKF estimations and sensor-less tracking control of the joint angle and torque are conducted to evaluate the estimation accuracy and tracking control performance. The estimation accuracy is less than 7.91 %, and the steady-state tracking control performance is more than 94.75 %. These results confirm that the proposed model is detailed and could be used as the state estimator of an antagonistic PAM system.
△ Less
Submitted 5 June, 2021; v1 submitted 19 September, 2020;
originally announced September 2020.
-
DeepJ: Style-Specific Music Generation
Authors:
Huanru Henry Mao,
Taylor Shin,
Garrison W. Cottrell
Abstract:
Recent advances in deep neural networks have enabled algorithms to compose music that is comparable to music composed by humans. However, few algorithms allow the user to generate music with tunable parameters. The ability to tune properties of generated music will yield more practical benefits for aiding artists, filmmakers, and composers in their creative tasks. In this paper, we introduce DeepJ…
▽ More
Recent advances in deep neural networks have enabled algorithms to compose music that is comparable to music composed by humans. However, few algorithms allow the user to generate music with tunable parameters. The ability to tune properties of generated music will yield more practical benefits for aiding artists, filmmakers, and composers in their creative tasks. In this paper, we introduce DeepJ - an end-to-end generative model that is capable of composing music conditioned on a specific mixture of composer styles. Our innovations include methods to learn musical style and music dynamics. We use our model to demonstrate a simple technique for controlling the style of generated music as a proof of concept. Evaluation of our model using human raters shows that we have improved over the Biaxial LSTM approach.
△ Less
Submitted 2 January, 2018;
originally announced January 2018.
-
INsight: A Neuromorphic Computing System for Evaluation of Large Neural Networks
Authors:
Jaeyong Chung,
Taehwan Shin,
Yongshin Kang
Abstract:
Deep neural networks have been demonstrated impressive results in various cognitive tasks such as object detection and image classification. In order to execute large networks, Von Neumann computers store the large number of weight parameters in external memories, and processing elements are timed-shared, which leads to power-hungry I/O operations and processing bottlenecks. This paper describes a…
▽ More
Deep neural networks have been demonstrated impressive results in various cognitive tasks such as object detection and image classification. In order to execute large networks, Von Neumann computers store the large number of weight parameters in external memories, and processing elements are timed-shared, which leads to power-hungry I/O operations and processing bottlenecks. This paper describes a neuromorphic computing system that is designed from the ground up for the energy-efficient evaluation of large-scale neural networks. The computing system consists of a non-conventional compiler, a neuromorphic architecture, and a space-efficient microarchitecture that leverages existing integrated circuit design methodologies. The compiler factorizes a trained, feedforward network into a sparsely connected network, compresses the weights linearly, and generates a time delay neural network reducing the number of connections. The connections and units in the simplified network are mapped to silicon synapses and neurons. We demonstrate an implementation of the neuromorphic computing system based on a field-programmable gate array that performs the MNIST hand-written digit classification with 97.64% accuracy.
△ Less
Submitted 5 August, 2015;
originally announced August 2015.