Showing 1–10 of 10 results for author: Lian, T

Divide, Ensemble and Conquer: The Last Mile on Unsupervised Domain Adaptation for On-Board Semantic Segmentation

Authors: Tao Lian, Jose L. Gómez, Antonio M. López

Abstract: The last mile of unsupervised domain adaptation (UDA) for semantic segmentation is the challenge of solving the syn-to-real domain gap. Recent UDA methods have progressed significantly, yet they often rely on strategies customized for synthetic single-source datasets (e.g., GTA5), which limits their generalisation to multi-source datasets. Conversely, synthetic multi-source datasets hold promise f… ▽ More The last mile of unsupervised domain adaptation (UDA) for semantic segmentation is the challenge of solving the syn-to-real domain gap. Recent UDA methods have progressed significantly, yet they often rely on strategies customized for synthetic single-source datasets (e.g., GTA5), which limits their generalisation to multi-source datasets. Conversely, synthetic multi-source datasets hold promise for advancing the last mile of UDA but remain underutilized in current research. Thus, we propose DEC, a flexible UDA framework for multi-source datasets. Following a divide-and-conquer strategy, DEC simplifies the task by categorizing semantic classes, training models for each category, and fusing their outputs by an ensemble model trained exclusively on synthetic datasets to obtain the final segmentation mask. DEC can integrate with existing UDA methods, achieving state-of-the-art performance on Cityscapes, BDD100K, and Mapillary Vistas, significantly narrowing the syn-to-real domain gap. △ Less

Submitted 26 June, 2024; originally announced June 2024.

Soft X-ray prompt emission from a high-redshift gamma-ray burst EP240315a

Authors: Y. Liu, H. Sun, D. Xu, D. S. Svinkin, J. Delaunay, N. R. Tanvir, H. Gao, C. Zhang, Y. Chen, X. -F. Wu, B. Zhang, W. Yuan, J. An, G. Bruni, D. D. Frederiks, G. Ghirlanda, J. -W. Hu, A. Li, C. -K. Li, J. -D. Li, D. B. Malesani, L. Piro, G. Raman, R. Ricci, E. Troja , et al. (170 additional authors not shown)

Abstract: Long gamma-ray bursts (GRBs) are believed to originate from core collapse of massive stars. High-redshift GRBs can probe the star formation and reionization history of the early universe, but their detection remains rare. Here we report the detection of a GRB triggered in the 0.5--4 keV band by the Wide-field X-ray Telescope (WXT) on board the Einstein Probe (EP) mission, designated as EP240315a,… ▽ More Long gamma-ray bursts (GRBs) are believed to originate from core collapse of massive stars. High-redshift GRBs can probe the star formation and reionization history of the early universe, but their detection remains rare. Here we report the detection of a GRB triggered in the 0.5--4 keV band by the Wide-field X-ray Telescope (WXT) on board the Einstein Probe (EP) mission, designated as EP240315a, whose bright peak was also detected by the Swift Burst Alert Telescope and Konus-Wind through off-line analyses. At a redshift of $z=4.859$, EP240315a showed a much longer and more complicated light curve in the soft X-ray band than in gamma-rays. Benefiting from a large field-of-view ($\sim$3600 deg$^2$) and a high sensitivity, EP-WXT captured the earlier engine activation and extended late engine activity through a continuous detection. With a peak X-ray flux at the faint end of previously known high-$z$ GRBs, the detection of EP240315a demonstrates the great potential for EP to study the early universe via GRBs. △ Less

Submitted 25 April, 2024; originally announced April 2024.

Comments: 41 pages, 8 figures, 7 tables

Applications of Deep Learning to physics workflows

Authors: Manan Agarwal, Jay Alameda, Jeroen Audenaert, Will Benoit, Damon Beveridge, Meghna Bhattacharya, Chayan Chatterjee, Deep Chatterjee, Andy Chen, Muhammed Saleem Cholayil, Chia-Jui Chou, Sunil Choudhary, Michael Coughlin, Maximilian Dax, Aman Desai, Andrea Di Luca, Javier Mauricio Duarte, Steven Farrell, Yongbin Feng, Pooyan Goodarzi, Ekaterina Govorkova, Matthew Graham, Jonathan Guiang, Alec Gunny, Weichangfeng Guo , et al. (43 additional authors not shown)

Abstract: Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and efficient workflows. Recent advances in Machine Learning (ML) and Artificial Intelligence (AI) can either improve or replace existing domain-specific algorithms… ▽ More Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and efficient workflows. Recent advances in Machine Learning (ML) and Artificial Intelligence (AI) can either improve or replace existing domain-specific algorithms to increase workflow efficiency. Not only can these algorithms improve the physics performance of current algorithms, but they can often be executed more quickly, especially when run on coprocessors such as GPUs or FPGAs. In the winter of 2023, MIT hosted the Accelerating Physics with ML at MIT workshop, which brought together researchers from gravitational-wave physics, multi-messenger astrophysics, and particle physics to discuss and share current efforts to integrate ML tools into their workflows. The following white paper highlights examples of algorithms and computing frameworks discussed during this workshop and summarizes the expected computing needs for the immediate future of the involved fields. △ Less

Submitted 13 June, 2023; originally announced June 2023.

Comments: Whitepaper resulting from Accelerating Physics with ML@MIT workshop in Jan/Feb 2023

The prolific thermonuclear X-ray bursts from the outburst of the newly discovered millisecond pulsar MAXI~J1816--195 observed by Insight-HXMT and NICER

Authors: Chen Yu-Peng, Zhang Shu, Ji Long, Zhang Shuang-Nan, Wang Peng-Ju, Kong Ling-Da, Chang Zhi, Peng **g-Qiang, Shui Qing-Cang, Li Jian, Tao Lian, Ge Ming-Yu, Qu **-Lu

Abstract: MAXI J1816-195 is a newly discovered accreting millisecond pulsar with prolific thermonuclear bursts, detected during its outburst in 2022 June by Insight-HXMT and NICER. During the outburst, Insight-HXMT detected 73 bursts in its peak and decay phase, serving as a prolific burst system found in the accreting millisecond pulsars. By analyzing one burst which was simultaneously detected by Insight-… ▽ More MAXI J1816-195 is a newly discovered accreting millisecond pulsar with prolific thermonuclear bursts, detected during its outburst in 2022 June by Insight-HXMT and NICER. During the outburst, Insight-HXMT detected 73 bursts in its peak and decay phase, serving as a prolific burst system found in the accreting millisecond pulsars. By analyzing one burst which was simultaneously detected by Insight-HXMT and NICER, we find a mild deviation from the conventional blackbody model. By stacking the Insight-HXMT lightcurves of 66 bursts which have similar profiles and intensities, a hard X-ray shortage is detected with a significance of 15.7 sigma in 30-100 keV. The shortage is about 30% of the persistent flux, which is low compared with other bursters. The shortage fraction is energy-dependent: larger in a higher energy band. These findings make the newly discovered millisecond MAXI J1816-195 a rather peculiar system compared with other millisecond pulsars and atoll bursters. In addition, based on the brightest burst, we derive an upper limit of the distance as 6.3 kpc, and therefore estimate the upper limit of the inner disc radius of the accretion disc to be~ 40 km. Assuming the radius as the magnetospheric radius, the derived magnetic field strength is about 7.1*10^8 G. △ Less

Submitted 25 August, 2022; originally announced August 2022.

Comments: ApJL in press

Neural Network Generalization: The impact of camera parameters

Authors: Zhenyi Liu, Trisha Lian, Joyce Farrell, Brian Wandell

Abstract: We quantify the generalization of a convolutional neural network (CNN) trained to identify cars. First, we perform a series of experiments to train the network using one image dataset - either synthetic or from a camera - and then test on a different image dataset. We show that generalization between images obtained with different cameras is roughly the same as generalization between images from a… ▽ More We quantify the generalization of a convolutional neural network (CNN) trained to identify cars. First, we perform a series of experiments to train the network using one image dataset - either synthetic or from a camera - and then test on a different image dataset. We show that generalization between images obtained with different cameras is roughly the same as generalization between images from a camera and ray-traced multispectral synthetic images. Second, we use ISETAuto, a soft prototy** tool that creates ray-traced multispectral simulations of camera images, to simulate sensor images with a range of pixel sizes, color filters, acquisition and post-acquisition processing. These experiments reveal how variations in specific camera parameters and image processing operations impact CNN generalization. We find that (a) pixel size impacts generalization, (b) demosaicking substantially impacts performance and generalization for shallow (8-bit) bit-depths but not deeper ones (10-bit), and (c) the network performs well using raw (not demosaicked) sensor data for 10-bit pixels. △ Less

Submitted 7 December, 2019; originally announced December 2019.

Comments: 11 pages, 11 figures, in preparation for submission

Soft Prototy** Camera Designs for Car Detection Based on a Convolutional Neural Network

Authors: Zhenyi Liu, Trisha Lian, Joyce Farrell, Brian Wandell

Abstract: Imaging systems are increasingly used as input to convolutional neural networks (CNN) for object detection; we would like to design cameras that are optimized for this purpose. It is impractical to build different cameras and then acquire and label the necessary data for every potential camera design; creating software simulations of the camera in context (soft prototy**) is the only realistic a… ▽ More Imaging systems are increasingly used as input to convolutional neural networks (CNN) for object detection; we would like to design cameras that are optimized for this purpose. It is impractical to build different cameras and then acquire and label the necessary data for every potential camera design; creating software simulations of the camera in context (soft prototy**) is the only realistic approach. We implemented soft-prototy** tools that can quantitatively simulate image radiance and camera designs to create realistic images that are input to a convolutional neural network for car detection. We used these methods to quantify the effect that critical hardware components (pixel size), sensor control (exposure algorithms) and image processing (gamma and demosaicing algorithms) have upon average precision of car detection. We quantify (a) the relationship between pixel size and the ability to detect cars at different distances, (b) the penalty for choosing a poor exposure duration, and (c) the ability of the CNN to perform car detection for a variety of post-acquisition processing algorithms. These results show that the optimal choices for car detection are not constrained by the same metrics used for image quality in consumer photography. It is better to evaluate camera designs for CNN applications using soft prototy** with task-specific metrics rather than consumer photography metrics. △ Less

Submitted 24 October, 2019; originally announced October 2019.

Time-variant metasurfaces enable tunable spectral bands of negative extinction

Authors: Maxim R. Shcherbakov, Robert Lemasters, Zhiyuan Fan, Jia Song, Tianquan Lian, Hayk Harutyunyan, Gennady Shvets

Abstract: We demonstrate that rapidly switched high-Q metasurfaces enable spectral regions of negative optical extinction. We demonstrate that rapidly switched high-Q metasurfaces enable spectral regions of negative optical extinction. △ Less

Submitted 29 August, 2019; originally announced September 2019.

Comments: 2 pages, 2 figures

A system for generating complex physically accurate sensor images for automotive applications

Authors: Zhenyi Liu, Minghao Shen, Jiaqi Zhang, Shuangting Liu, Henryk Blasinski, Trisha Lian, Brian Wandell

Abstract: We describe an open-source simulator that creates sensor irradiance and sensor images of typical automotive scenes in urban settings. The purpose of the system is to support camera design and testing for automotive applications. The user can specify scene parameters (e.g., scene type, road type, traffic density, time of day) to assemble a large number of random scenes from graphics assets stored i… ▽ More We describe an open-source simulator that creates sensor irradiance and sensor images of typical automotive scenes in urban settings. The purpose of the system is to support camera design and testing for automotive applications. The user can specify scene parameters (e.g., scene type, road type, traffic density, time of day) to assemble a large number of random scenes from graphics assets stored in a database. The sensor irradiance is generated using quantitative computer graphics methods, and the sensor images are created using image systems sensor simulation. The synthetic sensor images have pixel level annotations; hence, they can be used to train and evaluate neural networks for imaging tasks, such as object detection and classification. The end-to-end simulation system supports quantitative assessment, from scene to camera to network accuracy, for automotive applications. △ Less

Submitted 12 February, 2019; originally announced February 2019.

Comments: 5 pages, 10 figures, IS&T Electronic Imaging conference 2019

Towards Full Automated Drive in Urban Environments: A Demonstration in GoMentum Station, California

Authors: Akansel Cosgun, Lichao Ma, Jimmy Chiu, Jiawei Huang, Mahmut Demir, Alexandre Miranda Anon, Thang Lian, Hasan Tafish, Samir Al-Stouhi

Abstract: Each year, millions of motor vehicle traffic accidents all over the world cause a large number of fatalities, injuries and significant material loss. Automated Driving (AD) has potential to drastically reduce such accidents. In this work, we focus on the technical challenges that arise from AD in urban environments. We present the overall architecture of an AD system and describe in detail the per… ▽ More Each year, millions of motor vehicle traffic accidents all over the world cause a large number of fatalities, injuries and significant material loss. Automated Driving (AD) has potential to drastically reduce such accidents. In this work, we focus on the technical challenges that arise from AD in urban environments. We present the overall architecture of an AD system and describe in detail the perception and planning modules. The AD system, built on a modified Acura RLX, was demonstrated in a course in GoMentum Station in California. We demonstrated autonomous handling of 4 scenarios: traffic lights, cross-traffic at intersections, construction zones and pedestrians. The AD vehicle displayed safe behavior and performed consistently in repeated demonstrations with slight variations in conditions. Overall, we completed 44 runs, encompassing 110km of automated driving with only 3 cases where the driver intervened the control of the vehicle, mostly due to error in GPS positioning. Our demonstration showed that robust and consistent behavior in urban scenarios is possible, yet more investigation is necessary for full scale roll-out on public roads. △ Less

Submitted 2 May, 2017; originally announced May 2017.

Comments: Accepted to Intelligent Vehicles Conference (IV 2017)

Financial Atoms and Molecules

Authors: Yik Wen Goo, Tong Wei Lian, Wei Guang Ong, Wen Ting Choi, Siew-Ann Cheong

Abstract: Atoms and molecules are important conceptual entities we invented to understand the physical world around us. The key to their usefulness lies in the organization of nuclear and electronic degrees of freedom into a single dynamical variable whose time evolution we can better imagine. The use of such effective variables in place of the true microscopic variables is possible because of the separat… ▽ More Atoms and molecules are important conceptual entities we invented to understand the physical world around us. The key to their usefulness lies in the organization of nuclear and electronic degrees of freedom into a single dynamical variable whose time evolution we can better imagine. The use of such effective variables in place of the true microscopic variables is possible because of the separation between nuclear/electronic and atomic/molecular time scales. Where separation of time scales occurs, identification of analogous objects in financial markets can help advance our understanding of their dynamics. To detect separated time scales and identify their associated effective degrees of freedom in financial markets, we devised a two-stage statistical clustering scheme to analyze the price movements of stocks in several equity markets. Through this two-time-scale clustering analysis, we discovered a hierarchy of levels of self-organization in real financial markets. We call these statistically robust self-organized dynamical structures financial atoms, financial molecules, and financial supermolecules. In general, the detailed compositions of these dynamical structures cannot be deduced based on raw financial intuition alone, and must be explained in terms of the underlying portfolios, and investment strategies of market players. More interestingly, we find that major market events such as the Chinese Correction and the Subprime Crisis leave many tell-tale signs within the correlational structures of financial molecules. △ Less

Submitted 12 March, 2009; originally announced March 2009.

Comments: 19 pages in RevTeX4 format, 15 figures