-
Reduced Order Model for Chemical Kinetics: A case study with Primordial Chemical Network
Authors:
Kwok Sun Tang,
Matthew Turk
Abstract:
Chemical kinetics plays an important role in governing the thermal evolution in reactive flows problems. The possible interactions between chemical species increase drastically with the number of species considered in the system. Various ways have been proposed before to simplify chemical networks with an aim to reduce the computational complexity of the chemical network. These techniques oftentim…
▽ More
Chemical kinetics plays an important role in governing the thermal evolution in reactive flows problems. The possible interactions between chemical species increase drastically with the number of species considered in the system. Various ways have been proposed before to simplify chemical networks with an aim to reduce the computational complexity of the chemical network. These techniques oftentimes require domain-knowledge experts to handcraftedly identify important reaction pathways and possible simplifications. Here, we propose a combination of autoencoder and neural ordinary differential equation to model the temporal evolution of chemical kinetics in a reduced subspace. We demonstrated that our model has achieved a close-to 10-fold speed-up compared to commonly used astro-chemistry solver for a 9-species primordial network, while maintaining 1 percent accuracy across a wide-range of density and temperature.
△ Less
Submitted 14 July, 2022;
originally announced July 2022.
-
Galaxy Merger Reconstruction with Equivariant Graph Normalizing Flows
Authors:
Kwok Sun Tang,
Yuan-Sen Ting
Abstract:
A key yet unresolved question in modern-day astronomy is how galaxies formed and evolved under the paradigm of the $Λ$CDM model. A critical limiting factor lies in the lack of robust tools to describe the merger history through a statistical model. In this work, we employ a generative graph network, E(n) Equivariant Graph Normalizing Flows Model. We demonstrate that, by treating the progenitors as…
▽ More
A key yet unresolved question in modern-day astronomy is how galaxies formed and evolved under the paradigm of the $Λ$CDM model. A critical limiting factor lies in the lack of robust tools to describe the merger history through a statistical model. In this work, we employ a generative graph network, E(n) Equivariant Graph Normalizing Flows Model. We demonstrate that, by treating the progenitors as a graph, our model robustly recovers their distributions, including their masses, merging redshifts and pairwise distances at redshift z=2 conditioned on their z=0 properties. The generative nature of the model enables other downstream tasks, including likelihood-free inference, detecting anomalies and identifying subtle correlations of progenitor features.
△ Less
Submitted 6 July, 2022;
originally announced July 2022.
-
QUOTAS: A new research platform for the data-driven investigation of black holes
Authors:
Priyamvada Natarajan,
Kwok Sun Tang,
Robert McGibbon,
Sadegh Khochfar,
Brian Nord,
Steinn Sigurdsson,
Joe Tricot,
Nico Cappelluti,
Daniel George,
Jack Hidary
Abstract:
We present QUOTAS, a novel research platform for the data-driven investigation of super-massive black hole (SMBH) populations. While SMBH data sets -- observations and simulations -- have grown rapidly in complexity and abundance, our computational environments and analysis tools have not matured commensurately to exhaust opportunities for discovery. Motivated to explore BH host galaxy and the par…
▽ More
We present QUOTAS, a novel research platform for the data-driven investigation of super-massive black hole (SMBH) populations. While SMBH data sets -- observations and simulations -- have grown rapidly in complexity and abundance, our computational environments and analysis tools have not matured commensurately to exhaust opportunities for discovery. Motivated to explore BH host galaxy and the parent dark matter halo connection, in this pilot version of QUOTAS, we assemble and co-locate the high-redshift, luminous quasar population at $z \geq 3$ alongside simulated data of the same epochs. Leveraging machine learning algorithms (ML) we expand simulation volumes that successfully replicate halo populations beyond the training set. Training ML on the Illustris-TNG300 simulation that includes baryonic physics, we populate the larger LEGACY Expanse dark matter-only box with quasars. Our first science results comparing observational and ML simulated quasars at $z \sim 3$, reveal that while the recovered Black Hole Mass Functions and clustering are in good agreement, simulated SMBHs fail to accrete, shine and grow at high enough rates to match observed quasars. We conclude that sub-grid models of mass accretion and SMBH feedback implemented in Illustris-TNG300 do not reproduce their observed mass growth. QUOTAS, demonstrates the power of ML, both for analyzing large complex datasets, and offering a unique opportunity to interrogate our theoretical model assumptions. We deploy ML again to derive and devise an optimal survey strategy for bringing the undetected lower luminosity quasar population into view. QUOTAS, and all related materials are publicly available at the Google Kaggle platform.
△ Less
Submitted 14 April, 2023; v1 submitted 25 March, 2021;
originally announced March 2021.
-
SISE-PC: Semi-supervised Image Subsampling for Explainable Pathology
Authors:
Sohini Roychowdhury,
Kwok Sun Tang,
Mohith Ashok,
Anoop Sanka
Abstract:
Although automated pathology classification using deep learning (DL) has proved to be predictively efficient, DL methods are found to be data and compute cost intensive. In this work, we aim to reduce DL training costs by pre-training a Resnet feature extractor using SimCLR contrastive loss for latent encoding of OCT images. We propose a novel active learning framework that identifies a minimal su…
▽ More
Although automated pathology classification using deep learning (DL) has proved to be predictively efficient, DL methods are found to be data and compute cost intensive. In this work, we aim to reduce DL training costs by pre-training a Resnet feature extractor using SimCLR contrastive loss for latent encoding of OCT images. We propose a novel active learning framework that identifies a minimal sub-sampled dataset containing the most uncertain OCT image samples using label propagation on the SimCLR latent encodings. The pre-trained Resnet model is then fine-tuned with the labelled minimal sub-sampled data and the underlying pathological sites are visually explained. Our framework identifies upto 2% of OCT images to be most uncertain that need prioritized specialist attention and that can fine-tune a Resnet model to achieve upto 97% classification accuracy. The proposed method can be extended to other medical images to minimize prediction costs.
△ Less
Submitted 10 March, 2021; v1 submitted 23 February, 2021;
originally announced February 2021.
-
Adaptive strategy in differential evolution via explicit exploitation and exploration controls
Authors:
Sheng Xin Zhang,
Wing Shing Chan,
Kit Sang Tang,
Shao Yong Zheng
Abstract:
Existing multi-strategy adaptive differential evolution (DE) commonly involves trials of multiple strategies and then rewards better-performing ones with more resources. However, the trials of an exploitative or explorative strategy may result in over-exploitation or over-exploration. To improve the performance, this paper proposes a new strategy adaptation method, named explicit adaptation scheme…
▽ More
Existing multi-strategy adaptive differential evolution (DE) commonly involves trials of multiple strategies and then rewards better-performing ones with more resources. However, the trials of an exploitative or explorative strategy may result in over-exploitation or over-exploration. To improve the performance, this paper proposes a new strategy adaptation method, named explicit adaptation scheme (Ea scheme), which separates multiple strategies and employs them on-demand. It is done by dividing the evolution process into several Selective-candidate with Similarity Selection (SCSS) generations and adaptive generations. In the SCSS generations, the exploitation and exploration needs are learnt by utilizing a balanced strategy. To meet these needs, in adaptive generations, two other strategies, exploitative or explorative is adaptively used. Experimental studies on benchmark functions demonstrate the effectiveness of Ea scheme when compared with its variants and other adaptation methods. Furthermore, performance comparisons with state-of-the-art evolutionary algorithms and swarm intelligence-based algorithms show that EaDE is very competitive.
△ Less
Submitted 1 December, 2021; v1 submitted 3 February, 2020;
originally announced February 2020.
-
Physical Properties of the star-forming clusters in NGC 6334
Authors:
Mahya Sadaghiani,
Álvaro Sánchez-Monge,
Peter Schilke,
Hauyu Baobab Liu,
Seamus Clarke,
Qizhou Zhang,
Josep Miquel Girart,
Daniel Seifried,
Atefeh Aghababaei,
Hua-bai Li,
Carmen Juárez,
Kwok Sun Tang
Abstract:
We have studied the high-mass star-forming complex NGC 6334 with ALMA in the continuum emission at a frequency of 87.6 GHz, achieving a spatial resolution of 1300 au. Detecting 142 compact sources distributed over the whole observed area, we then used machine learning algorithms to group the compact cores in different clusters. A total of four main clusters were identified: NGC 6334-E, NGC 6334-I,…
▽ More
We have studied the high-mass star-forming complex NGC 6334 with ALMA in the continuum emission at a frequency of 87.6 GHz, achieving a spatial resolution of 1300 au. Detecting 142 compact sources distributed over the whole observed area, we then used machine learning algorithms to group the compact cores in different clusters. A total of four main clusters were identified: NGC 6334-E, NGC 6334-I, NGC 6334-I(N) and NGC 6334-I(NW). The typical separations between cluster members (4000-12000 au) together with the core masses (0.2-100 $M_{\odot}$) are in agreement with turbulent fragmentation at scales of 0.1 pc. We find that the CMFs (core mass functions) show an excess of massive cores compared to the IMF. Typical uncertainties in temperature or unresolved multiplicity may mimic the observed excess of massive cores. Evidence of mass segregation in NGC 6334-I and NGC 6334-I(N), with the most massive cores located closer to the center, was found. Correlations between the physical properties of the clusters and their evolutionary stage were searched for, and found to show a larger separation between cores in the more evolved clusters, favouring the role of gas expulsion and stellar ejection over time. From these results, we suggest that NGC 6334-I(N) was primordially segregated, while NGC 6334-I may have become mass-segregated over time due to dynamical effects. Finally, the lack of massive cores in the most evolved cluster suggests that the gas reservoir may be already exhausted, while the less evolved clusters still have access to a larger gas mass reservoir. In general, the fragmentation in NGC 6334 at large scales (about 1 pc) is governed by turbulent pressure, while at smaller scales (a few hundred au), thermal pressure regulates the fragmentation process.
△ Less
Submitted 25 November, 2019; v1 submitted 15 November, 2019;
originally announced November 2019.
-
Probing the Turbulence Dissipation Range and Magnetic Field Strengths in Molecular Clouds. II. Directly Probing the Ion-neutral Decoupling Scale
Authors:
Kwok Sun Tang,
Hua-Bai Li,
Wing-Kit Lee
Abstract:
The linewidth of ions has been observed to be systematically narrower than that of the coexisting neutrals in molecular clouds (Houde et al. 2000) and been interpreted as the signature of the decoupling of the neutral turbulence from magnetic fields in partially ionized medium (Li & Houde 2008; Paper I, hereafter). As a sequel of Paper I, here we present further observational evidence that lend su…
▽ More
The linewidth of ions has been observed to be systematically narrower than that of the coexisting neutrals in molecular clouds (Houde et al. 2000) and been interpreted as the signature of the decoupling of the neutral turbulence from magnetic fields in partially ionized medium (Li & Houde 2008; Paper I, hereafter). As a sequel of Paper I, here we present further observational evidence that lend support to these earlier proposals with the velocity coordinate spectrum analysis (Lazarian & Pogosyan 2006). We recover the turbulent energy spectra of HCN and HCO+(4-3) in a starless molecular filament in NGC 6334 where magnetic fields play a dynamically important role (Li et al. 2015). Our analysis showed that the neutral spectrum is consistent with Kolmogorov-type (k^-5/3, where k is the wave number), while that of the ions is the same on the large scale but steeper (k^-2) for scales smaller than 0.404pc. We carefully ruled out the possibilities that the spectrum difference can stem from the differences of ion and neutral optical depth and hyper-fine structures.
△ Less
Submitted 18 January, 2019;
originally announced January 2019.
-
Multi-Layer Competitive-Cooperative Framework for Performance Enhancement of Differential Evolution
Authors:
Sheng Xin Zhang,
Li Ming Zheng,
Kit Sang Tang,
Shao Yong Zheng,
Wing Shing Chan
Abstract:
Differential Evolution (DE) is recognized as one of the most powerful optimizers in the evolutionary algorithm (EA) family. Many DE variants were proposed in recent years, but significant differences in performances between them are hardly observed. Therefore, this paper suggests a multi-layer competitive-cooperative (MLCC) framework to facilitate the competition and cooperation of multiple DEs, w…
▽ More
Differential Evolution (DE) is recognized as one of the most powerful optimizers in the evolutionary algorithm (EA) family. Many DE variants were proposed in recent years, but significant differences in performances between them are hardly observed. Therefore, this paper suggests a multi-layer competitive-cooperative (MLCC) framework to facilitate the competition and cooperation of multiple DEs, which in turns, achieve a significant performance improvement. Unlike other multi-method strategies which adopt a multi-population based structure, with individuals only evolving in their corresponding subpopulations, MLCC implements a parallel structure with the entire population simultaneously monitored by multiple DEs assigned to their corresponding layers. An individual can store, utilize and update its evolution information in different layers based on an individual preference based layer selecting (IPLS) mechanism and a computational resource allocation bias (RAB) mechanism. In IPLS, individuals connect to only one favorite layer. While in RAB, high-quality solutions are evolved by considering all the layers. Thus DEs associated in the layers work in a competitive and cooperative manner. The proposed MLCC framework has been implemented on several highly competitive DEs. Experimental studies show that the MLCC variants significantly outperform the baseline DEs as well as several state-of-the-art and up-to-date DEs on CEC benchmark functions.
△ Less
Submitted 7 January, 2019; v1 submitted 31 January, 2018;
originally announced January 2018.
-
Selective-Candidate Framework with Similarity Selection Rule for Evolutionary Optimization
Authors:
Sheng Xin Zhang,
Wing Shing Chan,
Zi Kang Peng,
Shao Yong Zheng,
Kit Sang Tang
Abstract:
Achieving better exploitation and exploration capabilities (EEC) have always been an important yet challenging issue in the design of evolutionary optimization algorithm (EOA). The difficulties lie in obtaining a good balance in EEC, which is determined cooperatively by operations and parameters in an EOA. When deficiencies in exploitation or exploration are observed, most existing works consider…
▽ More
Achieving better exploitation and exploration capabilities (EEC) have always been an important yet challenging issue in the design of evolutionary optimization algorithm (EOA). The difficulties lie in obtaining a good balance in EEC, which is determined cooperatively by operations and parameters in an EOA. When deficiencies in exploitation or exploration are observed, most existing works consider a piecemeal approach, either by designing new operations or by altering the parameters. Unfortunately, when different situations are encountered, these proposals may fail to be the winner. To address these problems, this paper proposes an explicit EEC control method named selective-candidate framework with similarity selection rule (SCSS). M (M > 1) candidates are first generated from each current solution with independent operations and parameters to enrich the search. Then, a similarity selection rule is designed to determine the final candidate by considering the fitness ranking of the current solution and its Euclidian distance to each of these M candidates. Superior current solutions will prefer the closest candidates for efficient local exploitation while inferior ones will favor the farthest for exploration purpose. In this way, the rule could synthesize exploitation and exploration, making the evolution more effective. When applied to three classic, four state-of-the-art and four up-to-date EOAs from branches of differential evolution, evolution strategy and particle swarm optimization, significant enhancement in performance is achieved.
△ Less
Submitted 14 May, 2020; v1 submitted 18 December, 2017;
originally announced December 2017.
-
Controllability of networked MIMO systems
Authors:
Lin Wang,
Guanrong Chen,
Xiaofan Wang,
Wallace K. S. Tang
Abstract:
In this paper, we consider the state controllability of networked systems, where the network topology is directed and weighted and the nodes are higher-dimensional linear time-invariant (LTI) dynamical systems. We investigate how the network topology, the node-system dynamics, the external control inputs, and the inner interactions affect the controllability of a networked system, and show that fo…
▽ More
In this paper, we consider the state controllability of networked systems, where the network topology is directed and weighted and the nodes are higher-dimensional linear time-invariant (LTI) dynamical systems. We investigate how the network topology, the node-system dynamics, the external control inputs, and the inner interactions affect the controllability of a networked system, and show that for a general networked multi-input/multi-output (MIMO) system: 1) the controllability of the overall network is an integrated result of the aforementioned relevant factors, which cannot be decoupled into the controllability of individual node-systems and the properties solely determined by the network topology, quite different from the familiar notion of consensus or formation controllability; 2) if the network topology is uncontrollable by external inputs, then the networked system with identical nodes will be uncontrollable, even if it is structurally controllable; 3) with a controllable network topology, controllability and observability of the nodes together are necessary for the controllability of the networked systems under some mild conditions, but nevertheless they are not sufficient. For a networked system with single-input/single-output (SISO) LTI nodes, we present precise necessary and sufficient conditions for the controllability of a general network topology.
△ Less
Submitted 30 October, 2015; v1 submitted 6 May, 2015;
originally announced May 2015.
-
The Link between Magnetic Fields and Cloud/Star Formation
Authors:
Hua-bai Li,
Alyssa Goodman,
T. K. Sridharan,
Martin Houde,
Zhi-Yun Li,
Giles Novak,
Kwok Sun Tang
Abstract:
The question whether magnetic fields play an important role in the processes of molecular cloud and star formation has been debated for decades. Recent observations have revealed a simple picture that may help illuminate these questions: magnetic fields have a tendency to preserve their orientation at all scales that have been probed - from 100-pc scale inter-cloud media down to sub-pc scale cloud…
▽ More
The question whether magnetic fields play an important role in the processes of molecular cloud and star formation has been debated for decades. Recent observations have revealed a simple picture that may help illuminate these questions: magnetic fields have a tendency to preserve their orientation at all scales that have been probed - from 100-pc scale inter-cloud media down to sub-pc scale cloud cores. This ordered morphology has implications for the way in which self-gravity and turbulence interact with magnetic fields: both gravitational contraction and turbulent velocities should be anisotropic, due to the influence of dynamically important magnetic fields. Such anisotropy is now observed. Here we review these recent observations and discuss how they can improve our understanding of cloud/star formation.
△ Less
Submitted 8 April, 2014;
originally announced April 2014.