-
A Versatile Framework for Analyzing Galaxy Image Data by Implanting Human-in-the-loop on a Large Vision Model
Authors:
Mingxiang Fu,
Yu Song,
Jiameng Lv,
Liang Cao,
Peng Jia,
Nan Li,
Xiangru Li,
Jifeng Liu,
A-Li Luo,
Bo Qiu,
Shiyin Shen,
Liang** Tu,
Lili Wang,
Shoulin Wei,
Haifeng Yang,
Zhen** Yi,
Zhiqiang Zou
Abstract:
The exponential growth of astronomical datasets provides an unprecedented opportunity for humans to gain insight into the Universe. However, effectively analyzing this vast amount of data poses a significant challenge. Astronomers are turning to deep learning techniques to address this, but the methods are limited by their specific training sets, leading to considerable duplicate workloads too. He…
▽ More
The exponential growth of astronomical datasets provides an unprecedented opportunity for humans to gain insight into the Universe. However, effectively analyzing this vast amount of data poses a significant challenge. Astronomers are turning to deep learning techniques to address this, but the methods are limited by their specific training sets, leading to considerable duplicate workloads too. Hence, as an example to present how to overcome the issue, we built a framework for general analysis of galaxy images, based on a large vision model (LVM) plus downstream tasks (DST), including galaxy morphological classification, image restoration, object detection, parameter extraction, and more. Considering the low signal-to-noise ratio of galaxy images and the imbalanced distribution of galaxy categories, we have incorporated a Human-in-the-loop (HITL) module into our large vision model, which leverages human knowledge to enhance the reliability and interpretability of processing galaxy images interactively. The proposed framework exhibits notable few-shot learning capabilities and versatile adaptability to all the abovementioned tasks on galaxy images in the DESI legacy imaging surveys. Expressly, for object detection, trained by 1000 data points, our DST upon the LVM achieves an accuracy of 96.7%, while ResNet50 plus Mask R-CNN gives an accuracy of 93.1%; for morphology classification, to obtain AUC ~0.9, LVM plus DST and HITL only requests 1/50 training sets compared to ResNet18. Expectedly, multimodal data can be integrated similarly, which opens up possibilities for conducting joint analyses with datasets spanning diverse domains in the era of multi-message astronomy.
△ Less
Submitted 17 May, 2024;
originally announced May 2024.
-
Radio Frequency Interference Detection Using Efficient Multi-Scale Convolutional Attention UNet
Authors:
Fei Gu,
Longfei Hao,
Bo Liang,
Song Feng,
Shoulin Wei,
Wei Dai,
Yonghua Xu,
Zhixuan Li,
Yihang Dao
Abstract:
Studying the universe through radio telescope observation is crucial. However, radio telescopes capture not only signals from the universe but also various interfering signals, known as Radio Frequency Interference (RFI). The presence of RFI can significantly impact data analysis. Ensuring the accuracy, reliability, and scientific integrity of research findings by detecting and mitigating or elimi…
▽ More
Studying the universe through radio telescope observation is crucial. However, radio telescopes capture not only signals from the universe but also various interfering signals, known as Radio Frequency Interference (RFI). The presence of RFI can significantly impact data analysis. Ensuring the accuracy, reliability, and scientific integrity of research findings by detecting and mitigating or eliminating RFI in observational data, presents a persistent challenge in radio astronomy. In this study, we proposed a novel deep learning model called EMSCA-UNet for RFI detection. The model employs multi-scale convolutional operations to extract RFI features of various scale sizes. Additionally, an attention mechanism is utilized to assign different weights to the extracted RFI feature maps, enabling the model to focus on vital features for RFI detection. We evaluated the performance of the model using real data observed from the 40-meter radio telescope at Yunnan Observatory. Furthermore, we compared our results to other models, including U-Net, RFI-Net, and R-Net, using four commonly employed evaluation metrics: precision, recall, F1 score, and IoU. The results demonstrate that our model outperforms the other models on all evaluation metrics, achieving an average improvement of approximately 5\% compared to U-Net. Our model not only enhances the accuracy and comprehensiveness of RFI detection but also provides more detailed edge detection while minimizing the loss of useful signals.
△ Less
Submitted 30 March, 2024;
originally announced April 2024.
-
Constraining black hole parameters with the precessing jet nozzle of M87*
Authors:
Shao-Wen Wei,
Yuan-Chuan Zou,
Yu-Peng Zhang,
Yu-Xiao Liu
Abstract:
Recently, Cui et al. [Nature \textbf{621}, 711 (2023)] reported that the jet nozzle of M87* exhibits a precession with a period of approximately 11 years. This finding strongly suggests that M87* is a spinning black hole with a tilted accretion disk. In this paper, our aim is to utilize these observations to constrain the parameters of the black hole. Firstly, we investigate the properties of the…
▽ More
Recently, Cui et al. [Nature \textbf{621}, 711 (2023)] reported that the jet nozzle of M87* exhibits a precession with a period of approximately 11 years. This finding strongly suggests that M87* is a spinning black hole with a tilted accretion disk. In this paper, our aim is to utilize these observations to constrain the parameters of the black hole. Firstly, we investigate the properties of the tilted circular orbits and the innermost stable circular orbits. The corresponding angular momentum, energy, and Carter constant for both prograde and retrograde orbits are calculated. We find that, compared to equatorial circular orbits, these quantities exhibit significant differences for fixed tilt angles. Moreover, the Carter constant takes positive values for nonvanishing tilt angles. Notably, the presence of misalignment of the orbit angular momentum and black hole spin leads to a precession effect in these tilted circular orbits. We then make use of these circular orbits to model the warp radius of the tilted accretion disk, which allows us to determine the corresponding precession period through the motion of massive particles. Further comparing with the observation of M87*, the relationship between the black hole spin and the warp radius is given, through which if one of them is tested, the other one will be effectively determined. Additionally, our study establishes an upper bound on the warp radius of the accretion disk. These findings demonstrate that the precession of the jet nozzle offers a promising approach for testing the physics of strong gravitational regions near a supermassive black holes.
△ Less
Submitted 1 February, 2024; v1 submitted 31 January, 2024;
originally announced January 2024.
-
Strong correlation of the neutron star core-crust transition density with the $σ$-meson mass via vacuum polarization
Authors:
Niu Li,
Wei-Zhou Jiang,
**g Ye,
Rong-Yao Yang,
Si-Na Wei
Abstract:
We study the neutron star core-crust transition density $ρ_t$ with the inclusion of the vacuum polarization in the dielectric function in the nonlinear relativistic Hartree approach (RHAn). It is found that the strong correlation between the $ρ_{t}$ and the scalar meson mass $m_σ$ strikingly overwhelms the uncertainty of the nuclear equation of state in the RHAn models, in contrast to the usual aw…
▽ More
We study the neutron star core-crust transition density $ρ_t$ with the inclusion of the vacuum polarization in the dielectric function in the nonlinear relativistic Hartree approach (RHAn). It is found that the strong correlation between the $ρ_{t}$ and the scalar meson mass $m_σ$ strikingly overwhelms the uncertainty of the nuclear equation of state in the RHAn models, in contrast to the usual awareness that $ρ_{t}$ is predominantly sensitive to the isovector nuclear potential and symmetry energy. The accurate extraction of $ρ_{t}$ through the future gravitational wave measurements can thus provide a strong constraint on the longstanding uncertainty of $m_σ$, which is of significance to better infer the vacuum property. As an astrophysical implication, it suggests that the correlation between $ρ_t$ and $m_σ$ is very favorable to reconcile the difficulty in reproducing the large crustal moment of inertia for the pulsar glitches with the well constrained symmetry energy.
△ Less
Submitted 16 February, 2023; v1 submitted 9 February, 2023;
originally announced February 2023.
-
Identify 46 New Open Clusters Candidates In Gaia EDR3 Using pyUPMASK and Random Forest Hybrid Method
Authors:
Huanbin Chi,
Shoulin Wei,
Feng Wang,
Zhongmu Li
Abstract:
Open clusters (OCs) are regarded as tracers to understand stellar evolution theory and validate stellar models. In this study, we presented a robust approach to identifying OCs. A hybrid method of pyUPMASK and RF is first used to remove field stars and determine more reliable members. An identification model based on the RF algorithm built based on 3714 OC samples from Gaia DR2 and EDR3 is then ap…
▽ More
Open clusters (OCs) are regarded as tracers to understand stellar evolution theory and validate stellar models. In this study, we presented a robust approach to identifying OCs. A hybrid method of pyUPMASK and RF is first used to remove field stars and determine more reliable members. An identification model based on the RF algorithm built based on 3714 OC samples from Gaia DR2 and EDR3 is then applied to identify OC candidates. The OC candidates are obtained after isochrone fitting, the advanced stellar population synthesis (ASPS) model fitting, and visual inspection. Using the proposed approach, we revisited 868 candidates and preliminarily clustered them by the friends-of-friends algorithm in Gaia EDR3. Excluding the open clusters that have already been reported, we focused on the remaining 300 unknown candidates. From high to low fitting quality, these unrevealed candidates were further classified into Class A (59), Class B (21), and Class C (220), respectively. As a result, 46 new reliable open cluster candidates among classes A and B are identified after visual inspection.
△ Less
Submitted 22 December, 2022;
originally announced December 2022.
-
Unsupervised Galaxy Morphological Visual Representation with Deep Contrastive Learning
Authors:
Shoulin Wei,
Yadi Li,
Wei Lu,
Nan Li,
Bo Liang,
Wei Dai,
Zhijian Zhang
Abstract:
Galaxy morphology reflects structural properties which contribute to understand the formation and evolution of galaxies. Deep convolutional networks have proven to be very successful in learning hidden features that allow for unprecedented performance on galaxy morphological classification. Such networks mostly follow the supervised learning paradigm which requires sufficient labelled data for tra…
▽ More
Galaxy morphology reflects structural properties which contribute to understand the formation and evolution of galaxies. Deep convolutional networks have proven to be very successful in learning hidden features that allow for unprecedented performance on galaxy morphological classification. Such networks mostly follow the supervised learning paradigm which requires sufficient labelled data for training. However, it is an expensive and complicated process of labeling for million galaxies, particularly for the forthcoming survey projects. In this paper, we present an approach based on contrastive learning with aim for learning galaxy morphological visual representation using only unlabeled data. Considering the properties of low semantic information and contour dominated of galaxy image, the feature extraction layer of the proposed method incorporates vision transformers and convolutional network to provide rich semantic representation via the fusion of the multi-hierarchy features. We train and test our method on 3 classifications of datasets from Galaxy Zoo 2 and SDSS-DR17, and 4 classifications from Galaxy Zoo DECaLS. The testing accuracy achieves 94.7%, 96.5% and 89.9% respectively. The experiment of cross validation demonstrates our model possesses transfer and generalization ability when applied to the new datasets. The code that reveals our proposed method and pretrained models are publicly available and can be easily adapted to new surveys.
△ Less
Submitted 14 November, 2022;
originally announced November 2022.
-
Analyses of Flight Time During Solar Proton Events and Solar Flares
Authors:
X. H. Xu,
Y. Wang,
F. S. Wei,
X. S. Feng,
M. H. Bo,
H. W. Tang,
D. S. Wang,
B. Lei,
B. Y. Wang,
P. B. Zuo,
C. W. Jiang,
X. J. Xu,
Z. L. Zhou,
Z. Li,
P. Zou,
L. D. Wang,
Y. X. Gu,
Y. L. Chen,
W. Y. Zhang,
P. Sun
Abstract:
Analyzing the effects of space weather on aviation is a new and develo** topic. It has been commonly accepted that the flight time of the polar flights may increase during solar proton events because the flights have to change their route to avoid the high-energy particles. However, apart from such phenomenon, researches related to the flight time during space weather events is very rare. Based…
▽ More
Analyzing the effects of space weather on aviation is a new and develo** topic. It has been commonly accepted that the flight time of the polar flights may increase during solar proton events because the flights have to change their route to avoid the high-energy particles. However, apart from such phenomenon, researches related to the flight time during space weather events is very rare. Based on the analyses of 39 representative international air routes around westerlies, it is found that 97.44% (94.87%) of the commercial airplanes on the westbound (eastbound) air routes reveal shorter (longer) flight time during solar proton events compared to those during quiet periods, and the averaged magnitude of change in flight time is ~10 min or 0.21%-4.17% of the total flight durations. Comparative investigations reassure the certainty of such phenomenon that the directional differences in flight time are still incontrovertible regardless of over-land routes (China-Europe) or over-sea routes (China-Western America). Further analyses suggest that the solar proton events associated atmospheric heating will change the flight durations by weakening certain atmospheric circulations, such as the polar jet stream. While the polar jet stream will not be obviously altered during solar flares so that the directional differences in flight time are not found. Besides the conventional space weather effects already known, this paper is the first report that indicates a distinct new scenario of how the solar proton events affect flight time. These analyses are also important for aviation since our discoveries could help the airways optimize the air routes to save passenger time costs, reduce fuel costs and even contribute to the global warming issues.
△ Less
Submitted 15 September, 2022;
originally announced September 2022.
-
Characteristics of Flight Delays during Solar Flares
Authors:
X. H. Xu,
Y. Wang,
F. S. Wei,
X. S. Feng,
M. H. Bo,
H. W. Tang,
D. S. Wang,
L. Bian,
B. Y. Wang,
W. Y. Zhang,
Y. S. Huang,
Z. Li,
J. P. Guo,
P. B. Zuo,
C. W. Jiang,
X. J. Xu,
Z. L. Zhou,
P. Zou
Abstract:
Solar flare is one of the severest solar activities on the sun, and it has many important impacts on the near-earth space. It has been found that flight arrival delays will increase during solar flare. However, the detailed intrinsic mechanism of how solar flares influence the delays is still unknown. Based on 5-years huge amount of flight data, here we comprehensively analyze the flight departure…
▽ More
Solar flare is one of the severest solar activities on the sun, and it has many important impacts on the near-earth space. It has been found that flight arrival delays will increase during solar flare. However, the detailed intrinsic mechanism of how solar flares influence the delays is still unknown. Based on 5-years huge amount of flight data, here we comprehensively analyze the flight departure delays during 57 solar flares. It is found that the averaged flight departure delay time during solar flares increased by 20.68% (7.67 min) compared to those during quiet periods. It is also shown that solar flare related flight delays reveal apparent time and latitude dependencies. Flight delays during dayside solar flares are more serious than those during nightside flares, and the longer (shorter) delays tend to occur in the lower (higher) latitude airport. Further analyses suggest that flight delay time and delay rate would be directly modulated by the solar intensity (soft X-ray flux) and the Solar Zenith Angle. For the first time, these results indicate that the communication interferences caused by solar flares will directly affect flight departure delay time and delay rate. This work also expands our conventional understandings to the impacts of solar flares on human society, and it could also provide us with brand new views to help prevent or cope with flight delays.
△ Less
Submitted 15 September, 2022;
originally announced September 2022.
-
The Effects of Space Weather on Flight Delays
Authors:
Y. Wang,
X. H. Xu,
F. S. Wei,
X. S. Feng,
M. H. Bo,
H. W. Tang,
D. S. Wang,
L. Bian,
B. Y. Wang,
W. Y. Zhang,
Y. S. Huang,
Z. Li,
J. P. Guo,
P. B. Zuo,
C. W. Jiang,
X. J. Xu,
Z. L. Zhou,
P. Zou
Abstract:
Although the sun is really far away from us, some solar activities could still influence the performance and reliability of space-borne and ground-based technological systems on Earth. Those time-varying conditions in space caused by the sun are also called space weather, as the atmospheric conditions that can affect weather on the ground. It is known that aviation activities can be affected durin…
▽ More
Although the sun is really far away from us, some solar activities could still influence the performance and reliability of space-borne and ground-based technological systems on Earth. Those time-varying conditions in space caused by the sun are also called space weather, as the atmospheric conditions that can affect weather on the ground. It is known that aviation activities can be affected during space weather events, but the exact effects of space weather on aviation are still unclear. Especially how the flight delays, the top topic concerned by most people, will be affected by space weather has never been thoroughly researched. By analyzing huge amount of flight data (~5X106 records), for the first time, we demonstrate that space weather events could have systematically modulating effects on flight delays. The average arrival delay time and 30-minute delay rate during space weather events are significantly increased by 81.34% and 21.45% respectively compared to those during quiet periods. The evident negative correlation between the yearly flight regularity rate and the yearly mean total sunspot number during 22 years also confirms such delay effects. Further studies indicate that the interference in communication and navigation caused by geomagnetic field fluctuations and ionospheric disturbances associated with the space weather events will increase the flight delay time and delay rate. These results expand the traditional field of space weather research and could also provide us with brand new views for improving the flight delay predications.
△ Less
Submitted 15 September, 2022;
originally announced September 2022.
-
RFI Identification Based On Deep-Learning]{A Robust RFI Identification For Radio Interferometry based on a Convolutional Neural Network
Authors:
Haomin Sun,
Hui Deng,
Feng Wang,
Ying Mei,
Tingting Xu,
Oleg Smirnov,
Linhua Deng,
Shoulin Wei
Abstract:
The rapid development of new generation radio interferometers such as the Square Kilometer Array (SKA) has opened up unprecedented opportunities for astronomical research. However, anthropogenic Radio Frequency Interference (RFI) from communication technologies and other human activities severely affects the fidelity of observational data. It also significantly reduces the sensitivity of the teles…
▽ More
The rapid development of new generation radio interferometers such as the Square Kilometer Array (SKA) has opened up unprecedented opportunities for astronomical research. However, anthropogenic Radio Frequency Interference (RFI) from communication technologies and other human activities severely affects the fidelity of observational data. It also significantly reduces the sensitivity of the telescopes. We proposed a robust Convolutional Neural Network (CNN) model to identify RFI based on machine learning methods. We overlaid RFI on the simulation data of SKA1-LOW to construct three visibility function datasets. One dataset was used for modeling, and the other two were used for validating the model's usability. The experimental results show that the Area Under the Curve (AUC) reaches 0.93, with satisfactory accuracy and precision. We then further investigated the effectiveness of the model by identifying the RFI in the actual observational data from LOFAR and MeerKAT. The results show that the model performs well. The overall effectiveness is comparable to AOFlagger software and provides an improvement over existing methods in some instances.
△ Less
Submitted 1 March, 2022;
originally announced March 2022.
-
Are the black hole remnants produced from binary black hole mergers in GWTC-3 thermodynamically stable?
Authors:
Qiang Wu,
Shao-Wen Wei,
Tao Zhu
Abstract:
Black hole thermodynamics has brought strong hints of a profound and fundamental connection between gravity, thermodynamics, and quantum theory. If the black hole does behave like a natural thermodynamic system, it should be thermodynamically stable in a clean environment. In this paper, using the observational data of binary black hole (BBH) mergers observed by LIGO, Virgo, and KAGRA detectors, w…
▽ More
Black hole thermodynamics has brought strong hints of a profound and fundamental connection between gravity, thermodynamics, and quantum theory. If the black hole does behave like a natural thermodynamic system, it should be thermodynamically stable in a clean environment. In this paper, using the observational data of binary black hole (BBH) mergers observed by LIGO, Virgo, and KAGRA detectors, we check whether the black hole remnants produced from BBH mergers in the LIGO-Virgo-KAGRA catalog GWTC-3 are thermodynamically stable. The criterion for the thermodynamic stability is quite simple and is directly related to the black hole's spin, which states that a thermodynamically stable black hole remnant requires its dimensionless spin $a>a_* \simeq 0.68$. We check the posterior distributions of final spin $a_f$ for 83 black hole remnants in GWTC-3 and find the whole remnant population is consistent with the thermodynamically stable black hole with $99.98\%$ probability. This is the first verification of the thermodynamic stability of black hole remnants produced from BBH mergers.
△ Less
Submitted 22 February, 2022; v1 submitted 18 February, 2022;
originally announced February 2022.
-
An Empirical Evaluation On the Applicability of the DALiuGE Execution Framework
Authors:
Ying Mei,
Shoulin Wei,
Feng Wang,
Chen Wu,
Rodrigo Tobar,
Mohsim Shaikh,
Hui Deng,
Wei Dai,
Bo Liang,
Andreas Wicenec
Abstract:
The Square Kilometre Array (SKA) project is an international cooperation project to build the largest radio telescope worldwide. Data processing is one of the biggest challenges of building the SKA telescope. As a distributed execution framework, the Data Activated Liu Graph Engine (DALiuGE) was proposed to be one of the candidates for addressing the massive data of the SKA. DALiuGE has many disti…
▽ More
The Square Kilometre Array (SKA) project is an international cooperation project to build the largest radio telescope worldwide. Data processing is one of the biggest challenges of building the SKA telescope. As a distributed execution framework, the Data Activated Liu Graph Engine (DALiuGE) was proposed to be one of the candidates for addressing the massive data of the SKA. DALiuGE has many distinctive features, but its actual ability to handle scientific data is still not evident. In this paper, we perform an objective evaluation of the usability of DALiuGE concerning the execution performance, developer workload, and implementation difficulty of porting the SAGECal to DALiuGE. The evaluation results showed that the DALiuGE enables fast integration of astronomical software, but there are significant differences in the efficiency of different parallel granularities. Even with the deep optimization of the program, there is still a gap between the current DALiuGE and the traditional MPI in execution performance. Therefore, we come to a preliminary conclusion that the DALiuGE has no performance advantage in batch processing of massive data, while it may be more suitable for application scenarios with more customized computational tasks, such as SKA science regional centers.
△ Less
Submitted 24 December, 2021;
originally announced December 2021.
-
Neutron star deformability with hyperonization in density-dependent relativistic mean-field models
Authors:
W. Z. Shangguan,
Z. Q. Huang,
S. N. Wei,
W. Z. Jiang
Abstract:
Neutron star tidal deformability extracted from gravitational wave data provides a novel probe to the interior neutron star structures and the associated nuclear equation of state (EOS). Instead of the popular composition of nucleons and leptons in neutron stars, we include hyperons and examine the role of hyperons in the tidal deformability and its impact on the symmetry energy in a relativistic…
▽ More
Neutron star tidal deformability extracted from gravitational wave data provides a novel probe to the interior neutron star structures and the associated nuclear equation of state (EOS). Instead of the popular composition of nucleons and leptons in neutron stars, we include hyperons and examine the role of hyperons in the tidal deformability and its impact on the symmetry energy in a relativistic mean-field approach with the density-dependent parametrizations. The hyperons are found to have significant impact on the deformability, correlated sensitively with the onset density and fraction of hyperons in neutron star matter. Moderately lower onset density of hyperons can yield considerable modification to the tidal deformability and shift its inference on the nuclear EOS. The future measurements of the tidal deformability at multi-fiducial star masses are anticipated to lift the degeneracy between the contributions from the hyperon component and symmetry energy.
△ Less
Submitted 20 August, 2021;
originally announced August 2021.
-
Enhanced Remote Astronomical Archive System Based on the File-Level Unlimited Sliding-Window Technique
Authors:
Cong-Ming Shi,
Hui Deng,
Feng Wang,
Ying Mei,
Shao-Guang Guo,
Chen Yang,
Chen Wu,
Shou-Lin Wei,
Andreas Wicenec
Abstract:
Data archiving is one of the most critical issues for modern astronomical observations. With the development of a new generation of radio telescopes, the transfer and archiving of massive remote data have become urgent problems to be solved. Herein, we present a practical and robust file-level flow-control approach, called the Unlimited Sliding-Window (USW), by referring to the classic flow-contro…
▽ More
Data archiving is one of the most critical issues for modern astronomical observations. With the development of a new generation of radio telescopes, the transfer and archiving of massive remote data have become urgent problems to be solved. Herein, we present a practical and robust file-level flow-control approach, called the Unlimited Sliding-Window (USW), by referring to the classic flow-control method in TCP protocol. Basing on the USW and the Next Generation Archive System (NGAS) developed for the Murchison Widefield Array telescope, we further implemented an enhanced archive system (ENGAS) using ZeroMQ middleware. The ENGAS substantially improves the transfer performance and ensures the integrity of transferred files. In the tests, the ENGAS is approximately three to twelve times faster than the NGAS and can fully utilize the bandwidth of network links. Thus, for archiving radio observation data, the ENGAS reduces the communication time, improves the bandwidth utilization, and solves the remote synchronous archiving of data from observatories such as Mingantu spectral radioheliograph. It also provides a better reference for the future construction of the Square Kilometer Array (SKA) Science Regional Center.
△ Less
Submitted 24 June, 2021;
originally announced June 2021.
-
Fine-grained Distributed Averaging for Large-scale Radio Interferometric Measurement Sets
Authors:
Shoulin Wei,
Kaida Luo,
Feng Wang,
Hui Deng,
Ying Mei
Abstract:
The Square Kilometer Array (SKA) would be the world's largest radio telescope with eventually over a square kilometer of collecting area. However, there are enormous challenges in its data processing. The using of modern distributed computing techniques to solve the problem of massive data processing in SKA is one of the most important challenges. In this study, basing on the Dask distribution com…
▽ More
The Square Kilometer Array (SKA) would be the world's largest radio telescope with eventually over a square kilometer of collecting area. However, there are enormous challenges in its data processing. The using of modern distributed computing techniques to solve the problem of massive data processing in SKA is one of the most important challenges. In this study, basing on the Dask distribution computational framework, and taking the visibility function integral processing as an example, we adopt a multi-level parallelism method to implement distributed averaging over time and channel. Dask Array was used to implement super large matrix or arrays with supported parallelism. To maximize the usage of memory, we further exploit the data parallelism provided by Dask that intelligently distributes the computational load across a network of computer agents and has a built-in fault tolerance mechanism. The validity of the proposed pattern was also verified by using the Common Astronomy Software Application (CASA), wherein we analyze the smearing effects on images reconstructed from different resolution visibilities.
△ Less
Submitted 24 September, 2020;
originally announced September 2020.
-
Constraining Einstein's Equivalence Principle With Multi-Wavelength Observations of Polarized Blazars
Authors:
Shuang-Xi Yi,
Yuan-Chuan Zou,
Xuan Yang,
Bin Liao,
Shao-Wen Wei
Abstract:
In this paper, we present a novel method to test the Einstein's Equivalence Principle (EEP) using (simultaneous) multi-wavelength radio observations of polarized blazars. We analyze simultaneous multi-wavelength polarization observations of 3C 279 at 22, 43, and 86 GHz obtained by two antennas of the Korean VLBI Network. We obtained 15 groups of polarization data, and applied the Metropolis-Hastin…
▽ More
In this paper, we present a novel method to test the Einstein's Equivalence Principle (EEP) using (simultaneous) multi-wavelength radio observations of polarized blazars. We analyze simultaneous multi-wavelength polarization observations of 3C 279 at 22, 43, and 86 GHz obtained by two antennas of the Korean VLBI Network. We obtained 15 groups of polarization data, and applied the Metropolis-Hastings Markov Chain (MHMC) to simulate the parameters when considering the EEP effect and the simplest form of Faraday rotation (single external Faraday screen). The final results show the constraint of the parameterized post-Newtonian (PPN) parameter $γ$ discrepancy as $Δγ_{p} = (1.91\pm0.34)\times10^{-20}$. However, the single external Faraday screen is an oversimplification for blazars because there are numerous observations show complex Faraday rotation behavior for blazars due to internal/external Faraday dispersion, beam depolarization, etc. The value $Δγ_{p}$ results of this paper can only be considered as upper limits. Only if all other effects are revealed and considered, should the result be taken as a direct measurement of the violation of the EEP.
△ Less
Submitted 9 February, 2020;
originally announced February 2020.
-
LAMOST CCD camera-control system based on RTS2
Authors:
Yuan Tian,
Zheng Wang,
Jian Li,
Zi-Huang Cao,
Wei Dai,
Shou-Lin Wei,
Yong-Heng Zhao
Abstract:
The Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) is the largest existing spectroscopic survey telescope, having 32 scientific charge-coupled-device (CCD) cameras for receiving spectra. Stability and automation of the camera-control software are essential, but cannot be provided by the existing system. The Remote Telescope System 2nd Version (RTS2) is an open-source and automa…
▽ More
The Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) is the largest existing spectroscopic survey telescope, having 32 scientific charge-coupled-device (CCD) cameras for receiving spectra. Stability and automation of the camera-control software are essential, but cannot be provided by the existing system. The Remote Telescope System 2nd Version (RTS2) is an open-source and automatic observatory-control system. However, all previous RTS2 applications have concerned small telescopes. This paper focuses on implementation of an RTS2-based camera-control system for the 32 CCDs of LAMOST. A virtual camera module inherited from the RTS2 camera module is built as a device component working on the RTS2 framework. To improve the controllability and robustness, a virtualized layer is designed using the master-slave software paradigm, and the virtual camera module is mapped to the 32 real cameras of LAMOST. The new system is deployed in the actual environment and experimentally tested. Finally, multiple observations are conducted using this new RTS2-framework-based control system. The new camera-control system is found to satisfy the requirements for LAMOST automatic camera control. This is the first time that RTS2 has been applied to a large telescope, and provides a referential solution for full RTS2 introduction to the LAMOST observatory control system.
△ Less
Submitted 24 February, 2018;
originally announced February 2018.
-
High Performance Negative Database for Massive Data Management System of The Mingantu Spectral Radioheliograph
Authors:
Congming Shi,
Feng Wang,
Hui Deng,
Yingbo Liu,
Cuiyin Liu,
Shoulin Wei
Abstract:
As a dedicated synthetic aperture radio interferometer, the MingantU SpEctral Radioheliograph (MUSER), initially known as the Chinese Spectral RadioHeliograph (CSRH), has entered the stage of routine observation. More than 23 million data records per day need to be effectively managed to provide high performance data query and retrieval for scientific data reduction. In light of these massive amou…
▽ More
As a dedicated synthetic aperture radio interferometer, the MingantU SpEctral Radioheliograph (MUSER), initially known as the Chinese Spectral RadioHeliograph (CSRH), has entered the stage of routine observation. More than 23 million data records per day need to be effectively managed to provide high performance data query and retrieval for scientific data reduction. In light of these massive amounts of data generated by the MUSER, in this paper, a novel data management technique called the negative database (ND) is proposed and used to implement a data management system for the MUSER. Based on the key-value database, the ND technique makes complete utilization of the complement set of observational data to derive the requisite information. Experimental results showed that the proposed ND can significantly reduce storage volume in comparison with a relational database management system (RDBMS). Even when considering the time needed to derive records that were absent, its overall performance, including querying and deriving the data of the ND, is comparable with that of an RDBMS. The ND technique effectively solves the problem of massive data storage for the MUSER, and is a valuable reference for the massive data management required in next-generation telescopes.
△ Less
Submitted 17 May, 2017;
originally announced May 2017.
-
OpenCluster: A Flexible Distributed Computing Framework for Astronomical Data Processing
Authors:
Shoulin Wei,
Feng Wang,
Hui Deng,
Cuiyin Liu,
Wei Dai,
Bo Liang,
Ying Mei,
Congming Shi,
Yingbo Liu,
**g** Wu
Abstract:
The volume of data generated by modern astronomical telescopes is extremely large and rapidly growing. However, current high-performance data processing architectures/frameworks are not well suited for astronomers because of their limitations and programming difficulties. In this paper, we therefore present OpenCluster, an open-source distributed computing framework to support rapidly develo** h…
▽ More
The volume of data generated by modern astronomical telescopes is extremely large and rapidly growing. However, current high-performance data processing architectures/frameworks are not well suited for astronomers because of their limitations and programming difficulties. In this paper, we therefore present OpenCluster, an open-source distributed computing framework to support rapidly develo** high-performance processing pipelines of astronomical big data. We first detail the OpenCluster design principles and implementations and present the APIs facilitated by the framework. We then demonstrate a case in which OpenCluster is used to resolve complex data processing problems for develo** a pipeline for the Mingantu Ultrawide Spectral Radioheliograph. Finally, we present our OpenCluster performance evaluation. Overall, OpenCluster provides not only high fault tolerance and simple programming interfaces, but also a flexible means of scaling up the number of interacting entities. OpenCluster thereby provides an easily integrated distributed computing framework for quickly develo** a high-performance data processing system of astronomical telescopes and for significantly reducing software development expenses.
△ Less
Submitted 17 January, 2017;
originally announced January 2017.
-
Low-cost high performance distributed data storage for multi-channel observations
Authors:
Ying-bo Liu,
Feng Wang,
Hui Deng,
Kai-fan Ji,
Wei Dai,
Shou-lin Wei,
Bo Liang,
Xiao-li Zhang
Abstract:
The New Vacuum Solar Telescope (NVST) is a 1-m solar telescope that aims to observe the fine structures in both the photosphere and the chromosphere of the Sun. The observational data acquired simultaneously from one channel for the chromosphere and two channels for the photosphere bring great challenges to the data storage of NVST. The multi-channel instruments of NVST, including scientific camer…
▽ More
The New Vacuum Solar Telescope (NVST) is a 1-m solar telescope that aims to observe the fine structures in both the photosphere and the chromosphere of the Sun. The observational data acquired simultaneously from one channel for the chromosphere and two channels for the photosphere bring great challenges to the data storage of NVST. The multi-channel instruments of NVST, including scientific cameras and multi-band spectrometers, generate at least 3 terabytes data per day and require high access performance while storing massive short-exposure images. It is worth studying and implementing a storage system for NVST which would balance the data availability, access performance and the cost of development. In this paper, we build a distributed data storage system (DDSS) for NVST and then deeply evaluate the availability of real-time data storage on a distributed computing environment. The experimental results show that two factors, i.e., the number of concurrent read/write and the file size, are critically important for improving the performance of data access on a distributed environment. Referring to these two factors, three strategies for storing FITS files are presented and implemented to ensure the access performance of the DDSS under conditions of multi-host write and read simultaneously. The real applications of the DDSS proves that the system is capable of meeting the requirements of NVST real-time high performance observational data storage. Our study on the DDSS is the first attempt for modern astronomical telescope systems to store real-time observational data on a low-cost distributed system. The research results and corresponding techniques of the DDSS provide a new option for designing real-time massive astronomical data storage system and will be a reference for future astronomical data storage.
△ Less
Submitted 22 December, 2016;
originally announced December 2016.
-
Distributed Data-Processing Pipeline for Mingantu Ultrawide Spectral Radioheliograph
Authors:
F. Wang,
Y. Mei,
H. Deng,
C. Y. Liu,
D. H. Liu,
S. L. Wei,
W. Dai,
B. Liang,
Y. B. Liu,
X. L. Zhang,
K. F. Ji
Abstract:
The Chinese Spectral RadioHeliograph (CSRH) is a synthetic aperture radio interferometer built in Inner Mongolia, China. As a solar-dedicated interferometric array, CSRH is capable of producing high quality radio images at frequency range from 400 MHz to 15 GHz with high temporal, spatial, and spectral resolution.To implement high cadence imaging at wide-band and obtain more than 2 order higher mu…
▽ More
The Chinese Spectral RadioHeliograph (CSRH) is a synthetic aperture radio interferometer built in Inner Mongolia, China. As a solar-dedicated interferometric array, CSRH is capable of producing high quality radio images at frequency range from 400 MHz to 15 GHz with high temporal, spatial, and spectral resolution.To implement high cadence imaging at wide-band and obtain more than 2 order higher multiple frequencies, the implementation of the data processing system for CSRH is a great challenge. It is urgent to build a pipeline for processing massive data of CSRH generated every day. In this paper, we develop a high performance distributed data processing pipeline (DDPP) built on the OpenCluster infrastructure for processing CSRH observational data including data storage, archiving, preprocessing, image reconstruction, deconvolution, and real-time monitoring. We comprehensively elaborate the system architecture of the pipeline and the implementation of each subsystem. The DDPP is automatic, robust, scalable and manageable. The processing performance under multi computers parallel and GPU hybrid system meets the requirements of CSRH data processing. The study presents an valuable reference for other radio telescopes especially aperture synthesis telescopes, and also gives an valuable contribution to the current and/or future data intensive astronomical observations.
△ Less
Submitted 20 December, 2016;
originally announced December 2016.
-
Equation of state and hybrid star properties with the weakly interacting light U-boson in relativistic models
Authors:
Dong-Rui Zhang,
Wei-Zhou Jiang,
Si-Na Wei,
Rong-Yao Yang,
Qian-Fei Xiang
Abstract:
It has been a puzzle whether quarks may exist in the interior of massive neutron stars, since the hadron-quark phase transition softens the equation of state (EOS) and reduce the neutron star (NS) maximum mass very significantly. In this work, we consider the light U-boson that increases the NS maximum mass appreciably through its weak coupling to fermions. The inclusion of the U-boson may thus al…
▽ More
It has been a puzzle whether quarks may exist in the interior of massive neutron stars, since the hadron-quark phase transition softens the equation of state (EOS) and reduce the neutron star (NS) maximum mass very significantly. In this work, we consider the light U-boson that increases the NS maximum mass appreciably through its weak coupling to fermions. The inclusion of the U-boson may thus allow the existence of the quark degrees of freedom in the interior of large mass neutron stars. Unlike the consequence of the U-boson in hadronic matter, the stiffening role of the U-boson in the hybrid EOS is not sensitive to the choice of the hadron phase models. In addition, we have also investigated the effect of the effective QCD correction on the hybrid EOS. This correction may reduce the coupling strength of the U-boson that is needed to satisfy NS maximum mass constraint. While the inclusion of the U-boson also increases the NS radius significantly, we find that appropriate in-medium effects of the U-boson may reduce the NS radii significantly, satisfying both the NS radius and mass constraints well.
△ Less
Submitted 14 June, 2016;
originally announced July 2016.
-
Energy dissipation processes in solar wind turbulence
Authors:
Y. Wang,
F. S. Wei,
X. S. Feng,
X. J. Xu,
J. Zhang,
T. R. Sun,
P. B. Zuo
Abstract:
Turbulence is a chaotic flow regime filled by irregular flows. The dissipation of turbulence is a fundamental problem in the realm of physics. Theoretically, dissipation cannot be ultimately achieved without collisions, and so how turbulent kinetic energy is dissipated in the nearly collisionless solar wind is a challenging problem. Wave particle interactions and magnetic reconnection are two poss…
▽ More
Turbulence is a chaotic flow regime filled by irregular flows. The dissipation of turbulence is a fundamental problem in the realm of physics. Theoretically, dissipation cannot be ultimately achieved without collisions, and so how turbulent kinetic energy is dissipated in the nearly collisionless solar wind is a challenging problem. Wave particle interactions and magnetic reconnection are two possible dissipation mechanisms, but which mechanism dominates is still a controversial topic. Here we analyze the dissipation region scaling around a solar wind magnetic reconnection region. We find that the magnetic reconnection region shows a unique multifractal scaling in the dissipation range, while the ambient solar wind turbulence reveals a monofractal dissipation process for most of the time. These results provide the first observational evidences for the intermittent multifractal dissipation region scaling around a magnetic reconnection site, and they also have significant implications for the fundamental energy dissipation process.
△ Less
Submitted 31 December, 2015; v1 submitted 11 December, 2015;
originally announced December 2015.
-
Variations of solar electron and proton flux in magnetic cloud boundary layers and comparisons with those across the shocks and in the reconnection exhausts
Authors:
Y. Wang,
F. S. Wei,
X. S. Feng,
P. B. Zuo,
J. P. Guo,
X. J. Xu,
Z. Li
Abstract:
The Magnetic cloud boundary layer (BL) is a dynamic region formed by the interaction of the magnetic cloud (MC) and the ambient solar wind. In the present study, we comparatively investigate the proton and electron mean flux variations in the BL, in the interplanetary reconnection exhaust (RE) and across the MC-driven shock by using the Wind 3DP and MFI data from 1995 to 2006. In general, the prot…
▽ More
The Magnetic cloud boundary layer (BL) is a dynamic region formed by the interaction of the magnetic cloud (MC) and the ambient solar wind. In the present study, we comparatively investigate the proton and electron mean flux variations in the BL, in the interplanetary reconnection exhaust (RE) and across the MC-driven shock by using the Wind 3DP and MFI data from 1995 to 2006. In general, the proton flux has higher increments at lower energy bands compared with the ambient solar wind. Inside the BL, the core electron flux increases quasi-isotropically and the increments decrease monotonously with energy from ~30% (at 18 eV) to ~10% (at 70 eV); the suprathermal electron flux usually increases in either parallel or antiparallel direction; the correlation coefficient of electron flux variations in parallel and antiparallel directions changes sharply from ~0.8 below 70 eV to ~0 above 70 eV. Similar results are also found for RE. However, different phenomena are found across the shock where the electron flux variations first increase and then decrease with a peak increment (>200%) near 100 eV. The correlation coefficient of electron flux variations in parallel and antiparallel directions is always around 0.8. The similar behavior of flux variations in BL and RE suggests that reconnection may commonly occur in BL. Our work also implies that the strong energy dependence and direction selectivity of electron flux variations, which are previously thought to have no enough relevance to magnetic reconnection, could be considered as an important signature of solar wind reconnection in the statistical point of view.
△ Less
Submitted 24 June, 2012;
originally announced June 2012.
-
Energetic Electrons Associated with Magnetic Reconnection in the Magnetic Cloud Boundary Layer
Authors:
Y. Wang,
F. S. Wei,
X. S. Feng,
S. H. Zhang,
P. B. Zuo,
T. R. Sun
Abstract:
Here is reported in situ observation of energetic electrons (~100-500 keV) associated with magnetic reconnection in the solar wind by the ACE and Wind spacecraft. The properties of this magnetic cloud driving reconnection and the associated energetic electron acceleration problem are discussed. Further analyses indicate that the electric field acceleration and Fermi type mechanism are two fundamen…
▽ More
Here is reported in situ observation of energetic electrons (~100-500 keV) associated with magnetic reconnection in the solar wind by the ACE and Wind spacecraft. The properties of this magnetic cloud driving reconnection and the associated energetic electron acceleration problem are discussed. Further analyses indicate that the electric field acceleration and Fermi type mechanism are two fundamental elements in the electron acceleration processes and the trap** effect of the specific magnetic field configuration maintains the acceleration status that increases the totally gained energy.
△ Less
Submitted 24 June, 2012;
originally announced June 2012.
