Showing 1–24 of 24 results for author: Pu, M

First realization of macroscopic Fourier ptychography for hundred-meter distance sub-diffraction imaging

Authors: Qi Zhang, Yuran Lu, Yinghui Guo, Yingjie Shang, Mingbo Pu, Yulong Fan, Rui Zhou, Xiaoyin Li, Fei Zhang, Mingfeng Xu, Xiangang Luo

Abstract: Fourier ptychography (FP) imaging, drawing on the idea of synthetic aperture, has been demonstrated as a potential approach for remote sub-diffraction-limited imaging. Nevertheless, the farthest imaging distance is still limited around 10 m even though there has been a significant improvement in macroscopic FP. The most severely issue in increasing the imaging distance is FoV limitation caused by… ▽ More Fourier ptychography (FP) imaging, drawing on the idea of synthetic aperture, has been demonstrated as a potential approach for remote sub-diffraction-limited imaging. Nevertheless, the farthest imaging distance is still limited around 10 m even though there has been a significant improvement in macroscopic FP. The most severely issue in increasing the imaging distance is FoV limitation caused by far-field condition for diffraction. Here, we propose to modify the Fourier far-field condition for rough reflective objects, aiming to overcome the small FoV limitation by using a divergent beam to illuminate objects. A joint optimization of pupil function and target image is utilized to attain the aberration-free image while estimating the pupil function simultaneously. Benefiting from the optimized reconstruction algorithm which effectively expands the camera's effective aperture, we experimentally implement several FP systems suited for imaging distance of 12 m, 90 m, and 170 m with the maximum synthetic aperture of 200 mm. The maximum imaging distance and synthetic aperture are thus improved by more than one order of magnitude of the state-of-the-art works with a fourfold improvement in the resolution. Our findings demonstrate significant potential for advancing the field of macroscopic FP, propelling it into a new stage of development. △ Less

Submitted 22 October, 2023; originally announced October 2023.

Tunnel-coupled optical microtraps for ultracold atoms

Authors: Shangguo Zhu, Yun Long, Wei Gou, Mingbo Pu, Xiangang Luo

Abstract: Arrays of individual atoms trapped in optical microtraps with micrometer-scale sizes have emerged as a fundamental, versatile, and powerful platform for quantum sciences and technologies. This platform enables the bottom-up engineering of quantum systems, offering the capability of low-entropy preparation of quantum states with flexible geometry, as well as manipulation and detection at the single… ▽ More Arrays of individual atoms trapped in optical microtraps with micrometer-scale sizes have emerged as a fundamental, versatile, and powerful platform for quantum sciences and technologies. This platform enables the bottom-up engineering of quantum systems, offering the capability of low-entropy preparation of quantum states with flexible geometry, as well as manipulation and detection at the single-site level. The utilization of ultracold itinerant atoms with tunnel coupling in optical microtraps provides new opportunities for quantum simulation, enabling the exploration of exotic quantum states, phases, and dynamics, which would otherwise be challenging to achieve in conventional optical lattices due to high entropy and limited geometric flexibility. Here the development of tunnel-coupled optical microtraps for the manipulation of ultracold atomic quantum systems and its recent advances are briefly reviewed. △ Less

Submitted 9 January, 2024; v1 submitted 5 July, 2023; originally announced July 2023.

Comments: Review article, 16 pages, 7 figures

Journal ref: Advanced Quantum Technologies 6, 2300176 (2023)

Physics-data-driven intelligent optimization for large-scale meta-devices

Authors: Yingli Ha, Yu Luo, Mingbo Pu, Fei Zhang, Qiong He, **** **, Mingfeng Xu, Yinghui Guo, Xiaogang Li, Xiong Li, Xiaoliang Ma, Xiangang Luo

Abstract: Meta-devices have gained significant attention and have been widely utilized in optical systems for focusing and imaging, owing to their lightweight, high-integration, and exceptional-flexibility capabilities. However, based on the assumption of local phase approximation, traditional design method neglect the local lattice coupling effect between adjacent meta-atoms, thus harming the practical per… ▽ More Meta-devices have gained significant attention and have been widely utilized in optical systems for focusing and imaging, owing to their lightweight, high-integration, and exceptional-flexibility capabilities. However, based on the assumption of local phase approximation, traditional design method neglect the local lattice coupling effect between adjacent meta-atoms, thus harming the practical performance of meta-devices. Using physics-driven or data-driven optimization algorithms can effectively solve the aforementioned problems. Nevertheless, both of the methods either involve considerable time costs or require a substantial amount of data sets. Here, we propose a physics-data-driven approach based "intelligent optimizer" that enables us to adaptively modify the sizes of the studied meta-atom according to the sizes of its surrounding ones. Such a scheme allows to mitigate the undesired local lattice coupling effect, and the proposed network model works well on thousands of datasets with a validation loss of 3*10-3. Experimental results show that the 1-mm-diameter metalens designed with the "intelligent optimizer" possesses a relative focusing efficiency of 93.4% (as compared to ideal focusing) and a Strehl ratio of 0.94. In contrast to the previous inverse design method, our method significantly boosts designing efficiency with five orders of magnitude reduction in time. Our design approach may sets a new paradigm for devising large-scale meta-devices. △ Less

Submitted 2 June, 2023; originally announced June 2023.

Comments: manuscripts:19 pages, 4 figures; Supplementary Information: 11 pages, 12 figures

Statically Detecting Buffer Overflow in Cross-language Android Applications Written in Java and C/C++

Authors: Kishanthan Thangarajah, Noble Mathews, Michael Pu, Meiyappan Nagappan, Yousra Aafer, Sridhar Chimalakonda

Abstract: Many applications are being written in more than one language to take advantage of the features that different languages provide such as native code support, improved performance, and language-specific libraries. However, there are few static analysis tools currently available to analyse the source code of such multilingual applications. Existing work on cross-language (Java and C/C++) analysis fa… ▽ More Many applications are being written in more than one language to take advantage of the features that different languages provide such as native code support, improved performance, and language-specific libraries. However, there are few static analysis tools currently available to analyse the source code of such multilingual applications. Existing work on cross-language (Java and C/C++) analysis fails to detect buffer overflow vulnerabilities that are of cross-language nature. In this work, we are addressing how to do cross-language analysis between Java and C/C++. Specifically, we propose an approach to do data flow analysis between Java and C/C++ to detect buffer overflow. We have developed PilaiPidi, a tool that can automatically analyse the data flow in projects written in Java and C/C++. Using our approach, we were able to detect 23 buffer overflow vulnerabilities, which are of cross-language nature, in six different well-known Android applications, and out of these, developers have confirmed 11 vulnerabilities in three applications. △ Less

Submitted 17 May, 2023; v1 submitted 17 May, 2023; originally announced May 2023.

The Treasure Beneath Multiple Annotations: An Uncertainty-aware Edge Detector

Authors: Caixia Zhou, Ya** Huang, Mengyang Pu, Qingji Guan, Li Huang, Haibin Ling

Abstract: Deep learning-based edge detectors heavily rely on pixel-wise labels which are often provided by multiple annotators. Existing methods fuse multiple annotations using a simple voting process, ignoring the inherent ambiguity of edges and labeling bias of annotators. In this paper, we propose a novel uncertainty-aware edge detector (UAED), which employs uncertainty to investigate the subjectivity an… ▽ More Deep learning-based edge detectors heavily rely on pixel-wise labels which are often provided by multiple annotators. Existing methods fuse multiple annotations using a simple voting process, ignoring the inherent ambiguity of edges and labeling bias of annotators. In this paper, we propose a novel uncertainty-aware edge detector (UAED), which employs uncertainty to investigate the subjectivity and ambiguity of diverse annotations. Specifically, we first convert the deterministic label space into a learnable Gaussian distribution, whose variance measures the degree of ambiguity among different annotations. Then we regard the learned variance as the estimated uncertainty of the predicted edge maps, and pixels with higher uncertainty are likely to be hard samples for edge detection. Therefore we design an adaptive weighting loss to emphasize the learning from those pixels with high uncertainty, which helps the network to gradually concentrate on the important pixels. UAED can be combined with various encoder-decoder backbones, and the extensive experiments demonstrate that UAED achieves superior performance consistently across multiple edge detection benchmarks. The source code is available at \url{https://github.com/ZhouCX117/UAED} △ Less

Submitted 21 March, 2023; originally announced March 2023.

Comments: CVPR2023

Robustness Evaluation in Hand Pose Estimation Models using Metamorphic Testing

Authors: Muxin Pu, Chun Yong Chong, Mei Kuan Lim

Abstract: Hand pose estimation (HPE) is a task that predicts and describes the hand poses from images or video frames. When HPE models estimate hand poses captured in a laboratory or under controlled environments, they normally deliver good performance. However, the real-world environment is complex, and various uncertainties may happen, which could degrade the performance of HPE models. For example, the ha… ▽ More Hand pose estimation (HPE) is a task that predicts and describes the hand poses from images or video frames. When HPE models estimate hand poses captured in a laboratory or under controlled environments, they normally deliver good performance. However, the real-world environment is complex, and various uncertainties may happen, which could degrade the performance of HPE models. For example, the hands could be occluded, the visibility of hands could be reduced by imperfect exposure rate, and the contour of hands prone to be blurred during fast hand movements. In this work, we adopt metamorphic testing to evaluate the robustness of HPE models and provide suggestions on the choice of HPE models for different applications. The robustness evaluation was conducted on four state-of-the-art models, namely MediaPipe hands, OpenPose, BodyHands, and NSRM hand. We found that on average more than 80\% of the hands could not be identified by BodyHands, and at least 50\% of hands could not be identified by MediaPipe hands when diagonal motion blur is introduced, while an average of more than 50\% of strongly underexposed hands could not be correctly estimated by NSRM hand. Similarly, applying occlusions on only four hand joints will also largely degrade the performance of these models. The experimental results show that occlusions, illumination variations, and motion blur are the main obstacles to the performance of existing HPE models. These findings may pave the way for researchers to improve the performance and robustness of hand pose estimation models and their applications. △ Less

Submitted 8 March, 2023; originally announced March 2023.

Comments: Accepted at 2023 8th International Workshop on Metamorphic Testing, 8 pages

Post-2000 Nonlinear Optical Materials and Measurements: Data Tables and Best Practices

Authors: Nathalie Vermeulen, Daniel Espinosa, Adam Ball, John Ballato, Philippe Boucaud, Georges Boudebs, Cecilia L. A. V. Campos, Peter Dragic, Anderson S. L. Gomes, Mikko J. Huttunen, Nathaniel Kinsey, Rich Mildren, Dragomir Neshev, Lazaro Padilha, Minhao Pu, Ray Secondo, Eiji Tokunaga, Dmitry Turchinovich, **gshi Yan, Kresten Yvind, Ksenia Dolgaleva, Eric W. Van Stryland

Abstract: In its 60 years of existence, the field of nonlinear optics has gained momentum especially over the past two decades thanks to major breakthroughs in material science and technology. In this article, we present a new set of data tables listing nonlinear-optical properties for different material categories as reported in the literature since 2000. The papers included in the data tables are represen… ▽ More In its 60 years of existence, the field of nonlinear optics has gained momentum especially over the past two decades thanks to major breakthroughs in material science and technology. In this article, we present a new set of data tables listing nonlinear-optical properties for different material categories as reported in the literature since 2000. The papers included in the data tables are representative experimental works on bulk materials, solvents, 0D-1D-2D materials, metamaterials, fiber waveguiding materials, on-chip waveguiding materials, hybrid waveguiding systems, and materials suitable for nonlinear optics at THz frequencies. In addition to the data tables, we also provide best practices for performing and reporting nonlinear-optical experiments. These best practices underpin the selection process that was used for including papers in the tables. While the tables indeed show strong advancements in the field over the past two decades, we encourage the nonlinear-optics community to implement the identified best practices in future works. This will allow a more adequate comparison, interpretation and use of the published parameters, and as such further stimulate the overall progress in nonlinear-optical science and applications. △ Less

Submitted 21 May, 2023; v1 submitted 15 January, 2023; originally announced January 2023.

Comments: 209 pages, 8 figures, 14 tables. Journal of Physics:Photonics (2023)

Journal ref: J. Phys. Photonics, 5, 035001 (2023)

Integrated Optical Vortex Microcomb

Authors: Bo Chen, Yueguang Zhou, Yang Liu, Chaochao Ye, Qian Cao, Peinian Huang, Chanju Kim, Yi Zheng, Leif Katsuo Oxenløwe, Kresten Yvind, ** Li, Jiaqi Li, Yanfeng Zhang, Chunhua Dong, Songnian Fu, Qiwen Zhan, Xuehua Wang, Minhao Pu, ** Liu

Abstract: The explorations of physical degrees of freedom with infinite dimensionalities, such as orbital angular momentum and frequency of light, have profoundly reshaped the landscape of modern optics with representative photonic functional devices including optical vortex emitters and frequency combs. In nanophotonics, whispering gallery mode microresonators naturally support orbital angular momentum of… ▽ More The explorations of physical degrees of freedom with infinite dimensionalities, such as orbital angular momentum and frequency of light, have profoundly reshaped the landscape of modern optics with representative photonic functional devices including optical vortex emitters and frequency combs. In nanophotonics, whispering gallery mode microresonators naturally support orbital angular momentum of light and have been demonstrated as on-chip emitters of monochromatic optical vortices. On the other hand, whispering gallery mode microresonators serve as a highly efficient nonlinear optical platform for producing light at different frequencies - i.e., microcombs. Here, we interlace the optical vortices and microcombs by demonstrating an optical vortex comb on an III-V integrated nonlinear microresonator. The angular-grating-dressed nonlinear microring simultaneously emits spatiotemporal light springs consisting of 50 orbital angular momentum modes that are each spectrally addressed to the frequency components (longitudinal whispering gallery modes) of the generated microcomb. We further experimentally generate optical pulses with time-varying orbital angular momenta by carefully introducing a specific intermodal phase relation to spatiotemporal light springs. This work may immediately boost the development of integrated nonlinear/quantum photonics for exploring fundamental optical physics and advancing photonic quantum technology. △ Less

Submitted 10 March, 2024; v1 submitted 15 December, 2022; originally announced December 2022.

Comments: To appear in Nature Photonics

Parallel compression algorithm for fast preparation of defect-free atom arrays

Authors: Shangguo Zhu, Yun Long, Mingbo Pu, Xiangang Luo

Abstract: Defect-free atom arrays have emerged as a powerful and versatile platform for quantum sciences and technologies, offering high programmability and promising scalability. The arrays can be prepared by rearranging atoms from a partially loaded initial array to the designated target sites. However, achieving large defect-free arrays presents challenges due to atom loss during rearrangement and the va… ▽ More Defect-free atom arrays have emerged as a powerful and versatile platform for quantum sciences and technologies, offering high programmability and promising scalability. The arrays can be prepared by rearranging atoms from a partially loaded initial array to the designated target sites. However, achieving large defect-free arrays presents challenges due to atom loss during rearrangement and the vacuum-limited lifetime which is inversely proportional to the array size. Efficient rearrangement algorithms which minimize time cost and atom loss are crucial for successful atom rearrangement. Here we propose a novel parallel compression algorithm which leverages multiple mobile tweezers to transfer atoms simultaneously. The total time cost could be reduced to scale linearly with the number of target sites. This algorithm can be readily implemented in current experimental setups. △ Less

Submitted 4 July, 2023; v1 submitted 6 December, 2022; originally announced December 2022.

Comments: 7 pages, 3 figures

Metamorphic Testing-based Adversarial Attack to Fool Deepfake Detectors

Authors: Nyee Thoang Lim, Meng Yi Kuan, Muxin Pu, Mei Kuan Lim, Chun Yong Chong

Abstract: Deepfakes utilise Artificial Intelligence (AI) techniques to create synthetic media where the likeness of one person is replaced with another. There are growing concerns that deepfakes can be maliciously used to create misleading and harmful digital contents. As deepfakes become more common, there is a dire need for deepfake detection technology to help spot deepfake media. Present deepfake detect… ▽ More Deepfakes utilise Artificial Intelligence (AI) techniques to create synthetic media where the likeness of one person is replaced with another. There are growing concerns that deepfakes can be maliciously used to create misleading and harmful digital contents. As deepfakes become more common, there is a dire need for deepfake detection technology to help spot deepfake media. Present deepfake detection models are able to achieve outstanding accuracy (>90%). However, most of them are limited to within-dataset scenario, where the same dataset is used for training and testing. Most models do not generalise well enough in cross-dataset scenario, where models are tested on unseen datasets from another source. Furthermore, state-of-the-art deepfake detection models rely on neural network-based classification models that are known to be vulnerable to adversarial attacks. Motivated by the need for a robust deepfake detection model, this study adapts metamorphic testing (MT) principles to help identify potential factors that could influence the robustness of the examined model, while overcoming the test oracle problem in this domain. Metamorphic testing is specifically chosen as the testing technique as it fits our demand to address learning-based system testing with probabilistic outcomes from largely black-box components, based on potentially large input domains. We performed our evaluations on MesoInception-4 and TwoStreamNet models, which are the state-of-the-art deepfake detection models. This study identified makeup application as an adversarial attack that could fool deepfake detectors. Our experimental results demonstrate that both the MesoInception-4 and TwoStreamNet models degrade in their performance by up to 30\% when the input data is perturbed with makeup. △ Less

Submitted 31 May, 2022; v1 submitted 18 April, 2022; originally announced April 2022.

Comments: paper accepted at 26TH International Conference on Pattern Recognition (ICPR2022)

EDTER: Edge Detection with Transformer

Authors: Mengyang Pu, Ya** Huang, Yuming Liu, Qingji Guan, Haibin Ling

Abstract: Convolutional neural networks have made significant progresses in edge detection by progressively exploring the context and semantic features. However, local details are gradually suppressed with the enlarging of receptive fields. Recently, vision transformer has shown excellent capability in capturing long-range dependencies. Inspired by this, we propose a novel transformer-based edge detector, \… ▽ More Convolutional neural networks have made significant progresses in edge detection by progressively exploring the context and semantic features. However, local details are gradually suppressed with the enlarging of receptive fields. Recently, vision transformer has shown excellent capability in capturing long-range dependencies. Inspired by this, we propose a novel transformer-based edge detector, \emph{Edge Detection TransformER (EDTER)}, to extract clear and crisp object boundaries and meaningful edges by exploiting the full image context information and detailed local cues simultaneously. EDTER works in two stages. In Stage I, a global transformer encoder is used to capture long-range global context on coarse-grained image patches. Then in Stage II, a local transformer encoder works on fine-grained patches to excavate the short-range local cues. Each transformer encoder is followed by an elaborately designed Bi-directional Multi-Level Aggregation decoder to achieve high-resolution features. Finally, the global context and local cues are combined by a Feature Fusion Module and fed into a decision head for edge prediction. Extensive experiments on BSDS500, NYUDv2, and Multicue demonstrate the superiority of EDTER in comparison with state-of-the-arts. △ Less

Submitted 16 March, 2022; originally announced March 2022.

Comments: Accepted by CVPR2022

Fairness Evaluation in Deepfake Detection Models using Metamorphic Testing

Authors: Muxin Pu, Meng Yi Kuan, Nyee Thoang Lim, Chun Yong Chong, Mei Kuan Lim

Abstract: Fairness of deepfake detectors in the presence of anomalies are not well investigated, especially if those anomalies are more prominent in either male or female subjects. The primary motivation for this work is to evaluate how deepfake detection model behaves under such anomalies. However, due to the black-box nature of deep learning (DL) and artificial intelligence (AI) systems, it is hard to pre… ▽ More Fairness of deepfake detectors in the presence of anomalies are not well investigated, especially if those anomalies are more prominent in either male or female subjects. The primary motivation for this work is to evaluate how deepfake detection model behaves under such anomalies. However, due to the black-box nature of deep learning (DL) and artificial intelligence (AI) systems, it is hard to predict the performance of a model when the input data is modified. Crucially, if this defect is not addressed properly, it will adversely affect the fairness of the model and result in discrimination of certain sub-population unintentionally. Therefore, the objective of this work is to adopt metamorphic testing to examine the reliability of the selected deepfake detection model, and how the transformation of input variation places influence on the output. We have chosen MesoInception-4, a state-of-the-art deepfake detection model, as the target model and makeup as the anomalies. Makeups are applied through utilizing the Dlib library to obtain the 68 facial landmarks prior to filling in the RGB values. Metamorphic relations are derived based on the notion that realistic perturbations of the input images, such as makeup, involving eyeliners, eyeshadows, blushes, and lipsticks (which are common cosmetic appearance) applied to male and female images, should not alter the output of the model by a huge margin. Furthermore, we narrow down the scope to focus on revealing potential gender biases in DL and AI systems. Specifically, we are interested to examine whether MesoInception-4 model produces unfair decisions, which should be considered as a consequence of robustness issues. The findings from our work have the potential to pave the way for new research directions in the quality assurance and fairness in DL and AI systems. △ Less

Submitted 13 March, 2022; originally announced March 2022.

Comments: 8 pages, accepted at 7th International Workshop on Metamorphic Testing (MET22)

RINDNet: Edge Detection for Discontinuity in Reflectance, Illumination, Normal and Depth

Authors: Mengyang Pu, Ya** Huang, Qingji Guan, Haibin Ling

Abstract: As a fundamental building block in computer vision, edges can be categorised into four types according to the discontinuity in surface-Reflectance, Illumination, surface-Normal or Depth. While great progress has been made in detecting generic or individual types of edges, it remains under-explored to comprehensively study all four edge types together. In this paper, we propose a novel neural netwo… ▽ More As a fundamental building block in computer vision, edges can be categorised into four types according to the discontinuity in surface-Reflectance, Illumination, surface-Normal or Depth. While great progress has been made in detecting generic or individual types of edges, it remains under-explored to comprehensively study all four edge types together. In this paper, we propose a novel neural network solution, RINDNet, to jointly detect all four types of edges. Taking into consideration the distinct attributes of each type of edges and the relationship between them, RINDNet learns effective representations for each of them and works in three stages. In stage I, RINDNet uses a common backbone to extract features shared by all edges. Then in stage II it branches to prepare discriminative features for each edge type by the corresponding decoder. In stage III, an independent decision head for each type aggregates the features from previous stages to predict the initial results. Additionally, an attention module learns attention maps for all types to capture the underlying relations between them, and these maps are combined with initial results to generate the final edge detection results. For training and evaluation, we construct the first public benchmark, BSDS-RIND, with all four types of edges carefully annotated. In our experiments, RINDNet yields promising results in comparison with state-of-the-art methods. Additional analysis is presented in supplementary material. △ Less

Submitted 1 August, 2021; originally announced August 2021.

Comments: Accepted by ICCV2021

Learning from Pixel-Level Label Noise: A New Perspective for Semi-Supervised Semantic Segmentation

Authors: Rumeng Yi, Ya** Huang, Qingji Guan, Mengyang Pu, Runsheng Zhang

Abstract: This paper addresses semi-supervised semantic segmentation by exploiting a small set of images with pixel-level annotations (strong supervisions) and a large set of images with only image-level annotations (weak supervisions). Most existing approaches aim to generate accurate pixel-level labels from weak supervisions. However, we observe that those generated labels still inevitably contain noisy l… ▽ More This paper addresses semi-supervised semantic segmentation by exploiting a small set of images with pixel-level annotations (strong supervisions) and a large set of images with only image-level annotations (weak supervisions). Most existing approaches aim to generate accurate pixel-level labels from weak supervisions. However, we observe that those generated labels still inevitably contain noisy labels. Motivated by this observation, we present a novel perspective and formulate this task as a problem of learning with pixel-level label noise. Existing noisy label methods, nevertheless, mainly aim at image-level tasks, which can not capture the relationship between neighboring labels in one image. Therefore, we propose a graph based label noise detection and correction framework to deal with pixel-level noisy labels. In particular, for the generated pixel-level noisy labels from weak supervisions by Class Activation Map (CAM), we train a clean segmentation model with strong supervisions to detect the clean labels from these noisy labels according to the cross-entropy loss. Then, we adopt a superpixel-based graph to represent the relations of spatial adjacency and semantic similarity between pixels in one image. Finally we correct the noisy labels using a Graph Attention Network (GAT) supervised by detected clean labels. We comprehensively conduct experiments on PASCAL VOC 2012, PASCAL-Context and MS-COCO datasets. The experimental results show that our proposed semi supervised method achieves the state-of-the-art performances and even outperforms the fully-supervised models on PASCAL VOC 2012 and MS-COCO datasets in some cases. △ Less

Submitted 25 March, 2021; originally announced March 2021.

Shadow Removal by a Lightness-Guided Network with Training on Unpaired Data

Authors: Zhihao Liu, Hui Yin, Yang Mi, Mengyang Pu, Song Wang

Abstract: Shadow removal can significantly improve the image visual quality and has many applications in computer vision. Deep learning methods based on CNNs have become the most effective approach for shadow removal by training on either paired data, where both the shadow and underlying shadow-free versions of an image are known, or unpaired data, where shadow and shadow-free training images are totally di… ▽ More Shadow removal can significantly improve the image visual quality and has many applications in computer vision. Deep learning methods based on CNNs have become the most effective approach for shadow removal by training on either paired data, where both the shadow and underlying shadow-free versions of an image are known, or unpaired data, where shadow and shadow-free training images are totally different with no correspondence. In practice, CNN training on unpaired data is more preferred given the easiness of training data collection. In this paper, we present a new Lightness-Guided Shadow Removal Network (LG-ShadowNet) for shadow removal by training on unpaired data. In this method, we first train a CNN module to compensate for the lightness and then train a second CNN module with the guidance of lightness information from the first CNN module for final shadow removal. We also introduce a loss function to further utilise the colour prior of existing data. Extensive experiments on widely used ISTD, adjusted ISTD and USR datasets demonstrate that the proposed method outperforms the state-of-the-art methods with training on unpaired data. △ Less

Submitted 28 June, 2020; originally announced June 2020.

Comments: Submitted to IEEE TIP

High-pressure isostructural transition in nitrogen

Authors: Shan Liu, Meifang Pu, Qiqi Tang, Feng Zhang, Binbin Wu, Li Lei

Abstract: Understanding high-pressure transitions in prototypical linear diatomic molecules, such as hydrogen, nitrogen, and oxygen, is an important objective in high-pressure physics. Recent ultrahigh-pressure study on hydrogen revealed that there exists a molecular-symmetry-breaking isostructural electronic transition in hydrogen. The pressure-induced symmetry breaking could also lead to a series of solid… ▽ More Understanding high-pressure transitions in prototypical linear diatomic molecules, such as hydrogen, nitrogen, and oxygen, is an important objective in high-pressure physics. Recent ultrahigh-pressure study on hydrogen revealed that there exists a molecular-symmetry-breaking isostructural electronic transition in hydrogen. The pressure-induced symmetry breaking could also lead to a series of solid molecular phases in nitrogen associated with the splitting of vibron, walking a path from fluid nitrogen to molecular solids and then to polymetric nitrogen phases. However, isostructural transition in nitrogen has not been reported so far, which may provide crucial information on the crystallographic nature of the pressure-induced dissociation transitions in nitrogen. Here we present a high-pressure Raman scattering and high-pressure angle dispersive X-ray diffraction study of the previously reported lambda-N2 and reveal an isostructural transition from the lambda-N2 to a new derivative phase, lambda-N2. Under compression, lambda-N2 remains in the monoclinic crystal lattice, accompanied by a monotonic increase in anisotropy. The pressure-dependent decrease of the unit cell parameters exhibits a discontinuity at the pressure of 54 GPa, accompany with sudden broadening and turnover of vibron. △ Less

Submitted 30 October, 2019; originally announced October 2019.

Comments: 19 pages, 5 figures

Object Discovery From a Single Unlabeled Image by Mining Frequent Itemset With Multi-scale Features

Authors: Runsheng Zhang, Ya** Huang, Mengyang Pu, Jian Zhang, Qingji Guan, Qi Zou, Haibin Ling

Abstract: TThe goal of our work is to discover dominant objects in a very general setting where only a single unlabeled image is given. This is far more challenge than typical co-localization or weakly-supervised localization tasks. To tackle this problem, we propose a simple but effective pattern mining-based method, called Object Location Mining (OLM), which exploits the advantages of data mining and feat… ▽ More TThe goal of our work is to discover dominant objects in a very general setting where only a single unlabeled image is given. This is far more challenge than typical co-localization or weakly-supervised localization tasks. To tackle this problem, we propose a simple but effective pattern mining-based method, called Object Location Mining (OLM), which exploits the advantages of data mining and feature representation of pre-trained convolutional neural networks (CNNs). Specifically, we first convert the feature maps from a pre-trained CNN model into a set of transactions, and then discovers frequent patterns from transaction database through pattern mining techniques. We observe that those discovered patterns, i.e., co-occurrence highlighted regions, typically hold appearance and spatial consistency. Motivated by this observation, we can easily discover and localize possible objects by merging relevant meaningful patterns. Extensive experiments on a variety of benchmarks demonstrate that OLM achieves competitive localization performance compared with the state-of-the-art methods. We also evaluate our approach compared with unsupervised saliency detection methods and achieves competitive results on seven benchmark datasets. Moreover, we conduct experiments on fine-grained classification to show that our proposed method can locate the entire object and parts accurately, which can benefit to improving the classification results significantly. △ Less

Submitted 8 August, 2020; v1 submitted 26 February, 2019; originally announced February 2019.

Polarization Symmetry Breaking in Nitrogen under High Pressure

Authors: Meifang Pu, Li Lei

Abstract: An order parameter with broken polarization symmetry is proposed for the pressure-induced molecular dissociation transitions in nitrogen. The experimental dissociative transition pressure dependence of the calculated order parameter is well described by a power law of the form P=kq2. Our results unveil the important role of symmetry breaking in nitrogen under high pressure and further demonstrate… ▽ More An order parameter with broken polarization symmetry is proposed for the pressure-induced molecular dissociation transitions in nitrogen. The experimental dissociative transition pressure dependence of the calculated order parameter is well described by a power law of the form P=kq2. Our results unveil the important role of symmetry breaking in nitrogen under high pressure and further demonstrate a path from dense molecular fluid to fully polymeric phases by breaking local polarization reversal symmetry. △ Less

Submitted 19 January, 2019; v1 submitted 12 September, 2018; originally announced September 2018.

Comments: 14 pages, 3 figures

Journal ref: Solid State Communications Volume 298, August 2019, 113645

Emergence of collective dynamical chirality for achiral active particles

Authors: Huijun Jiang, Huai Ding, Mingfeng Pu, Zhonghuai Hou

Abstract: Emergence of collective dynamical chirality (CDC) at mesoscopic scales plays a key role in many formation processes of chiral structures in nature, which may also provide possible routines for people to fabricate complex chiral architectures. So far, most of reported CDCs are found in systems of active objects with individual structure chirality or/and dynamical chirality, and whether CDC can aris… ▽ More Emergence of collective dynamical chirality (CDC) at mesoscopic scales plays a key role in many formation processes of chiral structures in nature, which may also provide possible routines for people to fabricate complex chiral architectures. So far, most of reported CDCs are found in systems of active objects with individual structure chirality or/and dynamical chirality, and whether CDC can arise from simple and achiral units is still an attractive mystery. Here, we report a spontaneous formation of CDC in a system of both dynamically and structurally achiral particles motivated by active motion of cells. Active moving, confinement and hydrodynamic interaction are found to be the three key factors. Detailed analysis shows that the system can support abundant collective dynamical behaviors, including rotating droplet, rotating bubble, CDC oscillation, array of collective rotation, as well as interesting transitions such as chirality transition, structure transition and state reentrance. △ Less

Submitted 14 February, 2017; v1 submitted 1 October, 2016; originally announced October 2016.

Comments: 5 pages, 4 figures

Octave-spanning supercontinuum generation in a silicon-rich nitride waveguide

Authors: Xing Liu, Minhao Pu, Binbin Zhou, Clemens J. Krückel, Attila Fülöp, Victor Torres-Company, Morten Bache

Abstract: We experimentally show octave-spanning supercontinuum generation in a non-stoichiometric silicon-rich nitride waveguide when pumped by femtosecond pulses from an erbium fiber laser. The pulse energy and bandwidth are comparable to results achieved in stoichiometric silicon nitride waveguides, but our material platform is simpler to manufacture. We also observe wave-breaking supercontinuum generati… ▽ More We experimentally show octave-spanning supercontinuum generation in a non-stoichiometric silicon-rich nitride waveguide when pumped by femtosecond pulses from an erbium fiber laser. The pulse energy and bandwidth are comparable to results achieved in stoichiometric silicon nitride waveguides, but our material platform is simpler to manufacture. We also observe wave-breaking supercontinuum generation by using orthogonal pum** in the same waveguide. Additional analysis reveals that the waveguide height is a powerful tuning parameter for generating mid-infrared dispersive waves while kee** the pump in the telecom band. △ Less

Submitted 2 June, 2016; originally announced June 2016.

Comments: Accepted for OL, https://www.osapublishing.org/ol/upcoming_pdf.cfm?id=263052

Journal ref: Optics Letters 41, 2719-2722 (2016)

AlGaAs-On-Insulator Nonlinear Photonics

Authors: Minhao Pu, Luisa Ottaviano, Elizaveta Semenova, Kresten Yvind

Abstract: The combination of nonlinear and integrated photonics has recently seen a surge with Kerr frequency comb generation in micro-resonators as the most significant achievement. Efficient nonlinear photonic chips have myriad applications including high speed optical signal processing, on-chip multi-wavelength lasers, metrology, molecular spectroscopy, and quantum information science. Aluminium gallium… ▽ More The combination of nonlinear and integrated photonics has recently seen a surge with Kerr frequency comb generation in micro-resonators as the most significant achievement. Efficient nonlinear photonic chips have myriad applications including high speed optical signal processing, on-chip multi-wavelength lasers, metrology, molecular spectroscopy, and quantum information science. Aluminium gallium arsenide (AlGaAs) exhibits very high material nonlinearity and low nonlinear loss when operated below half its bandgap energy. However, difficulties in device processing and low device effective nonlinearity made Kerr frequency comb generation elusive. Here, we demonstrate AlGaAs-on-insulator as a nonlinear platform at telecom wavelengths. Using newly developed fabrication processes, we show high-quality-factor (Q>100,000) micro-resonators with integrated bus waveguides in a planar circuit where optical parametric oscillation is achieved with a record low threshold power of 3 mW and a frequency comb spanning 350 nm is obtained. Our demonstration shows the huge potential of the AlGaAs-on-insulator platform in integrated nonlinear photonics. △ Less

Submitted 11 September, 2015; originally announced September 2015.

Comments: 21 pages, 12 figures, 1 table, 41 references

Journal ref: Optica 3, 823-826 (2016)

An Efficient Self-optimized Sampling Method for Rare Events in Nonequilibrium Systems

Authors: Huijun Jiang, Mingfeng Pu, Zhonghuai Hou

Abstract: Rare events such as nucleation processes are of ubiquitous importance in real systems. The most popular method for nonequilibrium systems, forward flux sampling (FFS), samples rare events by using interfaces to partition the whole transition process into sequence of steps along an order parameter connecting the initial and final states. FFS usually suffers from two main difficulties: low computati… ▽ More Rare events such as nucleation processes are of ubiquitous importance in real systems. The most popular method for nonequilibrium systems, forward flux sampling (FFS), samples rare events by using interfaces to partition the whole transition process into sequence of steps along an order parameter connecting the initial and final states. FFS usually suffers from two main difficulties: low computational efficiency due to bad interface locations and even being not applicable when trap** into unknown intermediate metastable states. In the present work, we propose an approach to overcome these difficulties, by self-adaptively locating the interfaces on the fly in an optimized manner. Contrary to the conventional FFS which set the interfaces with euqal distance of the order parameter, our approach determines the interfaces with equal transition probability which is shown to satisfy the optimization condition. This is done by firstly running long local trajectories starting from the current interface $ł_i$ to get the conditional probability distribution $P_c$, and then determining $ł_{i+1}$ by equalling $P_c$ to a give value $p_0$. With these optimized interfaces, FFS can be run in a much efficient way. In addition, our approach can conveniently find the intermediate metastable states by monitoring some special long trajectories that nither end at the initial state nor reach the next interface, the number of which will increase sharply from zero if such metastable states are encountered. We apply our approach to a model two-state system and a two-dimensional lattice gas Ising model. Our approach is shown to be much more efficient than the conventional FFS method without losing accuracy, and it can also well reproduce the two-step nucleation scenario of the Ising model with easy identification of the intermidiate metastable state. △ Less

Submitted 8 August, 2013; originally announced August 2013.

Comments: 6 pages, 6 figures

Statistical tests for the intersection of independent lists of genes: Sensitivity, FDR, and type I error control

Authors: Loki Natarajan, Minya Pu, Karen Messer

Abstract: Public data repositories have enabled researchers to compare results across multiple genomic studies in order to replicate findings. A common approach is to first rank genes according to an hypothesis of interest within each study. Then, lists of the top-ranked genes within each study are compared across studies. Genes recaptured as highly ranked (usually above some threshold) in multiple studies… ▽ More Public data repositories have enabled researchers to compare results across multiple genomic studies in order to replicate findings. A common approach is to first rank genes according to an hypothesis of interest within each study. Then, lists of the top-ranked genes within each study are compared across studies. Genes recaptured as highly ranked (usually above some threshold) in multiple studies are considered to be significant. However, this comparison strategy often remains informal, in that type I error and false discovery rate (FDR) are usually uncontrolled. In this paper, we formalize an inferential strategy for this kind of list-intersection discovery test. We show how to compute a $p$-value associated with a "recaptured" set of genes, using a closed-form Poisson approximation to the distribution of the size of the recaptured set. We investigate operating characteristics of the test as a function of the total number of studies considered, the rank threshold within each study, and the number of studies within which a gene must be recaptured to be declared significant. We investigate the trade off between FDR control and expected sensitivity (the expected proportion of true-positive genes identified as significant). We give practical guidance on how to design a bioinformatic list-intersection study with maximal expected sensitivity and prespecified control of type I error (at the set level) and false discovery rate (at the gene level). We show how optimal choice of parameters may depend on particular alternative hypothesis which might hold. We illustrate our methods using prostate cancer gene-expression datasets from the curated Oncomine database, and discuss the effects of dependence between genes on the test. △ Less

Submitted 28 June, 2012; originally announced June 2012.

Comments: Published in at http://dx.doi.org/10.1214/11-AOAS510 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOAS-AOAS510

Journal ref: Annals of Applied Statistics 2012, Vol. 6, No. 2, 521-541

The Influence of Synthesis Parameters on Microstructures and Superconducting Properties of MgB2 Bulks

Authors: Y. F. Wu, Y. Feng, G. Yan, J. S. Li, H. P. Tang, S. K. Chen, Y. Zhao, M. H. Pu, H. L. Xu, C. S. Li, Y. F. Lu

Abstract: We succeeded in the synthesis of high-Jc MgB2 bulks via high energy ball-milling of elemental Mg and B powder at ambient temperatures. Alternatively to longtime mechanical alloying technique, the mixed powder was ball-milled for only 1h and the completed reaction is achieved by subsequent annealing. The correlations among synthesis parameters, microstructures and superconducting properties in Mg… ▽ More We succeeded in the synthesis of high-Jc MgB2 bulks via high energy ball-milling of elemental Mg and B powder at ambient temperatures. Alternatively to longtime mechanical alloying technique, the mixed powder was ball-milled for only 1h and the completed reaction is achieved by subsequent annealing. The correlations among synthesis parameters, microstructures and superconducting properties in MgB2 bulks were investigated. Samples were characterized by XRD and SEM, and the magnetization properties were examined in a SQUID magnetometer. The high- Jc, approximately 1.7*106A/cm2(15K, 0.59T), and improved flux pinning were attribute to a large number of grain boundaries provided by small grain size. △ Less

Submitted 23 March, 2006; v1 submitted 20 March, 2006; originally announced March 2006.

Comments: 19 pages, 12 figures,figure9 is replaced for it repeats with figure 10 by mistake

Journal ref: Physica C 467 (2007) pp.38_42