-
Real-Time Compressed Sensing for Joint Hyperspectral Image Transmission and Restoration for CubeSat
Authors:
Chih-Chung Hsu,
Chih-Yu Jian,
Eng-Shen Tu,
Chia-Ming Lee,
Guan-Lin Chen
Abstract:
This paper addresses the challenges associated with hyperspectral image (HSI) reconstruction from miniaturized satellites, which often suffer from stripe effects and are computationally resource-limited. We propose a Real-Time Compressed Sensing (RTCS) network designed to be lightweight and require only relatively few training samples for efficient and robust HSI reconstruction in the presence of…
▽ More
This paper addresses the challenges associated with hyperspectral image (HSI) reconstruction from miniaturized satellites, which often suffer from stripe effects and are computationally resource-limited. We propose a Real-Time Compressed Sensing (RTCS) network designed to be lightweight and require only relatively few training samples for efficient and robust HSI reconstruction in the presence of the stripe effect and under noisy transmission conditions. The RTCS network features a simplified architecture that reduces the required training samples and allows for easy implementation on integer-8-based encoders, facilitating rapid compressed sensing for stripe-like HSI, which exactly matches the moderate design of miniaturized satellites on push broom scanning mechanism. This contrasts optimization-based models that demand high-precision floating-point operations, making them difficult to deploy on edge devices. Our encoder employs an integer-8-compatible linear projection for stripe-like HSI data transmission, ensuring real-time compressed sensing. Furthermore, based on the novel two-streamed architecture, an efficient HSI restoration decoder is proposed for the receiver side, allowing for edge-device reconstruction without needing a sophisticated central server. This is particularly crucial as an increasing number of miniaturized satellites necessitates significant computing resources on the ground station. Extensive experiments validate the superior performance of our approach, offering new and vital capabilities for existing miniaturized satellite systems.
△ Less
Submitted 24 April, 2024;
originally announced April 2024.
-
Islander: A Real-Time News Monitoring and Analysis System
Authors:
Chao-Wei Huang,
Kai-Chou Yang,
Zi-Yuan Chen,
Hao-Chien Cheng,
Po-Yu Wu,
Yu-Yang Huang,
Chung-Kai Hsieh,
Geng-Zhi Wildsky Fann,
Ting-Yin Cheng,
Ethan Tu,
Yun-Nung Chen
Abstract:
With thousands of news articles from hundreds of sources distributed and shared every day, news consumption and information acquisition have been increasingly difficult for readers. Additionally, the content of news articles is becoming catchy or even inciting to attract readership, harming the accuracy of news reporting. We present Islander, an online news analyzing system. The system allows user…
▽ More
With thousands of news articles from hundreds of sources distributed and shared every day, news consumption and information acquisition have been increasingly difficult for readers. Additionally, the content of news articles is becoming catchy or even inciting to attract readership, harming the accuracy of news reporting. We present Islander, an online news analyzing system. The system allows users to browse trending topics with articles from multiple sources and perspectives. We define several metrics as proxies for news quality, and develop algorithms for automatic estimation. The quality estimation results are delivered through a web interface to newsreaders for easy access to news and information. The website is publicly available at https://islander.cc/
△ Less
Submitted 25 April, 2022;
originally announced April 2022.
-
Stereo Endoscopic Image Super-Resolution Using Disparity-Constrained Parallel Attention
Authors:
Tianyi Zhang,
Yun Gu,
Xiaolin Huang,
Enmei Tu,
Jie Yang
Abstract:
With the popularity of stereo cameras in computer assisted surgery techniques, a second viewpoint would provide additional information in surgery. However, how to effectively access and use stereo information for the super-resolution (SR) purpose is often a challenge. In this paper, we propose a disparity-constrained stereo super-resolution network (DCSSRnet) to simultaneously compute a super-reso…
▽ More
With the popularity of stereo cameras in computer assisted surgery techniques, a second viewpoint would provide additional information in surgery. However, how to effectively access and use stereo information for the super-resolution (SR) purpose is often a challenge. In this paper, we propose a disparity-constrained stereo super-resolution network (DCSSRnet) to simultaneously compute a super-resolved image in a stereo image pair. In particular, we incorporate a disparity-based constraint mechanism into the generation of SR images in a deep neural network framework with an additional atrous parallax-attention modules. Experiment results on laparoscopic images demonstrate that the proposed framework outperforms current SR methods on both quantitative and qualitative evaluations. Our DCSSRnet provides a promising solution on enhancing spatial resolution of stereo image pairs, which will be extremely beneficial for the endoscopic surgery.
△ Less
Submitted 18 March, 2020;
originally announced March 2020.
-
End-To-End Graph-based Deep Semi-Supervised Learning
Authors:
Zihao Wang,
Enmei Tu,
Zhou Meng
Abstract:
The quality of a graph is determined jointly by three key factors of the graph: nodes, edges and similarity measure (or edge weights), and is very crucial to the success of graph-based semi-supervised learning (SSL) approaches. Recently, dynamic graph, which means part/all its factors are dynamically updated during the training process, has demonstrated to be promising for graph-based semi-supervi…
▽ More
The quality of a graph is determined jointly by three key factors of the graph: nodes, edges and similarity measure (or edge weights), and is very crucial to the success of graph-based semi-supervised learning (SSL) approaches. Recently, dynamic graph, which means part/all its factors are dynamically updated during the training process, has demonstrated to be promising for graph-based semi-supervised learning. However, existing approaches only update part of the three factors and keep the rest manually specified during the learning stage. In this paper, we propose a novel graph-based semi-supervised learning approach to optimize all three factors simultaneously in an end-to-end learning fashion. To this end, we concatenate two neural networks (feature network and similarity network) together to learn the categorical label and semantic similarity, respectively, and train the networks to minimize a unified SSL objective function. We also introduce an extended graph Laplacian regularization term to increase training efficiency. Extensive experiments on several benchmark datasets demonstrate the effectiveness of our approach.
△ Less
Submitted 23 February, 2020;
originally announced February 2020.
-
Modeling Historical AIS Data For Vessel Path Prediction: A Comprehensive Treatment
Authors:
Enmei Tu,
Guanghao Zhang,
Shangbo Mao,
Lily Rachmawati,
Guang-Bin Huang
Abstract:
The prosperity of artificial intelligence has aroused intensive interests in intelligent/autonomous navigation, in which path prediction is a key functionality for decision supports, e.g. route planning, collision warning, and traffic regulation. For maritime intelligence, Automatic Identification System (AIS) plays an important role because it recently has been made compulsory for large internati…
▽ More
The prosperity of artificial intelligence has aroused intensive interests in intelligent/autonomous navigation, in which path prediction is a key functionality for decision supports, e.g. route planning, collision warning, and traffic regulation. For maritime intelligence, Automatic Identification System (AIS) plays an important role because it recently has been made compulsory for large international commercial vessels and is able to provide nearly real-time information of the vessel. Therefore AIS data based vessel path prediction is a promising way in future maritime intelligence. However, real-world AIS data collected online are just highly irregular trajectory segments (AIS message sequences) from different types of vessels and geographical regions, with possibly very low data quality. So even there are some works studying how to build a path prediction model using historical AIS data, but still, it is a very challenging problem. In this paper, we propose a comprehensive framework to model massive historical AIS trajectory segments for accurate vessel path prediction. Experimental comparisons with existing popular methods are made to validate the proposed approach and results show that our approach could outperform the baseline methods by a wide margin.
△ Less
Submitted 9 January, 2022; v1 submitted 2 January, 2020;
originally announced January 2020.
-
Semi-Supervised Deep Learning Using Improved Unsupervised Discriminant Projection
Authors:
Xiao Han,
Zihao Wang,
Enmei Tu,
Gunnam Suryanarayana,
Jie Yang
Abstract:
Deep learning demands a huge amount of well-labeled data to train the network parameters. How to use the least amount of labeled data to obtain the desired classification accuracy is of great practical significance, because for many real-world applications (such as medical diagnosis), it is difficult to obtain so many labeled samples. In this paper, modify the unsupervised discriminant projection…
▽ More
Deep learning demands a huge amount of well-labeled data to train the network parameters. How to use the least amount of labeled data to obtain the desired classification accuracy is of great practical significance, because for many real-world applications (such as medical diagnosis), it is difficult to obtain so many labeled samples. In this paper, modify the unsupervised discriminant projection algorithm from dimension reduction and apply it as a regularization term to propose a new semi-supervised deep learning algorithm, which is able to utilize both the local and nonlocal distribution of abundant unlabeled samples to improve classification performance. Experiments show that given dozens of labeled samples, the proposed algorithm can train a deep network to attain satisfactory classification results.
△ Less
Submitted 19 December, 2019;
originally announced December 2019.
-
A Review of Semi Supervised Learning Theories and Recent Advances
Authors:
Enmei Tu,
Jie Yang
Abstract:
Semi-supervised learning, which has emerged from the beginning of this century, is a new type of learning method between traditional supervised learning and unsupervised learning. The main idea of semi-supervised learning is to introduce unlabeled samples into the model training process to avoid performance (or model) degeneration due to insufficiency of labeled samples. Semi-supervised learning h…
▽ More
Semi-supervised learning, which has emerged from the beginning of this century, is a new type of learning method between traditional supervised learning and unsupervised learning. The main idea of semi-supervised learning is to introduce unlabeled samples into the model training process to avoid performance (or model) degeneration due to insufficiency of labeled samples. Semi-supervised learning has been applied successfully in many fields. This paper reviews the development process and main theories of semi-supervised learning, as well as its recent advances and importance in solving real-world problems demonstrated by typical application examples.
△ Less
Submitted 27 May, 2019;
originally announced May 2019.
-
A Theoretical Study of The Relationship Between Whole An ELM Network and Its Subnetworks
Authors:
Enmei Tu,
Guanghao Zhang,
Lily Rachmawati,
Eshan Rajabally,
Guang-Bin Huang
Abstract:
A biological neural network is constituted by numerous subnetworks and modules with different functionalities. For an artificial neural network, the relationship between a network and its subnetworks is also important and useful for both theoretical and algorithmic research, i.e. it can be exploited to develop incremental network training algorithm or parallel network training algorithm. In this p…
▽ More
A biological neural network is constituted by numerous subnetworks and modules with different functionalities. For an artificial neural network, the relationship between a network and its subnetworks is also important and useful for both theoretical and algorithmic research, i.e. it can be exploited to develop incremental network training algorithm or parallel network training algorithm. In this paper we explore the relationship between an ELM neural network and its subnetworks. To the best of our knowledge, we are the first to prove a theorem that shows an ELM neural network can be scattered into subnetworks and its optimal solution can be constructed recursively by the optimal solutions of these subnetworks. Based on the theorem we also present two algorithms to train a large ELM neural network efficiently: one is a parallel network training algorithm and the other is an incremental network training algorithm. The experimental results demonstrate the usefulness of the theorem and the validity of the developed algorithms.
△ Less
Submitted 30 October, 2016;
originally announced October 2016.
-
An Automatic Identification System (AIS) Database for Maritime Trajectory Prediction and Data Mining
Authors:
Shangbo Mao,
Enmei Tu,
Guanghao Zhang,
Lily Rachmawati,
Eshan Rajabally,
Guang-Bin Huang
Abstract:
In recent years, maritime safety and efficiency become more and more important across the world. Automatic Identification System (AIS) tracks vessel movement by onboard transceiver and terrestrial and/or satellite base station. The data collected by AIS contains broadcast kinematic information and static information. Both of them are useful for anomaly detection and route prediction which are key…
▽ More
In recent years, maritime safety and efficiency become more and more important across the world. Automatic Identification System (AIS) tracks vessel movement by onboard transceiver and terrestrial and/or satellite base station. The data collected by AIS contains broadcast kinematic information and static information. Both of them are useful for anomaly detection and route prediction which are key techniques in intelligent maritime research area. This paper is devoted to construct a standard AIS database for maritime trajectory learning, prediction and data mining. A path prediction algorithm is tested on this AIS database and the testing results show this database can be used as a standardized training resource for different trajectory prediction algorithms and other AIS data mining algorithms.
△ Less
Submitted 13 October, 2016; v1 submitted 12 July, 2016;
originally announced July 2016.
-
A Graph-Based Semi-Supervised k Nearest-Neighbor Method for Nonlinear Manifold Distributed Data Classification
Authors:
Enmei Tu,
Yaqian Zhang,
Lin Zhu,
Jie Yang,
Nikola Kasabov
Abstract:
$k$ Nearest Neighbors ($k$NN) is one of the most widely used supervised learning algorithms to classify Gaussian distributed data, but it does not achieve good results when it is applied to nonlinear manifold distributed data, especially when a very limited amount of labeled samples are available. In this paper, we propose a new graph-based $k…
▽ More
$k$ Nearest Neighbors ($k$NN) is one of the most widely used supervised learning algorithms to classify Gaussian distributed data, but it does not achieve good results when it is applied to nonlinear manifold distributed data, especially when a very limited amount of labeled samples are available. In this paper, we propose a new graph-based $k$NN algorithm which can effectively handle both Gaussian distributed data and nonlinear manifold distributed data. To achieve this goal, we first propose a constrained Tired Random Walk (TRW) by constructing an $R$-level nearest-neighbor strengthened tree over the graph, and then compute a TRW matrix for similarity measurement purposes. After this, the nearest neighbors are identified according to the TRW matrix and the class label of a query point is determined by the sum of all the TRW weights of its nearest neighbors. To deal with online situations, we also propose a new algorithm to handle sequential samples based a local neighborhood reconstruction. Comparison experiments are conducted on both synthetic data sets and real-world data sets to demonstrate the validity of the proposed new $k$NN algorithm and its improvements to other version of $k$NN algorithms. Given the widespread appearance of manifold structures in real-world problems and the popularity of the traditional $k$NN algorithm, the proposed manifold version $k$NN shows promising potential for classifying manifold-distributed data.
△ Less
Submitted 3 June, 2016;
originally announced June 2016.
-
Exploiting AIS Data for Intelligent Maritime Navigation: A Comprehensive Survey
Authors:
Enmei Tu,
Guanghao Zhang,
Lily Rachmawati,
Eshan Rajabally,
Guang-Bin Huang
Abstract:
The Automatic Identification System (AIS) tracks vessel movement by means of electronic exchange of navigation data between vessels, with onboard transceiver, terrestrial and/or satellite base stations. The gathered data contains a wealth of information useful for maritime safety, security and efficiency. This paper surveys AIS data sources and relevant aspects of navigation in which such data is…
▽ More
The Automatic Identification System (AIS) tracks vessel movement by means of electronic exchange of navigation data between vessels, with onboard transceiver, terrestrial and/or satellite base stations. The gathered data contains a wealth of information useful for maritime safety, security and efficiency. This paper surveys AIS data sources and relevant aspects of navigation in which such data is or could be exploited for safety of seafaring, namely traffic anomaly detection, route estimation, collision prediction and path planning.
△ Less
Submitted 3 June, 2016;
originally announced June 2016.
-
Map** Temporal Variables into the NeuCube for Improved Pattern Recognition, Predictive Modelling and Understanding of Stream Data
Authors:
Enmei Tu,
Nikola Kasabov,
Jie Yang
Abstract:
This paper proposes a new method for an optimized map** of temporal variables, describing a temporal stream data, into the recently proposed NeuCube spiking neural network architecture. This optimized map** extends the use of the NeuCube, which was initially designed for spatiotemporal brain data, to work on arbitrary stream data and to achieve a better accuracy of temporal pattern recognition…
▽ More
This paper proposes a new method for an optimized map** of temporal variables, describing a temporal stream data, into the recently proposed NeuCube spiking neural network architecture. This optimized map** extends the use of the NeuCube, which was initially designed for spatiotemporal brain data, to work on arbitrary stream data and to achieve a better accuracy of temporal pattern recognition, a better and earlier event prediction and a better understanding of complex temporal stream data through visualization of the NeuCube connectivity. The effect of the new map** is demonstrated on three bench mark problems. The first one is early prediction of patient sleep stage event from temporal physiological data. The second one is pattern recognition of dynamic temporal patterns of traffic in the Bay Area of California and the last one is the Challenge 2012 contest data set. In all cases the use of the proposed map** leads to an improved accuracy of pattern recognition and event prediction and a better understanding of the data when compared to traditional machine learning techniques or spiking neural network reservoirs with arbitrary map** of the variables.
△ Less
Submitted 17 March, 2016;
originally announced March 2016.
