-
Hierarchical Auxiliary Learning
Authors:
Jaehoon Cha,
Kyeong Soo Kim,
Sanghyuk Lee
Abstract:
Conventional application of convolutional neural networks (CNNs) for image classification and recognition is based on the assumption that all target classes are equal(i.e., no hierarchy) and exclusive of one another (i.e., no overlap). CNN-based image classifiers built on this assumption, therefore, cannot take into account an innate hierarchy among target classes (e.g., cats and dogs in animal im…
▽ More
Conventional application of convolutional neural networks (CNNs) for image classification and recognition is based on the assumption that all target classes are equal(i.e., no hierarchy) and exclusive of one another (i.e., no overlap). CNN-based image classifiers built on this assumption, therefore, cannot take into account an innate hierarchy among target classes (e.g., cats and dogs in animal image classification) or additional information that can be easily derived from the data (e.g.,numbers larger than five in the recognition of handwritten digits), thereby resulting in scalability issues when the number of target classes is large. Combining two related but slightly different ideas of hierarchical classification and logical learning by auxiliary inputs, we propose a new learning framework called hierarchical auxiliary learning, which not only address the scalability issues with a large number of classes but also could further reduce the classification/recognition errors with a reasonable number of classes. In the hierarchical auxiliary learning, target classes are semantically or non-semantically grouped into superclasses, which turns the original problem of map** between an image and its target class into a new problem of map** between a pair of an image and its superclass and the target class. To take the advantage of superclasses, we introduce an auxiliary block into a neural network, which generates auxiliary scores used as additional information for final classification/recognition; in this paper, we add the auxiliary block between the last residual block and the fully-connected output layer of the ResNet. Experimental results demonstrate that the proposed hierarchical auxiliary learning can reduce classification errors up to 0.56, 1.6 and 3.56 percent with MNIST, SVHN and CIFAR-10 datasets, respectively.
△ Less
Submitted 3 June, 2019;
originally announced June 2019.
-
On the Transformation of Latent Space in Autoencoders
Authors:
Jaehoon Cha,
Kyeong Soo Kim,
Sanghyuk Lee
Abstract:
Noting the importance of the latent variables in inference and learning, we propose a novel framework for autoencoders based on the homeomorphic transformation of latent variables, which could reduce the distance between vectors in the transformed space, while preserving the topological properties of the original space, and investigate the effect of the latent space transformation on learning gene…
▽ More
Noting the importance of the latent variables in inference and learning, we propose a novel framework for autoencoders based on the homeomorphic transformation of latent variables, which could reduce the distance between vectors in the transformed space, while preserving the topological properties of the original space, and investigate the effect of the latent space transformation on learning generative models and denoising corrupted data. The experimental results demonstrate that our generative and denoising models based on the proposed framework can provide better performance than conventional variational and denoising autoencoders due to the transformation, where we evaluate the performance of generative and denoising models in terms of the Hausdorff distance between the sets of training and processed i.e., either generated or denoised images, which can objectively measure their differences, as well as through direct comparison of the visual characteristics of the processed images.
△ Less
Submitted 3 June, 2019; v1 submitted 24 January, 2019;
originally announced January 2019.
-
XJTLUIndoorLoc: A New Fingerprinting Database for Indoor Localization and Trajectory Estimation Based on Wi-Fi RSS and Geomagnetic Field
Authors:
Zhenghang Zhong,
Zhe Tang,
Xiangxing Li,
Tiancheng Yuan,
Yang Yang,
Meng Wei,
Yuanyuan Zhang,
Renzhi Sheng,
Naomi Grant,
Chongfeng Ling,
Xintao Huan,
Kyeong Soo Kim,
Sanghyuk Lee
Abstract:
In this paper, we present a new location fingerprinting database comprised of Wi-Fi received signal strength (RSS) and geomagnetic field intensity measured with multiple devices at a multi-floor building in Xi'an Jiatong-Liverpool University, Suzhou, China. We also provide preliminary results of localization and trajectory estimation based on convolutional neural network (CNN) and long short-term…
▽ More
In this paper, we present a new location fingerprinting database comprised of Wi-Fi received signal strength (RSS) and geomagnetic field intensity measured with multiple devices at a multi-floor building in Xi'an Jiatong-Liverpool University, Suzhou, China. We also provide preliminary results of localization and trajectory estimation based on convolutional neural network (CNN) and long short-term memory (LSTM) network with this database. For localization, we map RSS data for a reference point to an image-like, two-dimensional array and then apply CNN which is popular in image and video analysis and recognition. For trajectory estimation, we use a modified random way point model to efficiently generate continuous step traces imitating human walking and train a stacked two-layer LSTM network with the generated data to remember the changing pattern of geomagnetic field intensity against (x,y) coordinates. Experimental results demonstrate the usefulness of our new database and the feasibility of the CNN and LSTM-based localization and trajectory estimation with the database.
△ Less
Submitted 16 October, 2018;
originally announced October 2018.
-
Hybrid Building/Floor Classification and Location Coordinates Regression Using A Single-Input and Multi-Output Deep Neural Network for Large-Scale Indoor Localization Based on Wi-Fi Fingerprinting
Authors:
Kyeong Soo Kim
Abstract:
In this paper, we propose hybrid building/floor classification and floor-level two-dimensional location coordinates regression using a single-input and multi-output (SIMO) deep neural network (DNN) for large-scale indoor localization based on Wi-Fi fingerprinting. The proposed scheme exploits the different nature of the estimation of building/floor and floor-level location coordinates and uses a d…
▽ More
In this paper, we propose hybrid building/floor classification and floor-level two-dimensional location coordinates regression using a single-input and multi-output (SIMO) deep neural network (DNN) for large-scale indoor localization based on Wi-Fi fingerprinting. The proposed scheme exploits the different nature of the estimation of building/floor and floor-level location coordinates and uses a different estimation framework for each task with a dedicated output and hidden layers enabled by SIMO DNN architecture. We carry out preliminary evaluation of the performance of the hybrid floor classification and floor-level two-dimensional location coordinates regression using new Wi-Fi crowdsourced fingerprinting datasets provided by Tampere University of Technology (TUT), Finland, covering a single building with five floors. Experimental results demonstrate that the proposed SIMO-DNN-based hybrid classification/regression scheme outperforms existing schemes in terms of both floor detection rate and mean positioning errors.
△ Less
Submitted 13 October, 2018;
originally announced October 2018.
-
A Scalable Deep Neural Network Architecture for Multi-Building and Multi-Floor Indoor Localization Based on Wi-Fi Fingerprinting
Authors:
Kyeong Soo Kim,
Sanghyuk Lee,
Kaizhu Huang
Abstract:
One of the key technologies for future large-scale location-aware services covering a complex of multi-story buildings --- e.g., a big shop** mall and a university campus --- is a scalable indoor localization technique. In this paper, we report the current status of our investigation on the use of deep neural networks (DNNs) for scalable building/floor classification and floor-level position est…
▽ More
One of the key technologies for future large-scale location-aware services covering a complex of multi-story buildings --- e.g., a big shop** mall and a university campus --- is a scalable indoor localization technique. In this paper, we report the current status of our investigation on the use of deep neural networks (DNNs) for scalable building/floor classification and floor-level position estimation based on Wi-Fi fingerprinting. Exploiting the hierarchical nature of the building/floor estimation and floor-level coordinates estimation of a location, we propose a new DNN architecture consisting of a stacked autoencoder for the reduction of feature space dimension and a feed-forward classifier for multi-label classification of building/floor/location, on which the multi-building and multi-floor indoor localization system based on Wi-Fi fingerprinting is built. Experimental results for the performance of building/floor estimation and floor-level coordinates estimation of a given location demonstrate the feasibility of the proposed DNN-based indoor localization system, which can provide near state-of-the-art performance using a single DNN, for the implementation with lower complexity and energy consumption at mobile devices.
△ Less
Submitted 5 December, 2017;
originally announced December 2017.
-
Simulation Study of an Energy-Efficient Time Synchronization Scheme based on Source Clock Frequency Recovery in Asymmetric Wireless Sensor Networks
Authors:
Kyeong Soo Kim,
Sanghyuk Lee,
Eng Gee Lim
Abstract:
In this paper we report preliminary results of a simulation study on an energy-efficient time synchronization scheme based on source clock frequency recovery (SCFR) at sensor nodes in asymmetric wireless sensor networks (WSNs), where a head node --- serving as a gateway between wired and wireless networks --- is equipped with a powerful processor and supplied power from outlet, and sensor nodes --…
▽ More
In this paper we report preliminary results of a simulation study on an energy-efficient time synchronization scheme based on source clock frequency recovery (SCFR) at sensor nodes in asymmetric wireless sensor networks (WSNs), where a head node --- serving as a gateway between wired and wireless networks --- is equipped with a powerful processor and supplied power from outlet, and sensor nodes --- connected only through wireless channels --- are limited in processing and battery-powered. In the SCFR-based WSN time synchronization scheme, we concentrate on battery-powered sensor nodes and reduce their energy consumption by minimizing the number of message transmissions from sensor nodes to the head node. Through simulation experiments we analyze the performance of the SCFR-based WSN time synchronization scheme, including the impact of SCFR on time synchronization based on two-way message exchange, and demonstrate the feasibility of the proposed time synchronization scheme.
△ Less
Submitted 17 February, 2016;
originally announced February 2016.
-
Energy-Efficient Time Synchronization Based on Asynchronous Source Clock Frequency Recovery and Reverse Two-Way Message Exchanges in Wireless Sensor Networks
Authors:
Kyeong Soo Kim,
Sanghyuk Lee,
Eng Gee Lim
Abstract:
We consider energy-efficient time synchronization in a wireless sensor network where a head node (i.e., a gateway between wired and wireless networks and a center of data fusion) is equipped with a powerful processor and supplied power from outlet, and sensor nodes (i.e., nodes measuring data and connected only through wireless channels) are limited in processing and battery-powered. It is this as…
▽ More
We consider energy-efficient time synchronization in a wireless sensor network where a head node (i.e., a gateway between wired and wireless networks and a center of data fusion) is equipped with a powerful processor and supplied power from outlet, and sensor nodes (i.e., nodes measuring data and connected only through wireless channels) are limited in processing and battery-powered. It is this asymmetry that our study focuses on; unlike most existing schemes to save the power of all network nodes, we concentrate on battery-powered sensor nodes in minimizing energy consumption for time synchronization. We present a time synchronization scheme based on asynchronous source clock frequency recovery and reverse two-way message exchanges combined with measurement data report messages, where we minimize the number of message transmissions from sensor nodes, and carry out the performance analysis of the estimation of both measurement time and clock frequency with lower bounds for the latter. Simulation results verify that the proposed scheme outperforms the schemes based on conventional two-way message exchanges with and without clock frequency recovery in terms of the accuracy of measurement time estimation and the number of message transmissions and receptions at sensor nodes as an indirect measure of energy efficiency.
△ Less
Submitted 15 February, 2016;
originally announced February 2016.
-
A Research Framework for the Clean-Slate Design of Next-Generation Optical Access
Authors:
Kyeong Soo Kim
Abstract:
A comprehensive research framework for a comparative analysis of candidate network architectures and protocols in the clean-slate design of next-generation optical access is proposed. The proposed research framework consists of a comparative analysis framework based on multivariate non-inferiority testing and a notion of equivalent circuit rate taking into account user-perceived performances, and…
▽ More
A comprehensive research framework for a comparative analysis of candidate network architectures and protocols in the clean-slate design of next-generation optical access is proposed. The proposed research framework consists of a comparative analysis framework based on multivariate non-inferiority testing and a notion of equivalent circuit rate taking into account user-perceived performances, and a virtual test bed providing a complete experimental platform for the comparative analysis. The capability of the research framework is demonstrated through numerical results from the study of the elasticity of hybrid TDM/WDM-PON based on tunable transceivers.
△ Less
Submitted 22 August, 2013;
originally announced August 2013.
-
The Effect of ISP Traffic Sha** on User-Perceived Performances in Broadband Shared Access Networks
Authors:
Kyeong Soo Kim
Abstract:
Recent studies on the practice of sha** subscribers' traffic by ISPs give a new insight into the actual performance of broadband access networks at a packet level. Unlike metro and backbone networks, however, access networks directly interface with end-users, so it is important to base the study and design of access networks on the behaviors of and the actual performance perceived by end-users.…
▽ More
Recent studies on the practice of sha** subscribers' traffic by ISPs give a new insight into the actual performance of broadband access networks at a packet level. Unlike metro and backbone networks, however, access networks directly interface with end-users, so it is important to base the study and design of access networks on the behaviors of and the actual performance perceived by end-users. In this paper we study the effect of ISP traffic sha** using traffic models based on user behaviors and application/session-layer metrics providing quantifiable measures of user-perceived performance for HTTP, FTP, and streaming video traffic. To compare the user-perceived performance of shaped traffic flows with those of unshaped ones in an integrated way, we use a multivariate non-inferiority testing procedure. We first investigate the effect of the token generation rate and the token bucket size of a token bucket filter on user-perceived performance at a subscriber level with a single subscriber. Then we investigate their effect at an access level where shaped traffic flows from multiple subscribers interact with one another in a common shared access network. The simulation results show that for a given token generation rate, a larger token bucket provides better user-perceived performance at both subscriber and access levels. It is also shown that the loose burst control resulting from the large token bucket --- up to 100 MB for access line rate of 100 Mbit/s --- does not negatively affect user-perceived performance with multiple subscribers even in the presence of non-conformant subscribers; with a much larger token bucket, however, the negative effect of non-conformant subscribers on the user-perceived performance of conformant subscribers becomes clearly visible because the impact of token bucket size and that of token generation rate are virtually indistinguishable in this case.
△ Less
Submitted 3 June, 2014; v1 submitted 18 August, 2013;
originally announced August 2013.
