-
Machine Learning-Aided Cooperative Localization under Dense Urban Environment
Authors:
Hoon Lee,
Hong Ki Kim,
Seung Hyun Oh,
Sang Hyun Lee
Abstract:
Future wireless network technology provides automobiles with the connectivity feature to consolidate the concept of vehicular networks that collaborate on conducting cooperative driving tasks. The full potential of connected vehicles, which promises road safety and quality driving experience, can be leveraged if machine learning models guarantee the robustness in performing core functions includin…
▽ More
Future wireless network technology provides automobiles with the connectivity feature to consolidate the concept of vehicular networks that collaborate on conducting cooperative driving tasks. The full potential of connected vehicles, which promises road safety and quality driving experience, can be leveraged if machine learning models guarantee the robustness in performing core functions including localization and controls. Location awareness, in particular, lends itself to the deployment of location-specific services and the improvement of the operation performance. The localization entails direct communication to the network infrastructure, and the resulting centralized positioning solutions readily become intractable as the network scales up. As an alternative to the centralized solutions, this article addresses decentralized principle of vehicular localization reinforced by machine learning techniques in dense urban environments with frequent inaccessibility to reliable measurement. As such, the collaboration of multiple vehicles enhances the positioning performance of machine learning approaches. A virtual testbed is developed to validate this machine learning model for real-map vehicular networks. Numerical results demonstrate universal feasibility of cooperative localization, in particular, for dense urban area configurations.
△ Less
Submitted 5 April, 2024;
originally announced April 2024.
-
Nondestructive, quantitative viability analysis of 3D tissue cultures using machine learning image segmentation
Authors:
Kylie J. Trettner,
Jeremy Hsieh,
Weikun Xiao,
Jerry S. H. Lee,
Andrea M. Armani
Abstract:
Ascertaining the collective viability of cells in different cell culture conditions has typically relied on averaging colorimetric indicators and is often reported out in simple binary readouts. Recent research has combined viability assessment techniques with image-based deep-learning models to automate the characterization of cellular properties. However, further development of viability measure…
▽ More
Ascertaining the collective viability of cells in different cell culture conditions has typically relied on averaging colorimetric indicators and is often reported out in simple binary readouts. Recent research has combined viability assessment techniques with image-based deep-learning models to automate the characterization of cellular properties. However, further development of viability measurements to assess the continuity of possible cellular states and responses to perturbation across cell culture conditions is needed. In this work, we demonstrate an image processing algorithm for quantifying cellular viability in 3D cultures without the need for assay-based indicators. We show that our algorithm performs similarly to a pair of human experts in whole-well images over a range of days and culture matrix compositions. To demonstrate potential utility, we perform a longitudinal study investigating the impact of a known therapeutic on pancreatic cancer spheroids. Using images taken with a high content imaging system, the algorithm successfully tracks viability at the individual spheroid and whole-well level. The method we propose reduces analysis time by 97% in comparison to the experts. Because the method is independent of the microscope or imaging system used, this approach lays the foundation for accelerating progress in and for improving the robustness and reproducibility of 3D culture analysis across biological and clinical research.
△ Less
Submitted 11 March, 2024; v1 submitted 15 November, 2023;
originally announced November 2023.
-
Intelligent upper-limb exoskeleton integrated with soft wearable bioelectronics and deep-learning for human intention-driven strength augmentation based on sensory feedback
Authors:
**woo Lee,
Kangkyu Kwon,
Ira Soltis,
Jared Matthews,
Yoonjae Lee,
Hojoong Kim,
Lissette Romero,
Nathan Zavanelli,
Young** Kwon,
Shinjae Kwon,
Jimin Lee,
Yewon Na,
Sung Hoon Lee,
Ki Jun Yu,
Minoru Shinohara,
Frank L. Hammond,
Woon-Hong Yeo
Abstract:
The age and stroke-associated decline in musculoskeletal strength degrades the ability to perform daily human tasks using the upper extremities. Although there are a few examples of exoskeletons, they need manual operations due to the absence of sensor feedback and no intention prediction of movements. Here, we introduce an intelligent upper-limb exoskeleton system that uses cloud-based deep learn…
▽ More
The age and stroke-associated decline in musculoskeletal strength degrades the ability to perform daily human tasks using the upper extremities. Although there are a few examples of exoskeletons, they need manual operations due to the absence of sensor feedback and no intention prediction of movements. Here, we introduce an intelligent upper-limb exoskeleton system that uses cloud-based deep learning to predict human intention for strength augmentation. The embedded soft wearable sensors provide sensory feedback by collecting real-time muscle signals, which are simultaneously computed to determine the user's intended movement. The cloud-based deep-learning predicts four upper-limb joint motions with an average accuracy of 96.2% at a 200-250 millisecond response rate, suggesting that the exoskeleton operates just by human intention. In addition, an array of soft pneumatics assists the intended movements by providing 897 newton of force and 78.7 millimeter of displacement at maximum. Collectively, the intent-driven exoskeleton can augment human strength by 5.15 times on average compared to the unassisted exoskeleton. This report demonstrates an exoskeleton robot that augments the upper-limb joint movements by human intention based on a machine-learning cloud computing and sensory feedback.
△ Less
Submitted 26 January, 2024; v1 submitted 8 September, 2023;
originally announced September 2023.
-
Leveraging Label Non-Uniformity for Node Classification in Graph Neural Networks
Authors:
Feng Ji,
See Hian Lee,
Hanyang Meng,
Kai Zhao,
Jielong Yang,
Wee Peng Tay
Abstract:
In node classification using graph neural networks (GNNs), a typical model generates logits for different class labels at each node. A softmax layer often outputs a label prediction based on the largest logit. We demonstrate that it is possible to infer hidden graph structural information from the dataset using these logits. We introduce the key notion of label non-uniformity, which is derived fro…
▽ More
In node classification using graph neural networks (GNNs), a typical model generates logits for different class labels at each node. A softmax layer often outputs a label prediction based on the largest logit. We demonstrate that it is possible to infer hidden graph structural information from the dataset using these logits. We introduce the key notion of label non-uniformity, which is derived from the Wasserstein distance between the softmax distribution of the logits and the uniform distribution. We demonstrate that nodes with small label non-uniformity are harder to classify correctly. We theoretically analyze how the label non-uniformity varies across the graph, which provides insights into boosting the model performance: increasing training samples with high non-uniformity or drop** edges to reduce the maximal cut size of the node set of small non-uniformity. These mechanisms can be easily added to a base GNN model. Experimental results demonstrate that our approach improves the performance of many benchmark base models.
△ Less
Submitted 28 April, 2023;
originally announced May 2023.
-
Distributional Signals for Node Classification in Graph Neural Networks
Authors:
Feng Ji,
See Hian Lee,
Kai Zhao,
Wee Peng Tay,
Jielong Yang
Abstract:
In graph neural networks (GNNs), both node features and labels are examples of graph signals, a key notion in graph signal processing (GSP). While it is common in GSP to impose signal smoothness constraints in learning and estimation tasks, it is unclear how this can be done for discrete node labels. We bridge this gap by introducing the concept of distributional graph signals. In our framework, w…
▽ More
In graph neural networks (GNNs), both node features and labels are examples of graph signals, a key notion in graph signal processing (GSP). While it is common in GSP to impose signal smoothness constraints in learning and estimation tasks, it is unclear how this can be done for discrete node labels. We bridge this gap by introducing the concept of distributional graph signals. In our framework, we work with the distributions of node labels instead of their values and propose notions of smoothness and non-uniformity of such distributional graph signals. We then propose a general regularization method for GNNs that allows us to encode distributional smoothness and non-uniformity of the model output in semi-supervised node classification tasks. Numerical experiments demonstrate that our method can significantly improve the performance of most base GNN models in different problem settings.
△ Less
Submitted 7 April, 2023;
originally announced April 2023.
-
LISA: Localized Image Stylization with Audio via Implicit Neural Representation
Authors:
Seung Hyun Lee,
Chanyoung Kim,
Wonmin Byeon,
Sang Ho Yoon,
**kyu Kim,
Sangpil Kim
Abstract:
We present a novel framework, Localized Image Stylization with Audio (LISA) which performs audio-driven localized image stylization. Sound often provides information about the specific context of the scene and is closely related to a certain part of the scene or object. However, existing image stylization works have focused on stylizing the entire image using an image or text input. Stylizing a pa…
▽ More
We present a novel framework, Localized Image Stylization with Audio (LISA) which performs audio-driven localized image stylization. Sound often provides information about the specific context of the scene and is closely related to a certain part of the scene or object. However, existing image stylization works have focused on stylizing the entire image using an image or text input. Stylizing a particular part of the image based on audio input is natural but challenging. In this work, we propose a framework that a user provides an audio input to localize the sound source in the input image and another for locally stylizing the target object or scene. LISA first produces a delicate localization map with an audio-visual localization network by leveraging CLIP embedding space. We then utilize implicit neural representation (INR) along with the predicted localization map to stylize the target object or scene based on sound information. The proposed INR can manipulate the localized pixel values to be semantically consistent with the provided audio input. Through a series of experiments, we show that the proposed framework outperforms the other audio-guided stylization methods. Moreover, LISA constructs concise localization maps and naturally manipulates the target object or scene in accordance with the given audio input.
△ Less
Submitted 21 November, 2022;
originally announced November 2022.
-
On semi shift invariant graph filters
Authors:
Feng Ji,
See Hian Lee,
Wee Peng Tay
Abstract:
In graph signal processing, one of the most important subjects is the study of filters, i.e., linear transformations that capture relations between graph signals. One of the most important families of filters is the space of shift invariant filters, defined as transformations commute with a preferred graph shift operator. Shift invariant filters have a wide range of applications in graph signal pr…
▽ More
In graph signal processing, one of the most important subjects is the study of filters, i.e., linear transformations that capture relations between graph signals. One of the most important families of filters is the space of shift invariant filters, defined as transformations commute with a preferred graph shift operator. Shift invariant filters have a wide range of applications in graph signal processing and graph neural networks. A shift invariant filter can be interpreted geometrically as an information aggregation procedure (from local neighborhood), and can be computed easily using matrix multiplication. However, there are still drawbacks to using solely shift invariant filters in applications, such as being restrictively homogeneous. In this paper, we generalize shift invariant filters by introducing and studying semi shift invariant filters. We give an application of semi shift invariant filters with a new signal processing framework, the subgraph signal processing. Moreover, we also demonstrate how semi shift invariant filters can be used in graph neural networks.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
Sound-Guided Semantic Image Manipulation
Authors:
Seung Hyun Lee,
Wonseok Roh,
Wonmin Byeon,
Sang Ho Yoon,
Chan Young Kim,
**kyu Kim,
Sangpil Kim
Abstract:
The recent success of the generative model shows that leveraging the multi-modal embedding space can manipulate an image using text information. However, manipulating an image with other sources rather than text, such as sound, is not easy due to the dynamic characteristics of the sources. Especially, sound can convey vivid emotions and dynamic expressions of the real world. Here, we propose a fra…
▽ More
The recent success of the generative model shows that leveraging the multi-modal embedding space can manipulate an image using text information. However, manipulating an image with other sources rather than text, such as sound, is not easy due to the dynamic characteristics of the sources. Especially, sound can convey vivid emotions and dynamic expressions of the real world. Here, we propose a framework that directly encodes sound into the multi-modal (image-text) embedding space and manipulates an image from the space. Our audio encoder is trained to produce a latent representation from an audio input, which is forced to be aligned with image and text representations in the multi-modal embedding space. We use a direct latent optimization method based on aligned embeddings for sound-guided image manipulation. We also show that our method can mix text and audio modalities, which enrich the variety of the image modification. We verify the effectiveness of our sound-guided image manipulation quantitatively and qualitatively. We also show that our method can mix different modalities, i.e., text and audio, which enrich the variety of the image modification. The experiments on zero-shot audio classification and semantic-level image classification show that our proposed model outperforms other text and sound-guided state-of-the-art methods.
△ Less
Submitted 30 November, 2021;
originally announced December 2021.
-
StRDAN: Synthetic-to-Real Domain Adaptation Network for Vehicle Re-Identification
Authors:
Sangrok Lee,
Eunsoo Park,
Hongsuk Yi,
Sang Hun Lee
Abstract:
Vehicle re-identification aims to obtain the same vehicles from vehicle images. This is challenging but essential for analyzing and predicting traffic flow in the city. Although deep learning methods have achieved enormous progress for this task, their large data requirement is a critical shortcoming. Therefore, we propose a synthetic-to-real domain adaptation network (StRDAN) framework, which can…
▽ More
Vehicle re-identification aims to obtain the same vehicles from vehicle images. This is challenging but essential for analyzing and predicting traffic flow in the city. Although deep learning methods have achieved enormous progress for this task, their large data requirement is a critical shortcoming. Therefore, we propose a synthetic-to-real domain adaptation network (StRDAN) framework, which can be trained with inexpensive large-scale synthetic and real data to improve performance. The StRDAN training method combines domain adaptation and semi-supervised learning methods and their associated losses. StRDAN offers significant improvement over the baseline model, which can only be trained using real data, for VeRi and CityFlow-ReID datasets, achieving 3.1% and 12.9% improved mean average precision, respectively.
△ Less
Submitted 17 July, 2020; v1 submitted 24 April, 2020;
originally announced April 2020.
-
On structural and dynamical factors determining the integrated basin instability of power-grid nodes
Authors:
Heetae Kim,
Mi ** Lee,
Sang Hoon Lee,
Seung-Woo Son
Abstract:
In electric power systems delivering alternating current, it is essential to maintain its synchrony of the phase with the rated frequency. The synchronization stability that quantifies how well the power-grid system recovers its synchrony against perturbation depends on various factors. As an intrinsic factor that we can design and control, the transmission capacity of the power grid affects the s…
▽ More
In electric power systems delivering alternating current, it is essential to maintain its synchrony of the phase with the rated frequency. The synchronization stability that quantifies how well the power-grid system recovers its synchrony against perturbation depends on various factors. As an intrinsic factor that we can design and control, the transmission capacity of the power grid affects the synchronization stability. Therefore, the transition pattern of the synchronization stability with the different levels of transmission capacity against external perturbation provides the stereoscopic perspective to understand the synchronization behavior of power grids. In this study, we extensively investigate the factors affecting the synchronization stability transition by using the concept of basin stability as a function of the transmission capacity. For a systematic approach, we introduce the integrated basin instability, which literally adds up the instability values as the transmission capacity increases. We first take simple 5-node motifs as a case study of building blocks of power grids, and a more realistic IEEE 24-bus model to highlight the complexity of decisive factors. We find that both structural properties such as gate keepers in network topology and dynamical properties such as large power input/output at nodes cause synchronization instability. The results suggest that evenly distributed power generation and avoidance of bottlenecks can improve the overall synchronization stability of power-grid systems.
△ Less
Submitted 22 October, 2019; v1 submitted 19 June, 2019;
originally announced June 2019.
-
Deep Learning for Distributed Optimization: Applications to Wireless Resource Management
Authors:
Hoon Lee,
Sang Hyun Lee,
Tony Q. S. Quek
Abstract:
This paper studies a deep learning (DL) framework to solve distributed non-convex constrained optimizations in wireless networks where multiple computing nodes, interconnected via backhaul links, desire to determine an efficient assignment of their states based on local observations. Two different configurations are considered: First, an infinite-capacity backhaul enables nodes to communicate in a…
▽ More
This paper studies a deep learning (DL) framework to solve distributed non-convex constrained optimizations in wireless networks where multiple computing nodes, interconnected via backhaul links, desire to determine an efficient assignment of their states based on local observations. Two different configurations are considered: First, an infinite-capacity backhaul enables nodes to communicate in a lossless way, thereby obtaining the solution by centralized computations. Second, a practical finite-capacity backhaul leads to the deployment of distributed solvers equipped along with quantizers for communication through capacity-limited backhaul. The distributed nature and the nonconvexity of the optimizations render the identification of the solution unwieldy. To handle them, deep neural networks (DNNs) are introduced to approximate an unknown computation for the solution accurately. In consequence, the original problems are transformed to training tasks of the DNNs subject to non-convex constraints where existing DL libraries fail to extend straightforwardly. A constrained training strategy is developed based on the primal-dual method. For distributed implementation, a novel binarization technique at the output layer is developed for quantization at each node. Our proposed distributed DL framework is examined in various network configurations of wireless resource management. Numerical results verify the effectiveness of our proposed approach over existing optimization techniques.
△ Less
Submitted 30 May, 2019;
originally announced May 2019.
