Showing 1–50 of 64 results for author: Nishio, T

Design, Control, and Motion-Planning for a Root-Perching Rotor-Distributed Manipulator

Authors: Takuzumi Nishio, Moju Zhao, Kei Okada, Masayuki Inaba

Abstract: Manipulation performance improvement is crucial for aerial robots. For aerial manipulators, the baselink position and attitude errors directly affect the precision at the end effector. To address this stability problem, fixed-body approaches such as perching on the environment using the rotor suction force are useful. Additionally, conventional arm-equipped multirotors, called rotor-concentrated m… ▽ More Manipulation performance improvement is crucial for aerial robots. For aerial manipulators, the baselink position and attitude errors directly affect the precision at the end effector. To address this stability problem, fixed-body approaches such as perching on the environment using the rotor suction force are useful. Additionally, conventional arm-equipped multirotors, called rotor-concentrated manipulators (RCMs), find it difficult to generate a large wrench at the end effector due to joint torque limitations. Using distributed rotors to each link, the thrust can support each link weight, decreasing the arm joints' torque. Based on this approach, rotor-distributed manipulators (RDMs) can increase feasible wrench and reachability of the end-effector. This paper introduces a minimal configuration of a rotor-distributed manipulator that can perch on surfaces, especially ceilings, using a part of their body. First, we design a minimal rotor-distributed arm considering the flight and end-effector performance. Second, a flight controller is proposed for this minimal RDM along with a perching controller adaptable for various types of aerial robots. Third, we propose a motion planning method based on inverse kinematics (IK), considering specific constraints to the proposed RDMs such as perching force. Finally, we evaluate flight and perching motions and \revise{confirm} that the proposed manipulator can significantly improve the manipulation performance. △ Less

Submitted 20 May, 2024; originally announced May 2024.

Comments: IEEE Transactions on Robotics (2023)

Ginzburg-Landau simulations of three-terminal operation of a superconducting nanowire cryotron

Authors: Naoki Yasukawa, Taichiro Nishio, Yasunori Mawatari

Abstract: Superconducting nanowire cryotrons (nTrons) are expected to be used as interfaces for super-high-performance hybrid devices in which superconductor and semiconductor circuits are combined. However, nTrons are still under development, and diverse analyses of these devices are needed. Accordingly, we have developed a numerical technique to simulate the three-terminal operation of an nTron by using t… ▽ More Superconducting nanowire cryotrons (nTrons) are expected to be used as interfaces for super-high-performance hybrid devices in which superconductor and semiconductor circuits are combined. However, nTrons are still under development, and diverse analyses of these devices are needed. Accordingly, we have developed a numerical technique to simulate the three-terminal operation of an nTron by using the finite element method to solve the time-dependent Ginzburg-Landau (TDGL) equation and the heat-diffusion equation. Simulations using this technique offer understanding of the dynamics of the order parameter, the thermal behavior, and the characteristics of three-terminal operation, and the TDGL model reproduces qualitatively the results of nTron experiments. In addition, we investigated how some geometric and physical parameters (the design elements) affect the operation characteristics. The TDGL model has far fewer free parameters compared with the lumped-element electrothermal model commonly used for simulating superconducting devices. Furthermore, the TDGL model provides time-dependent visual information about the superconducting state and the normal state, thereby offering insights into the relationship between nTron geometry and three-terminal operation. These simulation results offer a route to nTron optimization and the development of nTron applications. △ Less

Submitted 13 May, 2024; originally announced May 2024.

Comments: 11 pages, 11 figures, to be published in Supercond. Sci. Technol

BEATLE - Self-Reconfigurable Aerial Robot: Design, Control and Experimental Validation

Authors: Junichiro Sugihara, Moju Zhao, Takuzumi Nishio, Kei Okada, Masayuki Inaba

Abstract: Modular self-reconfigurable robots (MSRRs) offer enhanced task flexibility by constructing various structures suitable for each task. However, conventional terrestrial MSRRs equipped with wheels face critical challenges, including limitations in the size of constructible structures and system robustness due to elevated wrench loads applied to each module. In this work, we introduce an Aerial MSRR… ▽ More Modular self-reconfigurable robots (MSRRs) offer enhanced task flexibility by constructing various structures suitable for each task. However, conventional terrestrial MSRRs equipped with wheels face critical challenges, including limitations in the size of constructible structures and system robustness due to elevated wrench loads applied to each module. In this work, we introduce an Aerial MSRR (A-MSRR) system named BEATLE, capable of merging and separating in-flight. BEATLE can merge without applying wrench loads to adjacent modules, thereby expanding the scalability and robustness of conventional terrestrial MSRRs. In this article, we propose a system configuration for BEATLE, including mechanical design, a control framework for multi-connected flight, and a motion planner for reconfiguration motion. The design of a docking mechanism and housing structure aims to balance the durability of the constructed structure with ease of separation. Furthermore, the proposed flight control framework achieves stable multi-connected flight based on contact wrench control. Moreover, the proposed motion planner based on a finite state machine (FSM) achieves precise and robust reconfiguration motion. We also introduce the actual implementation of the prototype and validate the robustness and scalability of the proposed system design through experiments and simulation studies. △ Less

Submitted 15 April, 2024; v1 submitted 14 April, 2024; originally announced April 2024.

Adapting CSI-Guided Imaging Across Diverse Environments: An Experimental Study Leveraging Continuous Learning

Authors: Cheng Chen, Shoki Ohta, Takayuki Nishio, Mohamed Wahib

Abstract: This study explores the feasibility of adapting CSI-guided imaging across varied environments. Focusing on continuous model learning through continuous updates, we investigate CSI-Imager's adaptability in dynamically changing settings, specifically transitioning from an office to an industrial environment. Unlike traditional approaches that may require retraining for new environments, our experime… ▽ More This study explores the feasibility of adapting CSI-guided imaging across varied environments. Focusing on continuous model learning through continuous updates, we investigate CSI-Imager's adaptability in dynamically changing settings, specifically transitioning from an office to an industrial environment. Unlike traditional approaches that may require retraining for new environments, our experimental study aims to validate the potential of CSI-guided imaging to maintain accurate imaging performance through Continuous Learning (CL). By conducting experiments across different scenarios and settings, this work contributes to understanding the limitations and capabilities of existing CSI-guided imaging systems in adapting to new environmental contexts. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Single-Crystal Growth and Characterization of Cuprate Superconductor (Hg,Re)Ba$_2$Ca$_2$Cu$_3$O$_{8+δ}$

Authors: Yutaro Mino, Shigeyuki Ishida, Junichiro Kato, Shungo Nakagawa, Takanari Kashiwagi, Takahiro Nozue, Nao Takeshita, Kunihiro Kihou, Chul-Ho Lee, Taichiro Nishio, Hiroshi Eisaki

Abstract: We grew (Hg,Re)Ba$_2$Ca$_2$Cu$_3$O$_{8+δ}$ ((Hg,Re)1223) single crystals with good reproducibility via the single-step flux method using monoxides as raw materials. A double-sealing method using a thick-walled quartz tube and a stainless-steel container was adopted for explosion protection. The maximum crystal size was approximately 1 mm x 1 mm in the ab plane and 0.04 mm in thickness. The crystal… ▽ More We grew (Hg,Re)Ba$_2$Ca$_2$Cu$_3$O$_{8+δ}$ ((Hg,Re)1223) single crystals with good reproducibility via the single-step flux method using monoxides as raw materials. A double-sealing method using a thick-walled quartz tube and a stainless-steel container was adopted for explosion protection. The maximum crystal size was approximately 1 mm x 1 mm in the ab plane and 0.04 mm in thickness. The crystal was square-shaped, reflecting the tetragonal crystal structure of (Hg,Re)1223. Magnetic susceptibility measurements indicated a critical temperature of 130 K. The in-plane resistivity exhibited a linear temperature dependence, indicating that the sample was close to optimal do** level. The out-of-plane resistivity was also measured, and the anisotropy parameter was 250-650 at 300 K. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Comments: 21 pages, 9 figures, 2 tables

Journal ref: J. Phys. Soc. Jpn. 93, 044707 (2024)

Design and Control of Delta: Deformable Multilinked Multirotor with Rolling Locomotion Ability in Terrestrial Domain

Authors: Kazuki Sugihara, Moju Zhao, Takuzumi Nishio, Kei Okada, Masayuki Inaba

Abstract: In recent years, multiple types of locomotion methods for robots have been developed and enabled to adapt to multiple domains. In particular, aerial robots are useful for exploration in several situations, taking advantage of its three-dimensional mobility. Moreover, some aerial robots have achieved manipulation tasks in the air. However, energy consumption for flight is large and thus locomotion… ▽ More In recent years, multiple types of locomotion methods for robots have been developed and enabled to adapt to multiple domains. In particular, aerial robots are useful for exploration in several situations, taking advantage of its three-dimensional mobility. Moreover, some aerial robots have achieved manipulation tasks in the air. However, energy consumption for flight is large and thus locomotion ability on the ground is also necessary for aerial robots to do tasks for long time. Therefore, in this work, we aim to develop deformable multirotor robot capable of rolling movement with its entire body and achieve motions on the ground and in the air. In this paper, we first describe the design methodology of a deformable multilinked air-ground hybrid multirotor. We also introduce its mechanical design and rotor configuration based on control stability. Then, thrust control method for locomotion in air and ground domains is described. Finally, we show the implemented prototype of the proposed robot and evaluate through experiments in air and terrestrial domains. To the best of our knowledge, this is the first time to achieve the rolling locomotion by multilink structured mutltrotor. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: 8 pages, 15 figures

$Λ$-Split: A Privacy-Preserving Split Computing Framework for Cloud-Powered Generative AI

Authors: Shoki Ohta, Takayuki Nishio

Abstract: In the wake of the burgeoning expansion of generative artificial intelligence (AI) services, the computational demands inherent to these technologies frequently necessitate cloud-powered computational offloading, particularly for resource-constrained mobile devices. These services commonly employ prompts to steer the generative process, and both the prompts and the resultant content, such as text… ▽ More In the wake of the burgeoning expansion of generative artificial intelligence (AI) services, the computational demands inherent to these technologies frequently necessitate cloud-powered computational offloading, particularly for resource-constrained mobile devices. These services commonly employ prompts to steer the generative process, and both the prompts and the resultant content, such as text and images, may harbor privacy-sensitive or confidential information, thereby elevating security and privacy risks. To mitigate these concerns, we introduce $Λ$-Split, a split computing framework to facilitate computational offloading while simultaneously fortifying data privacy against risks such as eavesdrop** and unauthorized access. In $Λ$-Split, a generative model, usually a deep neural network (DNN), is partitioned into three sub-models and distributed across the user's local device and a cloud server: the input-side and output-side sub-models are allocated to the local, while the intermediate, computationally-intensive sub-model resides on the cloud server. This architecture ensures that only the hidden layer outputs are transmitted, thereby preventing the external transmission of privacy-sensitive raw input and output data. Given the black-box nature of DNNs, estimating the original input or output from intercepted hidden layer outputs poses a significant challenge for malicious eavesdroppers. Moreover, $Λ$-Split is orthogonal to traditional encryption-based security mechanisms, offering enhanced security when deployed in conjunction. We empirically validate the efficacy of the $Λ$-Split framework using Llama 2 and Stable Diffusion XL, representative large language and diffusion models developed by Meta and Stability AI, respectively. Our $Λ$-Split implementation is publicly accessible at https://github.com/nishio-laboratory/lambda_split. △ Less

Submitted 23 October, 2023; originally announced October 2023.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Tram-FL: Routing-based Model Training for Decentralized Federated Learning

Authors: Kota Maejima, Takayuki Nishio, Asato Yamazaki, Yuko Hara-Azumi

Abstract: In decentralized federated learning (DFL), substantial traffic from frequent inter-node communication and non-independent and identically distributed (non-IID) data challenges high-accuracy model acquisition. We propose Tram-FL, a novel DFL method, which progressively refines a global model by transferring it sequentially amongst nodes, rather than by exchanging and aggregating local models. We al… ▽ More In decentralized federated learning (DFL), substantial traffic from frequent inter-node communication and non-independent and identically distributed (non-IID) data challenges high-accuracy model acquisition. We propose Tram-FL, a novel DFL method, which progressively refines a global model by transferring it sequentially amongst nodes, rather than by exchanging and aggregating local models. We also introduce a dynamic model routing algorithm for optimal route selection, aimed at enhancing model precision with minimal forwarding. Our experiments using MNIST, CIFAR-10, and IMDb datasets demonstrate that Tram-FL with the proposed routing delivers high model accuracy under non-IID conditions, outperforming baselines while reducing communication costs. △ Less

Submitted 9 August, 2023; originally announced August 2023.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

MSC Class: 68T20 (Primary) 68M14 (Secondary) ACM Class: I.2.7; I.2.8; I.2.10; I.2.11

CSI-Inpainter: Enabling Visual Scene Recovery from CSI Time Sequences for Occlusion Removal

Authors: Cheng Chen, Shoki Ohta, Takayuki Nishio, Mehdi Bennis, Jihong Park, Mohamed Wahib

Abstract: Introducing CSI-Inpainter, a pioneering approach for occlusion removal using Channel State Information (CSI) time sequences, this work propels the application of wireless signal processing into the realm of visual scene recovery. Departing from traditional occlusion removal, CSI-Inpainter leverages CSI data to construct and refine obscured visual elements in a scene, facilitating recovery independ… ▽ More Introducing CSI-Inpainter, a pioneering approach for occlusion removal using Channel State Information (CSI) time sequences, this work propels the application of wireless signal processing into the realm of visual scene recovery. Departing from traditional occlusion removal, CSI-Inpainter leverages CSI data to construct and refine obscured visual elements in a scene, facilitating recovery independent of lighting conditions. Validated through comprehensive testing in both office and industrial environments, CSI-Inpainter demonstrates a robust capacity for discerning and reconstructing occluded segments, establishing a new frontier for obstacle removal. This first-of-its-kind framework offers a transformative perspective on how environmental visual information can be extracted from CSI, thereby broadening the scope for computer vision applications in everyday contexts. △ Less

Submitted 1 March, 2024; v1 submitted 9 May, 2023; originally announced May 2023.

Design and Control of a Small Humanoid Equipped with Flight Unit and Wheels for Multimodal Locomotion

Authors: Kazuki Sugihara, Moju Zhao, Takuzumi Nishio, Tasuku Makabe, Kei Okada, Masayuki Inaba

Abstract: Humanoids are versatile robotic platforms owing to their limbs with multiple degrees of freedom. Although humanoids can walk like humans, they are relatively slow, and cannot run over large barriers. To address these limitations, we aim to achieve rapid terrestrial locomotion ability and simultaneously expand the locomotion domain to the air by utilizing thrust for propulsion. In this paper, we fi… ▽ More Humanoids are versatile robotic platforms owing to their limbs with multiple degrees of freedom. Although humanoids can walk like humans, they are relatively slow, and cannot run over large barriers. To address these limitations, we aim to achieve rapid terrestrial locomotion ability and simultaneously expand the locomotion domain to the air by utilizing thrust for propulsion. In this paper, we first describe an optimized construction method for a humanoid robot equipped with wheels and a flight unit to achieve these abilities. Then, we describe the integrated control framework of the proposed flying humanoid for each locomotion mode: aerial, legged, and wheeled locomotion. Finally, we achieved multimodal locomotion and aerial manipulation experiments using the proposed robot platform. To the best of our knowledge, this is the first time that a single humanoid has simultaneously achieved three different types of locomotion, including flight. △ Less

Submitted 9 March, 2024; v1 submitted 26 March, 2023; originally announced March 2023.

Comments: 8 pages, 17 figures. Accepted by IEEE Robotics and Automation Letters

Design, Control, and Motion Strategy of TRADY: Tilted-Rotor-Equipped Aerial Robot With Autonomous In-Flight Assembly and Disassembly Ability

Authors: Junichiro Sugihara, Takuzumi Nishio, Keisuke Nagato, Masayuki Nakao, Moju Zhao

Abstract: In previous research, various types of aerial robots were developed to improve maneuverability or manipulation abilities. However, there was a challenge in achieving both mobility and manipulation capabilities simultaneously. This is because aerial robots with high mobility lack the necessary rotors to perform manipulation tasks, while those with manipulation ability are too large to achieve high… ▽ More In previous research, various types of aerial robots were developed to improve maneuverability or manipulation abilities. However, there was a challenge in achieving both mobility and manipulation capabilities simultaneously. This is because aerial robots with high mobility lack the necessary rotors to perform manipulation tasks, while those with manipulation ability are too large to achieve high mobility. To address this issue, a new aerial robot called TRADY was introduced in this article. TRADY is a tilted-rotor-equipped aerial robot that can autonomously assemble and disassemble in-flight, allowing for a switch in control model between under-actuated and fully-actuated models. The system features a novel docking mechanism and optimized rotor configuration, as well as a control system that can transition between under-actuated and fully-actuated modes and compensate for discrete changes. Additionally, a new motion strategy for assembly/disassembly motion that includes recovery behavior from hazardous conditions was introduced. Experimental results showed that TRADY can successfully execute aerial assembly/disassembly motions with a 90% success rate and generate more than nine times the torque of a single unit in the assembly state. This is the first robot system capable of performing both assembly and disassembly while seamlessly transitioning between fully-actuated and under-actuated models. △ Less

Submitted 5 February, 2024; v1 submitted 13 March, 2023; originally announced March 2023.

Journal ref: Adv. Intell. Syst. 2023

Design, Modeling and Control of a Quadruped Robot SPIDAR: Spherically Vectorable and Distributed Rotors Assisted Air-Ground Amphibious Quadruped Robot

Authors: Moju Zhao, Tomoki Anzai, Takuzumi Nishio

Abstract: Multimodal locomotion capability is an emerging topic in robotics field, and various novel mobile robots have been developed to enable the maneuvering in both terrestrial and aerial domains. Among these hybrid robots, several state-of-the-art bipedal \robots enable the complex walking motion which is interlaced with flying. These robots are also desired to have the manipulation ability; however, i… ▽ More Multimodal locomotion capability is an emerging topic in robotics field, and various novel mobile robots have been developed to enable the maneuvering in both terrestrial and aerial domains. Among these hybrid robots, several state-of-the-art bipedal \robots enable the complex walking motion which is interlaced with flying. These robots are also desired to have the manipulation ability; however, it is difficult for the current forms to keep stability with the joint motion in midair due to the central\ized rotor arrangement. Therefore, in this work, we develop a novel air-ground amphibious quadruped robot called SPIDAR which is assisted by spherically vectorable rotors distributed in each link to enable both walking motion and transformable flight. F\irst, we present a unique mechanical design for quadruped robot that enables terrestrial and aerial locomotion. We then reveal the modeling method for this hybrid robot platform, and further develop an integrated control strategy for both walking and fl\ying with joint motion. Finally, we demonstrate the feasibility of the proposed hybrid quadruped robot by performing a seamless motion that involves static walking and subsequent flight. To the best of our knowledge, this work is the first to achieve a \quadruped robot with multimodal locomotion capability, which also shows the potential of manipulation in multiple domains. △ Less

Submitted 10 January, 2023; originally announced January 2023.

Point Cloud-based Proactive Link Quality Prediction for Millimeter-wave Communications

Authors: Shoki Ohta, Takayuki Nishio, Riichi Kudo, Kahoko Takahashi, Hisashi Nagata

Abstract: This study demonstrates the feasibility of point cloud-based proactive link quality prediction for millimeter-wave (mmWave) communications. Previous studies have proposed machine learning-based methods to predict received signal strength for future time periods using time series of depth images to mitigate the line-of-sight (LOS) path blockage by pedestrians in mmWave communication. However, these… ▽ More This study demonstrates the feasibility of point cloud-based proactive link quality prediction for millimeter-wave (mmWave) communications. Previous studies have proposed machine learning-based methods to predict received signal strength for future time periods using time series of depth images to mitigate the line-of-sight (LOS) path blockage by pedestrians in mmWave communication. However, these image-based methods have limited applicability due to privacy concerns as camera images may contain sensitive information. This study proposes a point cloud-based method for mmWave link quality prediction and demonstrates its feasibility through experiments. Point clouds represent three-dimensional (3D) spaces as a set of points and are sparser and less likely to contain sensitive information than camera images. Additionally, point clouds provide 3D position and motion information, which is necessary for understanding the radio propagation environment involving pedestrians. This study designs the mmWave link quality prediction method and conducts realistic indoor experiments, where the link quality fluctuates significantly due to human blockage, using commercially available IEEE 802.11ad-based 60 GHz wireless LAN devices and Kinect v2 RGB-D camera and Velodyne VLP-16 light detection and ranging (LiDAR) for point cloud acquisition. The experimental results showed that our proposed method can predict future large attenuation of mmWave received signal strength and throughput induced by the LOS path blockage by pedestrians with comparable or superior accuracy to image-based prediction methods. Hence, our point cloud-based method can serve as a viable alternative to image-based methods. △ Less

Submitted 7 December, 2023; v1 submitted 2 January, 2023; originally announced January 2023.

Journal ref: IEEE Transactions on Machine Learning in Communications and Networking, vol. 1, pp. 258-276, 2023

Neural Architecture Search for Improving Latency-Accuracy Trade-off in Split Computing

Authors: Shoma Shimizu, Takayuki Nishio, Shota Saito, Yoichi Hirose, Chen Yen-Hsiu, Shinichi Shirakawa

Abstract: This paper proposes a neural architecture search (NAS) method for split computing. Split computing is an emerging machine-learning inference technique that addresses the privacy and latency challenges of deploying deep learning in IoT systems. In split computing, neural network models are separated and cooperatively processed using edge servers and IoT devices via networks. Thus, the architecture… ▽ More This paper proposes a neural architecture search (NAS) method for split computing. Split computing is an emerging machine-learning inference technique that addresses the privacy and latency challenges of deploying deep learning in IoT systems. In split computing, neural network models are separated and cooperatively processed using edge servers and IoT devices via networks. Thus, the architecture of the neural network model significantly impacts the communication payload size, model accuracy, and computational load. In this paper, we address the challenge of optimizing neural network architecture for split computing. To this end, we proposed NASC, which jointly explores optimal model architecture and a split point to achieve higher accuracy while meeting latency requirements (i.e., smaller total latency of computation and communication than a certain threshold). NASC employs a one-shot NAS that does not require repeating model training for a computationally efficient architecture search. Our performance evaluation using hardware (HW)-NAS-Bench of benchmark data demonstrates that the proposed NASC can improve the ``communication latency and model accuracy" trade-off, i.e., reduce the latency by approximately 40-60% from the baseline, with slight accuracy degradation. △ Less

Submitted 29 August, 2022; originally announced August 2022.

High-pressure synthesis and superconductivity of the novel Laves phase BaIr2

Authors: Terunari Koshinuma, Hiroki Ninomiya, Izumi Hase, Hiroshi Fujihisa, Yoshito Gotoh, Kenji Kawashima, Shigeyuki Ishida, Yoshiyuki Yoshida, Hiroshi Eisaki, Taichiro Nishio, Akira Iyo

Abstract: Superconductors comprising 5d transition metals of Ir and Pt have been widely explored because they have the potential of unique superconductivity caused by the strong spin-orbit interaction (SOI). We successfully synthesized BaIr2, the last Laves phase remaining unsynthesized in the MgCu2-type AM2 (A = Ca, Sr, Ba; M = Rh, Pd, Ir, Pt). BaIr2 was crystallized at 925 C under a pressure of 3.3 GPa vi… ▽ More Superconductors comprising 5d transition metals of Ir and Pt have been widely explored because they have the potential of unique superconductivity caused by the strong spin-orbit interaction (SOI). We successfully synthesized BaIr2, the last Laves phase remaining unsynthesized in the MgCu2-type AM2 (A = Ca, Sr, Ba; M = Rh, Pd, Ir, Pt). BaIr2 was crystallized at 925 C under a pressure of 3.3 GPa via a solid-state reaction between Ba and Ir powders; it was found to have the longest a-lattice constant of 8.038(1) A among AM2. BaIr2 exhibited bulk superconductivity at a transition temperature (Tc) of 2.7 K. BaIr2 was found to have a type-II superconductor with an upper critical field of 67.7 kOe, which was above the Pauli paramagnetic limit (50 kOe). The electron-phonon coupling constant and normalized specific heat jump were measured to be 0.63 and 1.2, respectively, indicating that BaIr2 is a weak-coupling superconductor. The electronic-structure calculations for BaIr2 revealed that the Ir-5d states are dominant at the Fermi energy (EF) and the density of states at the EF is strongly affected by SOI as in the case of CaIr2 and SrIr2. △ Less

Submitted 24 June, 2022; originally announced June 2022.

Comments: 9 pages, 8 figures

Vision-Aided Frame-Capture-Based CSI Recomposition for WiFi Sensing: A Multimodal Approach

Authors: Hiroki Shimomura, Yusuke Koda, Takamochi Kanda, Koji Yamamoto, Takayuki Nishio, Akihito Taya

Abstract: Recompositing channel state information (CSI) from the beamforming feedback matrix (BFM), which is a compressed version of CSI and can be captured because of its lack of encryption, is an alternative way of implementing firmware-agnostic WiFi sensing. In this study, we propose the use of camera images toward the accuracy enhancement of CSI recomposition from BFM. The key motivation for this vision… ▽ More Recompositing channel state information (CSI) from the beamforming feedback matrix (BFM), which is a compressed version of CSI and can be captured because of its lack of encryption, is an alternative way of implementing firmware-agnostic WiFi sensing. In this study, we propose the use of camera images toward the accuracy enhancement of CSI recomposition from BFM. The key motivation for this vision-aided CSI recomposition is to draw a first-hand insight that the BFM does not fully involve spatial information to recomposite CSI and that this could be compensated by camera images. To leverage the camera images, we use multimodal deep learning, where the two modalities, i.e., images and BFMs, are integrated to recomposite the CSI. We conducted experiments using IEEE 802.11ac devices. The experimental results confirmed that the recomposition accuracy of the proposed multimodal framework is improved compared to the single-modal framework only using images or BFMs. △ Less

Submitted 3 June, 2022; originally announced June 2022.

Watch from sky: machine-learning-based multi-UAV network for predictive police surveillance

Authors: Ryusei Sugano, Ryoichi Shinkuma, Takayuki Nishio, Sohei Itahara, Narayan B. Mandayam

Abstract: This paper presents the watch-from-sky framework, where multiple unmanned aerial vehicles (UAVs) play four roles, i.e., sensing, data forwarding, computing, and patrolling, for predictive police surveillance. Our framework is promising for crime deterrence because UAVs are useful for collecting and distributing data and have high mobility. Our framework relies on machine learning (ML) technology f… ▽ More This paper presents the watch-from-sky framework, where multiple unmanned aerial vehicles (UAVs) play four roles, i.e., sensing, data forwarding, computing, and patrolling, for predictive police surveillance. Our framework is promising for crime deterrence because UAVs are useful for collecting and distributing data and have high mobility. Our framework relies on machine learning (ML) technology for controlling and dispatching UAVs and predicting crimes. This paper compares the conceptual model of our framework against the literature. It also reports a simulation of UAV dispatching using reinforcement learning and distributed ML inference over a lossy UAV network. △ Less

Submitted 6 March, 2022; originally announced March 2022.

Communication-oriented Model Fine-tuning for Packet-loss Resilient Distributed Inference under Highly Lossy IoT Networks

Authors: Sohei Itahara, Takayuki Nishio, Yusuke Koda, Koji Yamamoto

Abstract: The distributed inference (DI) framework has gained traction as a technique for real-time applications empowered by cutting-edge deep machine learning (ML) on resource-constrained Internet of things (IoT) devices. In DI, computational tasks are offloaded from the IoT device to the edge server via lossy IoT networks. However, generally, there is a communication system-level trade-off between commun… ▽ More The distributed inference (DI) framework has gained traction as a technique for real-time applications empowered by cutting-edge deep machine learning (ML) on resource-constrained Internet of things (IoT) devices. In DI, computational tasks are offloaded from the IoT device to the edge server via lossy IoT networks. However, generally, there is a communication system-level trade-off between communication latency and reliability; thus, to provide accurate DI results, a reliable and high-latency communication system is required to be adapted, which results in non-negligible end-to-end latency of the DI. This motivated us to improve the trade-off between the communication latency and accuracy by efforts on ML techniques. Specifically, we have proposed a communication-oriented model tuning (COMtune), which aims to achieve highly accurate DI with low-latency but unreliable communication links. In COMtune, the key idea is to fine-tune the ML model by emulating the effect of unreliable communication links through the application of the dropout technique. This enables the DI system to obtain robustness against unreliable communication links. Our ML experiments revealed that COMtune enables accurate predictions with low latency and under lossy networks. △ Less

Submitted 17 December, 2021; originally announced December 2021.

Comments: Submitted to IEEE Access

Bi-directional Beamforming Feedback-based Firmware-agnostic WiFi Sensing: An Empirical Study

Authors: S. Kondo, S. Itahara, K. Yamashita, K. Yamamoto, Y. Koda, T. Nishio, A. Taya

Abstract: In the field of WiFi sensing, as an alternative sensing source of the channel state information (CSI) matrix, the use of a beamforming feedback matrix (BFM)that is a right singular matrix of the CSI matrix has attracted significant interest owing to its wide availability regarding the underlying WiFi systems. In the IEEE 802.11ac/ax standard, the station (STA) transmits a BFM to an access point (A… ▽ More In the field of WiFi sensing, as an alternative sensing source of the channel state information (CSI) matrix, the use of a beamforming feedback matrix (BFM)that is a right singular matrix of the CSI matrix has attracted significant interest owing to its wide availability regarding the underlying WiFi systems. In the IEEE 802.11ac/ax standard, the station (STA) transmits a BFM to an access point (AP), which uses the BFM for precoded multiple-input and multiple-output communications. In addition, in the same way, the AP transmits a BFM to the STA, and the STA uses the received BFM. Regarding BFM-based sensing, extensive real-world experiments were conducted as part of this study, and two key insights were reported: Firstly, this report identified a potential issue related to accuracy in existing uni-directional BFM-based sensing frameworks that leverage only BFMs transmitted for the AP or STA. Such uni-directionality introduces accuracy concerns when there is a sensing capability gap between the uni-directional BFMs for the AP and STA. Thus, this report experimentally evaluates the sensing ability disparity between the uni-directional BFMs, and shows that the BFMs transmitted for an AP achieve higher sensing accuracy compared to the BFMs transmitted from the STA when the sensing target values are estimated depending on the angle of departure of the AP. Secondly, to complement the sensing gap, this paper proposes a bi-directional sensing framework, which simultaneously leverages the BFMs transmitted from the AP and STA. The experimental evaluations reveal that bi-directional sensing achieves higher accuracy than uni-directional sensing in terms of the human localization task. △ Less

Submitted 27 February, 2022; v1 submitted 13 December, 2021; originally announced December 2021.

Comments: 10 pages, 7 figures

Frame-Capture-Based CSI Recomposition Pertaining to Firmware-Agnostic WiFi Sensing

Authors: Ryosuke Hanahara, Sohei Itahara, Kota Yamashita, Yusuke Koda, Akihito Taya, Takayuki Nishio, Koji Yamamoto

Abstract: With regard to the implementation of WiFi sensing agnostic according to the availability of channel state information (CSI), we investigate the possibility of estimating a CSI matrix based on its compressed version, which is known as beamforming feedback matrix (BFM). Being different from the CSI matrix that is processed and discarded in physical layer components, the BFM can be captured using a m… ▽ More With regard to the implementation of WiFi sensing agnostic according to the availability of channel state information (CSI), we investigate the possibility of estimating a CSI matrix based on its compressed version, which is known as beamforming feedback matrix (BFM). Being different from the CSI matrix that is processed and discarded in physical layer components, the BFM can be captured using a medium-access-layer frame-capturing technique because this is exchanged among an access point (AP) and stations (STAs) over the air. This indicates that WiFi sensing that leverages the BFM matrix is more practical to implement using the pre-installed APs. However, the ability of BFM-based sensing has been evaluated in a few tasks, and more general insights into its performance should be provided. To fill this gap, we propose a CSI estimation method based on BFM, approximating the estimation function with a machine learning model. In addition, to improve the estimation accuracy, we leverage the inter-subcarrier dependency using the BFMs at multiple subcarriers in orthogonal frequency division multiplexing transmissions. Our simulation evaluation reveals that the estimated CSI matches the ground-truth amplitude. Moreover, compared to CSI estimation at each individual subcarrier, the effect of the BFMs at multiple subcarriers on the CSI estimation accuracy is validated. △ Less

Submitted 29 October, 2021; originally announced October 2021.

Journal ref: Proc. IEEE 19th Annual Consumer Communications & Networking Conference (CCNC 2022)

Beamforming Feedback-based Model-Driven Angle of Departure Estimation Toward Legacy Support in WiFi Sensing: An Experimental Study

Authors: Sohei Itahara, Sota Kondo, Kota Yamashita, Takayuki Nishio, Koji Yamamoto, Yusuke Koda

Abstract: This study experimentally validated the possibility of angle of departure (AoD) estimation using multiple signal classification (MUSIC) with only WiFi control frames for beamforming feedback (BFF), defined in IEEE 802.11ac/ax. The examined BFF-based MUSIC is a model-driven algorithm, which does not require a pre-obtained database. This contrasts with most existing BFF-based sensing techniques, whi… ▽ More This study experimentally validated the possibility of angle of departure (AoD) estimation using multiple signal classification (MUSIC) with only WiFi control frames for beamforming feedback (BFF), defined in IEEE 802.11ac/ax. The examined BFF-based MUSIC is a model-driven algorithm, which does not require a pre-obtained database. This contrasts with most existing BFF-based sensing techniques, which are data-driven and require a pre-obtained database. Moreover, the BFF-based MUSIC affords an alternative AoD estimation method without access to channel state information (CSI). Specifically, the extensive experimental and numerical evaluations demonstrated that the BFF-based MUSIC successfully estimates the AoDs for multiple propagation paths. Moreover, the evaluations performed in this study revealed that the BFF-based MUSIC achieved a comparable error of AoD estimation to the CSI-based MUSIC, while BFF is a highly compressed version of CSI in IEEE 802.11ac/ax. △ Less

Submitted 2 February, 2022; v1 submitted 27 October, 2021; originally announced October 2021.

Comments: Submitted to IEEE Access

Computer Vision-assisted Single-antenna and Single-anchor RSSI Localization Harnessing Dynamic Blockage Events

Authors: Tomoya Sunami, Sohei Itahara, Yusuke Koda, Takayuki Nishio, Koji Yamamoto

Abstract: This paper demonstrates the feasibility of single-antenna and single-RF (radio frequency)- anchor received power strength indicator (RSSI) localization (SARR-LOC) with the assistance of the computer vision (CV) technique. Generally, to perform radio frequency (RF)-based device localization, either 1) fine-grained channel state information or 2) RSSIs from multiple antenna elements or multiple RF a… ▽ More This paper demonstrates the feasibility of single-antenna and single-RF (radio frequency)- anchor received power strength indicator (RSSI) localization (SARR-LOC) with the assistance of the computer vision (CV) technique. Generally, to perform radio frequency (RF)-based device localization, either 1) fine-grained channel state information or 2) RSSIs from multiple antenna elements or multiple RF anchors (e.g., access points) is required. Meanwhile, owing to deficiency of single-antenna and single-anchor RSSI, which only indicates a coarse-grained distance information between a receiver and a transmitter, realizing localization with single-antenna and single-anchor RSSI is challenging. Our key idea to address this challenge is to leverage CV technique and to estimate the most likely first Fresnel zone (FFZ) between the receiver and transmitter, where the role of the RSSI is to detect blockage timings. Specifically, historical positions of an obstacle that dynamically blocks the FFZ are detected by the CV technique, and we estimate positions at which a blockage starts and ends via a time series of RSSI. These estimated obstacle positions, in principle, coincide with points on the FFZ boundaries, enabling the estimation of the FFZ and localization of the transmitter. The experimental evaluation revealed that the proposed SARR-LOC achieved the localization error less than 1.0 m in an indoor environment, which is comparable to that of a conventional triangulation-based RSSI localization with multiple RF anchors. △ Less

Submitted 6 December, 2021; v1 submitted 10 July, 2021; originally announced July 2021.

Comments: Submitted to IEEE Internet of Things journal

Packet-Loss-Tolerant Split Inference for Delay-Sensitive Deep Learning in Lossy Wireless Networks

Authors: Sohei Itahara, Takayuki Nishio, Koji Yamamoto

Abstract: The distributed inference framework is an emerging technology for real-time applications empowered by cutting-edge deep machine learning (ML) on resource-constrained Internet of things (IoT) devices. In distributed inference, computational tasks are offloaded from the IoT device to other devices or the edge server via lossy IoT networks. However, narrow-band and lossy IoT networks cause non-neglig… ▽ More The distributed inference framework is an emerging technology for real-time applications empowered by cutting-edge deep machine learning (ML) on resource-constrained Internet of things (IoT) devices. In distributed inference, computational tasks are offloaded from the IoT device to other devices or the edge server via lossy IoT networks. However, narrow-band and lossy IoT networks cause non-negligible packet losses and retransmissions, resulting in non-negligible communication latency. This study solves the problem of the incremental retransmission latency caused by packet loss in a lossy IoT network. We propose a split inference with no retransmissions (SI-NR) method that achieves high accuracy without any retransmissions, even when packet loss occurs. In SI-NR, the key idea is to train the ML model by emulating the packet loss by a dropout method, which randomly drops the output of hidden units in a DNN layer. This enables the SI-NR system to obtain robustness against packet losses. Our ML experimental evaluation reveals that SI-NR obtains accurate predictions without packet retransmission at a packet loss rate of 60%. △ Less

Submitted 28 April, 2021; originally announced April 2021.

ACK-Less Rate Adaptation for IEEE 802.11bc Enhanced Broadcast Services Using Sim-to-Real Deep Reinforcement Learning

Authors: T. Kanda, Y. Koda, K. Yamamoto, T. Nishio

Abstract: In IEEE 802.11bc, the broadcast mode on wireless local area networks (WLANs), data rate control that is based on acknowledgement (ACK) mechanism similar to the one in the current IEEE 802.11 WLANs is not applicable because ACK mechanism is not implemented. This paper addresses this challenge by proposing ACK-less data rate adaptation methods by capturing non-broadcast uplink frames of STAs. In IEE… ▽ More In IEEE 802.11bc, the broadcast mode on wireless local area networks (WLANs), data rate control that is based on acknowledgement (ACK) mechanism similar to the one in the current IEEE 802.11 WLANs is not applicable because ACK mechanism is not implemented. This paper addresses this challenge by proposing ACK-less data rate adaptation methods by capturing non-broadcast uplink frames of STAs. In IEEE 802.11bc, an use case is assumed, where a part of STAs in the broadcast recipients is also associated with non-broadcast APs, and such STAs periodically transmit uplink frames including ACK frames. The proposed method is based on the idea that by overhearing such uplink frames, the broadcast AP surveys channel conditions at partial STAs, thereby setting appropriate data rates for the STAs. Furthermore, in order to avoid reception failures in a large portion of STAs, this paper proposes deep reinforcement learning (DRL)-based data rate adaptation framework that uses a sim-to-real approach. Therein, information of reception success/failure at broadcast recipient STAs, that could not be notified to the broadcast AP in real deployments, are made available by simulations beforehand, thereby forming data rate adaptation strategies. Numerical results show that utilizing overheard uplink frames of recipients makes it feasible to manage data rates in ACK-less broadcast WLANs, and using the sim-to-real DRL framework can decrease reception failures. △ Less

Submitted 23 April, 2021; originally announced April 2021.

Journal ref: Proc. IEEE 19th Annual Consumer Communications & Networking Conference (CCNC 2022)

Decentralized and Model-Free Federated Learning: Consensus-Based Distillation in Function Space

Authors: Akihito Taya, Takayuki Nishio, Masahiro Morikura, Koji Yamamoto

Abstract: This paper proposes a fully decentralized federated learning (FL) scheme for Internet of Everything (IoE) devices that are connected via multi-hop networks. Because FL algorithms hardly converge the parameters of machine learning (ML) models, this paper focuses on the convergence of ML models in function spaces. Considering that the representative loss functions of ML tasks e.g, mean squared error… ▽ More This paper proposes a fully decentralized federated learning (FL) scheme for Internet of Everything (IoE) devices that are connected via multi-hop networks. Because FL algorithms hardly converge the parameters of machine learning (ML) models, this paper focuses on the convergence of ML models in function spaces. Considering that the representative loss functions of ML tasks e.g, mean squared error (MSE) and Kullback-Leibler (KL) divergence, are convex functionals, algorithms that directly update functions in function spaces could converge to the optimal solution. The key concept of this paper is to tailor a consensus-based optimization algorithm to work in the function space and achieve the global optimum in a distributed manner. This paper first analyzes the convergence of the proposed algorithm in a function space, which is referred to as a meta-algorithm, and shows that the spectral graph theory can be applied to the function space in a manner similar to that of numerical vectors. Then, consensus-based multi-hop federated distillation (CMFD) is developed for a neural network (NN) to implement the meta-algorithm. CMFD leverages knowledge distillation to realize function aggregation among adjacent devices without parameter averaging. An advantage of CMFD is that it works even with different NN models among the distributed learners. Although CMFD does not perfectly reflect the behavior of the meta-algorithm, the discussion of the meta-algorithm's convergence property promotes an intuitive understanding of CMFD, and simulation evaluations show that NN models converge using CMFD for several tasks. The simulation results also show that CMFD achieves higher accuracy than parameter aggregation for weakly connected networks, and CMFD is more stable than parameter aggregation methods. △ Less

Submitted 3 October, 2022; v1 submitted 1 April, 2021; originally announced April 2021.

Journal ref: IEEE Transactions on Signal and Information Processing over Networks, vol. 8, pp. 799-814, 2022

Zero-Shot Adaptation for mmWave Beam-Tracking on Overhead Messenger Wires through Robust Adversarial Reinforcement Learning

Authors: Masao Shinzaki, Yusuke Koda, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura, Yushi Shirato, Daisei Uchida, Naoki Kita

Abstract: Millimeter wave (mmWave) beam-tracking based on machine learning enables the development of accurate tracking policies while obviating the need to periodically solve beam-optimization problems. However, its applicability is still arguable when training-test gaps exist in terms of environmental parameters that affect the node dynamics. From this skeptical point of view, the contribution of this stu… ▽ More Millimeter wave (mmWave) beam-tracking based on machine learning enables the development of accurate tracking policies while obviating the need to periodically solve beam-optimization problems. However, its applicability is still arguable when training-test gaps exist in terms of environmental parameters that affect the node dynamics. From this skeptical point of view, the contribution of this study is twofold. First, by considering an example scenario, we confirm that the training-test gap adversely affects the beam-tracking performance. More specifically, we consider nodes placed on overhead messenger wires, where the node dynamics are affected by several environmental parameters, e.g, the wire mass and tension. Although these are particular scenarios, they yield insight into the validation of the training-test gap problems. Second, we demonstrate the feasibility of \textit{zero-shot adaptation} as a solution, where a learning agent adapts to environmental parameters unseen during training. This is achieved by leveraging a robust adversarial reinforcement learning (RARL) technique, where such training-and-test gaps are regarded as disturbances by adversaries that are jointly trained with a legitimate beam-tracking agent. Numerical evaluations demonstrate that the beam-tracking policy learned via RARL can be applied to a wide range of environmental parameters without severely degrading the received power. △ Less

Submitted 10 July, 2021; v1 submitted 16 February, 2021; originally announced February 2021.

Comments: 13 pages, 13 figures, 3 tables, under submission for possible publication for IEEE

Millimeter Wave Communications on Overhead Messenger Wire: Deep Reinforcement Learning-Based Predictive Beam Tracking

Authors: Yusuke Koda, Masao Shinzaki, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura, Yushi Shirato, Daisei Uchida, Naoki Kita

Abstract: This paper discusses the feasibility of beam tracking against dynamics in millimeter wave (mmWave) nodes placed on overhead messenger wires, including wind-forced perturbations and disturbances caused by impulsive forces to wires. Our main contribution is to answer whether or not historical positions and velocities of a mmWave node is useful to track directional beams given the complicated on-wire… ▽ More This paper discusses the feasibility of beam tracking against dynamics in millimeter wave (mmWave) nodes placed on overhead messenger wires, including wind-forced perturbations and disturbances caused by impulsive forces to wires. Our main contribution is to answer whether or not historical positions and velocities of a mmWave node is useful to track directional beams given the complicated on-wire dynamics. To this end, we implement beam-tracking based on deep reinforcement learning (DRL) to learn the complicated relationships between the historical positions/velocities and appropriate beam steering angles. Our numerical evaluations yielded the following key insights: Against wind perturbations, an appropriate beam-tracking policy can be learned from the historical positions and velocities of a node. Meanwhile, against impulsive forces to the wire, the use of the position and velocity of the node is not necessarily sufficient owing to the rapid displacement of the node. To solve this, we propose to take advantage of the positional interaction on the wire by leveraging the positions/velocities of several points on the wire as state information in DRL. The results confirmed that this results in the avoidance of beam misalignment, which would not be possible by using only the position/velocity of the node. △ Less

Submitted 2 December, 2020; originally announced December 2020.

Comments: 12 pages, 18 figures

When Wireless Communications Meet Computer Vision in Beyond 5G

Authors: Takayuki Nishio, Yusuke Koda, Jihong Park, Mehdi Bennis, Klaus Doppler

Abstract: This article articulates the emerging paradigm, sitting at the confluence of computer vision and wireless communication, to enable beyond-5G/6G mission-critical applications (autonomous/remote-controlled vehicles, visuo-haptic VR, and other cyber-physical applications). First, drawing on recent advances in machine learning and the availability of non-RF data, vision-aided wireless networks are sho… ▽ More This article articulates the emerging paradigm, sitting at the confluence of computer vision and wireless communication, to enable beyond-5G/6G mission-critical applications (autonomous/remote-controlled vehicles, visuo-haptic VR, and other cyber-physical applications). First, drawing on recent advances in machine learning and the availability of non-RF data, vision-aided wireless networks are shown to significantly enhance the reliability of wireless communication without sacrificing spectral efficiency. In particular, we demonstrate how computer vision enables {look-ahead} prediction in a millimeter-wave channel blockage scenario, before the blockage actually happens. From a computer vision perspective, we highlight how radio frequency (RF) based sensing and imaging are instrumental in robustifying computer vision applications against occlusion and failure. This is corroborated via an RF-based image reconstruction use case, showcasing a receiver-side image failure correction resulting in reduced retransmission and latency. Taken together, this article sheds light on the much-needed convergence of RF and non-RF modalities to enable ultra-reliable communication and truly intelligent 6G networks. △ Less

Submitted 13 October, 2020; originally announced October 2020.

Comments: 7 pages, 4 figures; This work has been submitted to IEEE Communications Standards Magazine for possible publication

Journal ref: IEEE Communications Standards Magazine, Vol. 5, Issue 2, June 2021

MAB-based Client Selection for Federated Learning with Uncertain Resources in Mobile Networks

Authors: Naoya Yoshida, Takayuki Nishio, Masahiro Morikura, Koji Yamamoto

Abstract: This paper proposes a client selection method for federated learning (FL) when the computation and communication resource of clients cannot be estimated; the method trains a machine learning (ML) model using the rich data and computational resources of mobile clients without collecting their data in central systems. Conventional FL with client selection estimates the required time for an FL round… ▽ More This paper proposes a client selection method for federated learning (FL) when the computation and communication resource of clients cannot be estimated; the method trains a machine learning (ML) model using the rich data and computational resources of mobile clients without collecting their data in central systems. Conventional FL with client selection estimates the required time for an FL round from a given clients' computation power and throughput and determines a client set to reduce time consumption in FL rounds. However, it is difficult to obtain accurate resource information for all clients before the FL process is conducted because the available computation and communication resources change easily based on background computation tasks, background traffic, bottleneck links, etc. Consequently, the FL operator must select clients through exploration and exploitation processes. This paper proposes a multi-armed bandit (MAB)-based client selection method to solve the exploration and exploitation trade-off and reduce the time consumption for FL in mobile networks. The proposed method balances the selection of clients for which the amount of resources is uncertain and those known to have a large amount of resources. The simulation evaluation demonstrated that the proposed scheme requires less learning time than the conventional method in the resource fluctuating scenario. △ Less

Submitted 29 September, 2020; originally announced September 2020.

Online Trainable Wireless Link Quality Prediction System using Camera Imagery

Authors: Sohei Itahara, Takayuki Nishio, Masahiro Morikura, Koji Yamamoto

Abstract: Machine-learning-based prediction of future wireless link quality is an emerging technique that can potentially improve the reliability of wireless communications, especially at higher frequencies (e.g., millimeter-wave and terahertz technologies), through predictive handover and beamforming to solve line-of-sight (LOS) blockage problem. In this study, a real-time online trainable wireless link qu… ▽ More Machine-learning-based prediction of future wireless link quality is an emerging technique that can potentially improve the reliability of wireless communications, especially at higher frequencies (e.g., millimeter-wave and terahertz technologies), through predictive handover and beamforming to solve line-of-sight (LOS) blockage problem. In this study, a real-time online trainable wireless link quality prediction system was proposed; the system was implemented with commercially available laptops. The proposed system collects datasets, updates a model, and infers the received power in real-time. The experimental evaluation was conducted using 5 GHz Wi-Fi, where received signal strength could be degraded by 10 dB when the LOS path was blocked by large obstacles. The experimental results demonstrate that the prediction model is updated in real-time, adapts to the change in environment, and predicts the time-varying Wi-Fi received power accurately. △ Less

Submitted 29 September, 2020; originally announced September 2020.

Estimation of Individual Device Contributions for Incentivizing Federated Learning

Authors: Takayuki Nishio, Ryoichi Shinkuma, Narayan B. Mandayam

Abstract: Federated learning (FL) is an emerging technique used to train a machine-learning model collaboratively using the data and computation resource of the mobile devices without exposing privacy-sensitive user data. Appropriate incentive mechanisms that motivate the data and mobile-device owner to participate in FL is key to building a sustainable platform for FL. However, it is difficult to evaluat… ▽ More Federated learning (FL) is an emerging technique used to train a machine-learning model collaboratively using the data and computation resource of the mobile devices without exposing privacy-sensitive user data. Appropriate incentive mechanisms that motivate the data and mobile-device owner to participate in FL is key to building a sustainable platform for FL. However, it is difficult to evaluate the contribution level of the devices/owners to determine appropriate rewards without large computation and communication overhead. This paper proposes a computation-and communication-efficient method of estimating a participating device's contribution level. The proposed method enables such estimation during a single FL training process, there by reducing the need for traffic and computation overhead. The performance evaluations using the MNIST dataset show that the proposed method estimates individual participants' contributions accurately with 46-49% less computation overhead and no communication overhead than a naive estimation method. △ Less

Submitted 20 September, 2020; originally announced September 2020.

Comments: Submitted to IEEE Globecom Workshop

Experimental and Computational Determination of Optimal Boron Content in Layered Superconductor Sc$_{20}$C$_{8-x}$B$_x$C$_{20}$

Authors: Hiroki Ninomiya, Terunari Koshinuma, Taichiro Nishio, Hiroshi Fujihisa, Kenji Kawashima, Izumi Hase, Shigeyuki Ishida, Hiraku Ogino, Akira Iyo, Yoshiyuki Yoshida, Yoshito Gotoh, Hiroshi Eisaki

Abstract: It is generally difficult to quantify the amounts of light elements in materials because of their low X-ray-scattering power, as this means that they cannot be easily estimated via X-ray analyses. Meanwhile, the recently reported layered superconductor, Sc$_{20}$C$_{8-x}$B$_x$C$_{20}$, requires a small amount of boron, which is a light element, for its structural stability. In this context, here,… ▽ More It is generally difficult to quantify the amounts of light elements in materials because of their low X-ray-scattering power, as this means that they cannot be easily estimated via X-ray analyses. Meanwhile, the recently reported layered superconductor, Sc$_{20}$C$_{8-x}$B$_x$C$_{20}$, requires a small amount of boron, which is a light element, for its structural stability. In this context, here, we quantitatively evaluate the optimal $x$ value using both the experimental and computational approaches. Using the high-pressure synthesis approach that can maintain the starting composition even after sintering, we obtain the Sc$_{20}$(C,B)$_{8}$C$_{20}$ phase by the reaction of the previously reported Sc$_{15}$C$_{19}$ and B (Sc$_{15}$B$_y$C$_{19}$). Our experiments demonstrate that an increase in $y$ values promotes the phase formation of the Sc$_{20}$(C,B)$_{8}$C$_{20}$ structure; however, there appears to be an upper limit to the nominal $y$ value to form this phase. The maximum $T_\mathrm{c}$ $(=7.6\text{ K})$ is found to correspond with the actual $x$ value of $x \sim 5$ under the assumption that the sample with the same $T_\mathrm{c}$ as the reported value $(=7.7\text{ K})$ possesses the optimal $x$ amount. Moreover, we construct the energy convex hull diagram by calculating the formation enthalpy based on first principles. Our computational results indicate that the composition of Sc$_{20}$C$_4$B$_4$C$_{20}$ $(x=4)$ is the most thermodynamically stable, which is reasonably consistent with the experimentally obtained value. △ Less

Submitted 1 September, 2020; originally announced September 2020.

Comments: 10 pages, 1 table, 7 figures

Journal ref: Inorganic Chemistry (2020)

Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training with Non-IID Private Data

Authors: Sohei Itahara, Takayuki Nishio, Yusuke Koda, Masahiro Morikura, Koji Yamamoto

Abstract: This study develops a federated learning (FL) framework overcoming largely incremental communication costs due to model sizes in typical frameworks without compromising model performance. To this end, based on the idea of leveraging an unlabeled open dataset, we propose a distillation-based semi-supervised FL (DS-FL) algorithm that exchanges the outputs of local models among mobile devices, instea… ▽ More This study develops a federated learning (FL) framework overcoming largely incremental communication costs due to model sizes in typical frameworks without compromising model performance. To this end, based on the idea of leveraging an unlabeled open dataset, we propose a distillation-based semi-supervised FL (DS-FL) algorithm that exchanges the outputs of local models among mobile devices, instead of model parameter exchange employed by the typical frameworks. In DS-FL, the communication cost depends only on the output dimensions of the models and does not scale up according to the model size. The exchanged model outputs are used to label each sample of the open dataset, which creates an additionally labeled dataset. Based on the new dataset, local models are further trained, and model performance is enhanced owing to the data augmentation effect. We further highlight that in DS-FL, the heterogeneity of the devices' dataset leads to ambiguous of each data sample and lowing of the training convergence. To prevent this, we propose entropy reduction averaging, where the aggregated model outputs are intentionally sharpened. Moreover, extensive experiments show that DS-FL reduces communication costs up to 99% relative to those of the FL benchmark while achieving similar or higher classification accuracy. △ Less

Submitted 20 January, 2021; v1 submitted 13 August, 2020; originally announced August 2020.

Journal ref: IEEE Transactions on Mobile Computing (2021) 1-15

Versatile Multilinked Aerial Robot with Tilting Propellers: Design, Modeling, Control and State Estimation for Autonomous Flight and Manipulation

Authors: Moju Zhao, Tomoki Anzai, Fan Shi, Toshiya Maki, Takuzumi Nishio, Keita Ito, Naoya Kuromiya, Kei Okada, Masayuki Inaba

Abstract: Multilinked aerial robot is one of the state-of-the-art works in aerial robotics, which demonstrates the deformability benefiting both maneuvering and manipulation. However, the performance in outdoor physical world has not yet been evaluated because of the weakness in the controllability and the lack of the state estimation for autonomous flight. Thus we adopt tilting propellers to enhance the co… ▽ More Multilinked aerial robot is one of the state-of-the-art works in aerial robotics, which demonstrates the deformability benefiting both maneuvering and manipulation. However, the performance in outdoor physical world has not yet been evaluated because of the weakness in the controllability and the lack of the state estimation for autonomous flight. Thus we adopt tilting propellers to enhance the controllability. The related design, modeling and control method are developed in this work to enable the stable hovering and deformation. Furthermore, the state estimation which involves the time synchronization between sensors and the multilinked kinematics is also presented in this work to enable the fully autonomous flight in the outdoor environment. Various autonomous outdoor experiments, including the fast maneuvering for interception with target, object gras** for delivery, and blanket manipulation for firefighting are performed to evaluate the feasibility and versatility of the proposed robot platform. To the best of our knowledge, this is the first study for the multilinked aerial robot to achieve the fully autonomous flight and the manipulation task in outdoor environment. We also applied our platform in all challenges of the 2020 Mohammed Bin Zayed International Robotics Competition, and ranked third place in Challenge 1 and sixth place in Challenge 3 internationally, demonstrating the reliable flight performance in the fields. △ Less

Submitted 12 August, 2020; originally announced August 2020.

Distributed Heteromodal Split Learning for Vision Aided mmWave Received Power Prediction

Authors: Yusuke Koda, Jihong Park, Mehdi Bennis, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura

Abstract: The goal of this work is the accurate prediction of millimeter-wave received power leveraging both radio frequency (RF) signals and heterogeneous visual data from multiple distributed cameras, in a communication and energy-efficient manner while preserving data privacy. To this end, firstly focusing on data privacy, we propose heteromodal split learning with feature aggregation (HetSLAgg) that spl… ▽ More The goal of this work is the accurate prediction of millimeter-wave received power leveraging both radio frequency (RF) signals and heterogeneous visual data from multiple distributed cameras, in a communication and energy-efficient manner while preserving data privacy. To this end, firstly focusing on data privacy, we propose heteromodal split learning with feature aggregation (HetSLAgg) that splits neural network (NN) models into camera-side and base station (BS)-side segments. The BS-side NN segment fuses RF signals and uploaded image features without collecting raw images. However, the usage of multiple visual data leads to an increase in NN input dimensions, which gives rise to additional communication and energy costs. To overcome additional communication and energy costs due to image interpolation to blend different frame rates, we propose a novel BS-side manifold mixup technique that offloads the interpolation operations from cameras to a BS. Subsequently, we confront energy costs for operating a larger size of the BS- side NN segment due to concatenating image features across cameras and propose an energy-efficient aggregation method. This is done via a linear combination of image features instead of concatenating them, where the NN size is independent of the number of cameras. Comprehensive test-bed experiments with measured channels demonstrate that HetSLAgg reduces the prediction error by 44% compared to a baseline leveraging only RF received power. Moreover, the experiments show that the designed HetSLAgg achieves over 20% gains in terms of communication and energy cost reduction compared to several baseline designs within at most 1% of accuracy loss. △ Less

Submitted 16 July, 2020; originally announced July 2020.

Comments: 14 pages, 17 figures

Transfer Learning-Based Received Power Prediction with Ray-tracing Simulation and Small Amount of Measurement Data

Authors: Masahiro Iwasaki, Takayuki Nishio, Masahiro Morikura, Koji Yamamoto

Abstract: This paper proposes a method to predict received power in urban area deterministically, which can learn a prediction model from small amount of measurement data by a simulation-aided transfer learning and data augmentation. Recent development in machine learning such as artificial neural network (ANN) enables us to predict radio propagation and path loss accurately. However, training a high-perfor… ▽ More This paper proposes a method to predict received power in urban area deterministically, which can learn a prediction model from small amount of measurement data by a simulation-aided transfer learning and data augmentation. Recent development in machine learning such as artificial neural network (ANN) enables us to predict radio propagation and path loss accurately. However, training a high-performance ANN model requires a significant number of data, which are difficult to obtain in real environments. The main motivation for this work was to facilitate accurate prediction using small amount of measurement data. To this end, we propose a transfer learning-based prediction method with data augmentation. The proposed method pre-trains a prediction model using data generated from ray-tracing simulations, increases the number of data using simulation-assisted data augmentation, and then fine-tunes a model using the augmented data to fit the target environment. Experiments using Wi-Fi devices were conducted, and the results demonstrate that the proposed method predicts received power with 50% (or less) of the RMS error of conventional methods. △ Less

Submitted 2 May, 2020; originally announced May 2020.

Lottery Hypothesis based Unsupervised Pre-training for Model Compression in Federated Learning

Authors: Sohei Itahara, Takayuki Nishio, Masahiro Morikura, Koji Yamamoto

Abstract: Federated learning (FL) enables a neural network (NN) to be trained using privacy-sensitive data on mobile devices while retaining all the data on their local storages. However, FL asks the mobile devices to perform heavy communication and computation tasks, i.e., devices are requested to upload and download large-volume NN models and train them. This paper proposes a novel unsupervised pre-traini… ▽ More Federated learning (FL) enables a neural network (NN) to be trained using privacy-sensitive data on mobile devices while retaining all the data on their local storages. However, FL asks the mobile devices to perform heavy communication and computation tasks, i.e., devices are requested to upload and download large-volume NN models and train them. This paper proposes a novel unsupervised pre-training method adapted for FL, which aims to reduce both the communication and computation costs through model compression. Since the communication and computation costs are highly dependent on the volume of NN models, reducing the volume without decreasing model performance can reduce these costs. The proposed pre-training method leverages unlabeled data, which is expected to be obtained from the Internet or data repository much more easily than labeled data. The key idea of the proposed method is to obtain a ``good'' subnetwork from the original NN using the unlabeled data based on the lottery hypothesis. The proposed method trains an original model using a denoising auto encoder with the unlabeled data and then prunes small-magnitude parameters of the original model to generate a small but good subnetwork. The proposed method is evaluated using an image classification task. The results show that the proposed method requires 35\% less traffic and computation time than previous methods when achieving a certain test accuracy. △ Less

Submitted 21 April, 2020; originally announced April 2020.

Differentially Private AirComp Federated Learning with Power Adaptation Harnessing Receiver Noise

Authors: Yusuke Koda, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura

Abstract: Over-the-air computation (AirComp)-based federated learning (FL) enables low-latency uploads and the aggregation of machine learning models by exploiting simultaneous co-channel transmission and the resultant waveform superposition. This study aims at realizing secure AirComp-based FL against various privacy attacks where malicious central servers infer clients' private data from aggregated global… ▽ More Over-the-air computation (AirComp)-based federated learning (FL) enables low-latency uploads and the aggregation of machine learning models by exploiting simultaneous co-channel transmission and the resultant waveform superposition. This study aims at realizing secure AirComp-based FL against various privacy attacks where malicious central servers infer clients' private data from aggregated global models. To this end, a differentially private AirComp-based FL is designed in this study, where the key idea is to harness receiver noise perturbation injected to aggregated global models inherently, thereby preventing the inference of clients' private data. However, the variance of the inherent receiver noise is often uncontrollable, which renders the process of injecting an appropriate noise perturbation to achieve a desired privacy level quite challenging. Hence, this study designs transmit power control across clients, wherein the received signal level is adjusted intentionally to control the noise perturbation levels effectively, thereby achieving the desired privacy level. It is observed that a higher privacy level requires lower transmit power, which indicates the tradeoff between the privacy level and signal-to-noise ratio (SNR). To understand this tradeoff more fully, the closed-form expressions of SNR (with respect to the privacy level) are derived, and the tradeoff is analytically demonstrated. The analytical results also demonstrate that among the configurable parameters, the number of participating clients is a key parameter that enhances the received SNR under the aforementioned tradeoff. The analytical results are validated through numerical evaluations. △ Less

Submitted 14 April, 2020; originally announced April 2020.

Comments: 6 pages, 4 figures

Adversarial Reinforcement Learning-based Robust Access Point Coordination Against Uncoordinated Interference

Authors: Yuto Kihira, Yusuke Koda, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura

Abstract: This paper proposes a robust adversarial reinforcement learning (RARL)-based multi-access point (AP) coordination method that is robust even against unexpected decentralized operations of uncoordinated APs. Multi-AP coordination is a promising technique towards IEEE 802.11be, and there are studies that use RL for multi-AP coordination. Indeed, a simple RL-based multi-AP coordination method diminis… ▽ More This paper proposes a robust adversarial reinforcement learning (RARL)-based multi-access point (AP) coordination method that is robust even against unexpected decentralized operations of uncoordinated APs. Multi-AP coordination is a promising technique towards IEEE 802.11be, and there are studies that use RL for multi-AP coordination. Indeed, a simple RL-based multi-AP coordination method diminishes the collision probability among the APs; therefore, the method is a promising approach to improve time-resource efficiency. However, this method is vulnerable to frame transmissions of uncoordinated APs that are less aware of frame transmissions of other coordinated APs. To help the central agent experience even such unexpected frame transmissions, in addition to the central agent, the proposed method also competitively trains an adversarial AP that disturbs coordinated APs by causing frame collisions intensively. Besides, we propose to exploit a history of frame losses of a coordinated AP to promote reasonable competition between the central agent and adversarial AP. The simulation results indicate that the proposed method can avoid uncoordinated interference and thereby improve the minimum sum of the throughputs in the system compared to not considering the uncoordinated AP. △ Less

Submitted 2 April, 2020; originally announced April 2020.

Penalized and Decentralized Contextual Bandit Learning for WLAN Channel Allocation with Contention-Driven Feature Extraction

Authors: Kota Yamashita, Shotaro Kamiya, Koji Yamamoto, Yusuke Koda, Takayuki Nishio, Masahiro Morikura

Abstract: In this study, a contextual multi-armed bandit (CMAB)-based decentralized channel exploration framework disentangling a channel utility function (i.e., reward) with respect to contending neighboring access points (APs) is proposed. The proposed framework enables APs to evaluate observed rewards compositionally for contending APs, allowing both robustness against reward fluctuation due to neighbori… ▽ More In this study, a contextual multi-armed bandit (CMAB)-based decentralized channel exploration framework disentangling a channel utility function (i.e., reward) with respect to contending neighboring access points (APs) is proposed. The proposed framework enables APs to evaluate observed rewards compositionally for contending APs, allowing both robustness against reward fluctuation due to neighboring APs' varying channels and assessment of even unexplored channels. To realize this framework, we propose contention-driven feature extraction (CDFE), which extracts the adjacency relation among APs under contention and forms the basis for expressing reward functions in the disentangled form, that is, a linear combination of parameters associated with neighboring APs under contention). This allows the CMAB to be leveraged with joint a linear upper confidence bound (JLinUCB) exploration and to delve into the effectiveness of the proposed framework. Moreover, we address the problem of non-convergence -- the channel exploration cycle -- by proposing a penalized JLinUCB (P-JLinUCB) based on the key idea of introducing a discount parameter to the reward for exploiting a different channel before and after the learning round. Numerical evaluations confirm that the proposed method allows APs to assess the channel quality robustly against reward fluctuations by CDFE and achieves better convergence properties by P-JLinUCB. △ Less

Submitted 1 December, 2021; v1 submitted 23 March, 2020; originally announced March 2020.

Comments: 12 pages, 6 figures, 3 Tables

Communication-Efficient Multimodal Split Learning for mmWave Received Power Prediction

Authors: Yusuke Koda, Jihong Park, Mehdi Bennis, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura

Abstract: The goal of this study is to improve the accuracy of millimeter wave received power prediction by utilizing camera images and radio frequency (RF) signals, while gathering image inputs in a communication-efficient and privacy-preserving manner. To this end, we propose a distributed multimodal machine learning (ML) framework, coined multimodal split learning (MultSL), in which a large neural networ… ▽ More The goal of this study is to improve the accuracy of millimeter wave received power prediction by utilizing camera images and radio frequency (RF) signals, while gathering image inputs in a communication-efficient and privacy-preserving manner. To this end, we propose a distributed multimodal machine learning (ML) framework, coined multimodal split learning (MultSL), in which a large neural network (NN) is split into two wirelessly connected segments. The upper segment combines images and received powers for future received power prediction, whereas the lower segment extracts features from camera images and compresses its output to reduce communication costs and privacy leakage. Experimental evaluation corroborates that MultSL achieves higher accuracy than the baselines utilizing either images or RF signals. Remarkably, without compromising accuracy, compressing the lower segment output by 16x yields 16x lower communication latency and 2.8% less privacy leakage compared to the case without compression. △ Less

Submitted 2 March, 2020; v1 submitted 1 March, 2020; originally announced March 2020.

Comments: 5 pages, 7 figures, to be published at IEEE Communications Letters

Extreme URLLC: Vision, Challenges, and Key Enablers

Authors: Jihong Park, Sumudu Samarakoon, Hamid Shiri, Mohamed K. Abdel-Aziz, Takayuki Nishio, Anis Elgabli, Mehdi Bennis

Abstract: Notwithstanding the significant traction gained by ultra-reliable and low-latency communication (URLLC) in both academia and 3GPP standardization, fundamentals of URLLC remain elusive. Meanwhile, new immersive and high-stake control applications with much stricter reliability, latency and scalability requirements are posing unprecedented challenges in terms of system design and algorithmic solutio… ▽ More Notwithstanding the significant traction gained by ultra-reliable and low-latency communication (URLLC) in both academia and 3GPP standardization, fundamentals of URLLC remain elusive. Meanwhile, new immersive and high-stake control applications with much stricter reliability, latency and scalability requirements are posing unprecedented challenges in terms of system design and algorithmic solutions. This article aspires at providing a fresh and in-depth look into URLLC by first examining the limitations of 5G URLLC, and putting forward key research directions for the next generation of URLLC, coined eXtreme ultra-reliable and low-latency communication (xURLLC). xURLLC is underpinned by three core concepts: (1) it leverages recent advances in machine learning (ML) for faster and reliable data-driven predictions; (2) it fuses both radio frequency (RF) and non-RF modalities for modeling and combating rare events without sacrificing spectral efficiency; and (3) it underscores the much needed joint communication and control co-design, as opposed to the communication-centric 5G URLLC. The intent of this article is to spearhead beyond-5G/6G mission-critical applications by laying out a holistic vision of xURLLC, its research challenges and enabling technologies, while providing key insights grounded in selected use cases. △ Less

Submitted 27 January, 2020; originally announced January 2020.

Comments: 7 pages, 6 figures; This work has been submitted to the IEEE for possible publication

One Pixel Image and RF Signal Based Split Learning for mmWave Received Power Prediction

Authors: Yusuke Koda, Jihong Park, Mehdi Bennis, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura

Abstract: Focusing on the received power prediction of millimeter-wave (mmWave) radio-frequency (RF) signals, we propose a multimodal split learning (SL) framework that integrates RF received signal powers and depth-images observed by physically separated entities. To improve its communication efficiency while preserving data privacy, we propose an SL neural network architecture that compresses the communic… ▽ More Focusing on the received power prediction of millimeter-wave (mmWave) radio-frequency (RF) signals, we propose a multimodal split learning (SL) framework that integrates RF received signal powers and depth-images observed by physically separated entities. To improve its communication efficiency while preserving data privacy, we propose an SL neural network architecture that compresses the communication payload, i.e., images. Compared to a baseline solely utilizing RF signals, numerical results show that SL integrating only one pixel image with RF signals achieves higher prediction accuracy while maximizing both communication efficiency and privacy guarantees. △ Less

Submitted 5 November, 2019; originally announced November 2019.

Comments: 3 pages, Accepted in ACM CoNEXT 2019 Poster Session

Cooperative Sensing in Deep RL-Based Image-to-Decision Proactive Handover for mmWave Networks

Authors: Yusuke Koda, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura

Abstract: For reliable millimeter-wave (mmWave) networks, this paper proposes cooperative sensing with multi-camera operation in an image-to-decision proactive handover framework that directly maps images to a handover decision. In the framework, camera images are utilized to allow for the prediction of blockage effects in a mmWave link, whereby a network controller triggers a handover in a proactive fashio… ▽ More For reliable millimeter-wave (mmWave) networks, this paper proposes cooperative sensing with multi-camera operation in an image-to-decision proactive handover framework that directly maps images to a handover decision. In the framework, camera images are utilized to allow for the prediction of blockage effects in a mmWave link, whereby a network controller triggers a handover in a proactive fashion. Furthermore, direct map** allows for the scalability of the number of pedestrians. This paper experimentally investigates the feasibility of adopting cooperative sensing with multiple cameras that can compensate for one another's blind spots. The optimal map** is learned via deep reinforcement learning to resolve the high dimensionality of images from multiple cameras. An evaluation based on experimentally obtained images and received powers verifies that a map** that enhances channel capacity can be learned in a multi-camera operation. The results indicate that our proposed framework with multi-camera operation outperforms a conventional framework with single-camera operation in terms of the average capacity. △ Less

Submitted 12 June, 2019; originally announced June 2019.

Comments: arXiv admin note: text overlap with arXiv:1904.04585

Hybrid-FL for Wireless Networks: Cooperative Learning Mechanism Using Non-IID Data

Authors: Naoya Yoshida, Takayuki Nishio, Masahiro Morikura, Koji Yamamoto, Ryo Yonetani

Abstract: This paper proposes a cooperative mechanism for mitigating the performance degradation due to non-independent-and-identically-distributed (non-IID) data in collaborative machine learning (ML), namely federated learning (FL), which trains an ML model using the rich data and computational resources of mobile clients without gathering their data to central systems. The data of mobile clients is typic… ▽ More This paper proposes a cooperative mechanism for mitigating the performance degradation due to non-independent-and-identically-distributed (non-IID) data in collaborative machine learning (ML), namely federated learning (FL), which trains an ML model using the rich data and computational resources of mobile clients without gathering their data to central systems. The data of mobile clients is typically non-IID owing to diversity among mobile clients' interests and usage, and FL with non-IID data could degrade the model performance. Therefore, to mitigate the degradation induced by non-IID data, we assume that a limited number (e.g., less than 1%) of clients allow their data to be uploaded to a server, and we propose a hybrid learning mechanism referred to as Hybrid-FL, wherein the server updates the model using the data gathered from the clients and aggregates the model with the models trained by clients. The Hybrid-FL solves both client- and data-selection problems via heuristic algorithms, which try to select the optimal sets of clients who train models with their own data, clients who upload their data to the server, and data uploaded to the server. The algorithms increase the number of clients participating in FL and make more data gather in the server IID, thereby improving the prediction accuracy of the aggregated model. Evaluations, which consist of network simulations and ML experiments, demonstrate that the proposed scheme achieves a 13.5% higher classification accuracy than those of the previously proposed schemes for the non-IID case. △ Less

Submitted 5 March, 2020; v1 submitted 17 May, 2019; originally announced May 2019.

Journal ref: Proc. IEEE ICC 2019, Dublin, Ireland, June 2020

Deep Reinforcement Learning-Based Channel Allocation for Wireless LANs with Graph Convolutional Networks

Authors: Kota Nakashima, Shotaro Kamiya, Kazuki Ohtsu, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura

Abstract: Last year, IEEE 802.11 Extremely High Throughput Study Group (EHT Study Group) was established to initiate discussions on new IEEE 802.11 features. Coordinated control methods of the access points (APs) in the wireless local area networks (WLANs) are discussed in EHT Study Group. The present study proposes a deep reinforcement learning-based channel allocation scheme using graph convolutional netw… ▽ More Last year, IEEE 802.11 Extremely High Throughput Study Group (EHT Study Group) was established to initiate discussions on new IEEE 802.11 features. Coordinated control methods of the access points (APs) in the wireless local area networks (WLANs) are discussed in EHT Study Group. The present study proposes a deep reinforcement learning-based channel allocation scheme using graph convolutional networks (GCNs). As a deep reinforcement learning method, we use a well-known method double deep Q-network. In densely deployed WLANs, the number of the available topologies of APs is extremely high, and thus we extract the features of the topological structures based on GCNs. We apply GCNs to a contention graph where APs within their carrier sensing ranges are connected to extract the features of carrier sensing relationships. Additionally, to improve the learning speed especially in an early stage of learning, we employ a game theory-based method to collect the training data independently of the neural network model. The simulation results indicate that the proposed method can appropriately control the channels when compared to extant methods. △ Less

Submitted 17 May, 2019; originally announced May 2019.

Handover Management for mmWave Networks with Proactive Performance Prediction Using Camera Images and Deep Reinforcement Learning

Authors: Yusuke Koda, Kota Nakashima, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura

Abstract: For millimeter-wave networks, this paper presents a paradigm shift for leveraging time-consecutive camera images in handover decision problems. While making handover decisions, it is important to predict future long-term performance---e.g., the cumulative sum of time-varying data rates---proactively to avoid making myopic decisions. However, this study experimentally notices that a time-variation… ▽ More For millimeter-wave networks, this paper presents a paradigm shift for leveraging time-consecutive camera images in handover decision problems. While making handover decisions, it is important to predict future long-term performance---e.g., the cumulative sum of time-varying data rates---proactively to avoid making myopic decisions. However, this study experimentally notices that a time-variation in the received powers is not necessarily informative for proactively predicting the rapid degradation of data rates caused by moving obstacles. To overcome this challenge, this study proposes a proactive framework wherein handover timings are optimized while obstacle-caused data rate degradations are predicted before the degradations occur. The key idea is to expand a state space to involve time consecutive camera images, which comprises informative features for predicting such data rate degradations. To overcome the difficulty in handling the large dimensionality of the expanded state space, we use a deep reinforcement learning for deciding the handover timings. The evaluations performed based on the experimentally obtained camera images and received powers demonstrate that the expanded state space facilitates (i) the prediction of obstacle-caused data rate degradations from 500 ms before the degradations occur and (ii) superior performance to a handover framework without the state space expansion △ Less

Submitted 17 July, 2020; v1 submitted 9 April, 2019; originally announced April 2019.

Comments: 14 pages, 19 figures, Published at IEEE Transactions on Cognitive Communications and Networking

Concurrent Transmission Scheduling for Perceptual Data Sharing in mmWave Vehicular Networks

Authors: Akihito Taya, Takayuki Nishio, Masahiro Morikura, Koji Yamamoto

Abstract: Sharing perceptual data with other vehicles enhances the traffic safety of autonomous vehicles because it helps vehicles locate other vehicles and pedestrians in their blind spots. Such safety applications require high throughput and short delay, which cannot be achieved by conventional microwave vehicular communication systems. Therefore, millimeter-wave (mmWave) communications are considered to… ▽ More Sharing perceptual data with other vehicles enhances the traffic safety of autonomous vehicles because it helps vehicles locate other vehicles and pedestrians in their blind spots. Such safety applications require high throughput and short delay, which cannot be achieved by conventional microwave vehicular communication systems. Therefore, millimeter-wave (mmWave) communications are considered to be a key technology for sharing perceptual data because of their wide bandwidth. One of the challenges of data sharing in mmWave communications is broadcasting because narrow-beam directional antennas are used to obtain high gain. Because many vehicles should share their perceptual data to others within a short time frame in order to enlarge the areas that can be perceived based on shared perceptual data, an efficient scheduling for concurrent transmission that improves spatial reuse is required for perceptual data sharing. This paper proposes a data sharing algorithm that employs a graph-based concurrent transmission scheduling. The proposed algorithm realizes concurrent transmission to improve spatial reuse by designing a rule that is utilized to determine if the two pairs of transmitters and receivers interfere with each other by considering the radio propagation characteristics of narrow-beam antennas. A prioritization method that considers the geographical information in perceptual data is also designed to enlarge perceivable areas in situations where data sharing time is limited and not all data can be shared. Simulation results demonstrate that the proposed algorithm doubles the area of the cooperatively perceivable region compared with a conventional algorithm that does not consider mmWave communications because the proposed algorithm achieves high-throughput transmission by improving spatial reuse. The prioritization also enlarges the perceivable region by a maximum of 20%. △ Less

Submitted 22 March, 2019; originally announced March 2019.

Comments: IEICE TRANS. INF. & SYST

Journal ref: IEICE TRANSACTIONS on Information and Systems, Vol.E102-D,No.5, May 2019

Deep-Reinforcement-Learning-Based Distributed Vehicle Position Controls for Coverage Expansion in mmWave V2X

Authors: Akihito Taya, Takayuki Nishio, Masahiro Morikura, Koji Yamamoto

Abstract: In millimeter wave (mmWave) vehicular communications, multi-hop relay disconnection by line-of-sight (LOS) blockage is a critical problem, especially in the early diffusion phase of mmWave-available vehicles, where not all the vehicles have mmWave communication devices. This paper proposes a distributed position control method for autonomous vehicles to make long relays connecting to road side uni… ▽ More In millimeter wave (mmWave) vehicular communications, multi-hop relay disconnection by line-of-sight (LOS) blockage is a critical problem, especially in the early diffusion phase of mmWave-available vehicles, where not all the vehicles have mmWave communication devices. This paper proposes a distributed position control method for autonomous vehicles to make long relays connecting to road side units (RSUs) by avoiding blockages to communicate with each other via LOS paths. Even though vehicles with the proposed method do not use the whole information of the environments and cooperate with each other, they can decide their action (e.g., lane change and overtaking) to form long relays using only information of its surroundings (e.g., surrounding vehicle positions). The decision-making problem is formulated as a Markov decision process so that autonomous vehicles can learn a practical movement strategy of making long relays by a reinforcement learning (RL) algorithm. This paper designs a learning algorithm based on a sophisticated deep reinforcement learning algorithm, asynchronous advantage actor-critic (A3C), which enables vehicles to learn a complex movement strategy quickly by its deepneural-network architecture and multi-agent-learning mechanism. Once the strategy is well trained, vehicles can distributedly move to positions where the long relay to the RSU is established. Simulations results confirm that the proposed method can increase the relay length and coverage even if the traffic conditions and penetration ratio of mmWave communication devices in learning and operation phases are different. △ Less

Submitted 22 March, 2019; v1 submitted 26 October, 2018; originally announced October 2018.

Comments: 16 pages, 11 figures, IEICE Transactions on Communications

Superconductors that do not expel magnetic flux

Authors: Y. Tanaka, H. Yamamori, T. Yanagisawa, T. Nishio, S. Arisawa

Abstract: An ultrathin superconducting bilayer creates a coreless fractional vortex when only the second layer has a hole. The quantization is broken by the hole, and the normal core disappears. The magnetic flux is no longer confined near the normal core, and its density profile around the hole becomes similar to that of a crème caramel; the divergence of the magnetic flux density is truncated around the c… ▽ More An ultrathin superconducting bilayer creates a coreless fractional vortex when only the second layer has a hole. The quantization is broken by the hole, and the normal core disappears. The magnetic flux is no longer confined near the normal core, and its density profile around the hole becomes similar to that of a crème caramel; the divergence of the magnetic flux density is truncated around the center. We propose basic design of a practical device to realize a coreless fractional vortex. △ Less

Submitted 8 May, 2018; v1 submitted 30 April, 2018; originally announced May 2018.

Comments: 15 pages, 5 figures, The fourth version of the submission and the final update for arXiv. After this revision, the title is changed two times in a review process. In the first change, the title was "A vortex in a superconducting bilayer where one layer has a hole". The final title is "An unconventional vortex state in a superconducting bilayer where one layer has a hole"

Journal ref: Solid State Communications. Vol.277, pp 39-44, 2018