-
Multi-Object Tracking as Attention Mechanism
Authors:
Hiroshi Fukui,
Taiki Miyagawa,
Yusuke Morishita
Abstract:
We propose a conceptually simple and thus fast multi-object tracking (MOT) model that does not require any attached modules, such as the Kalman filter, Hungarian algorithm, transformer blocks, or graph networks. Conventional MOT models are built upon the multi-step modules listed above, and thus the computational cost is high. Our proposed end-to-end MOT model, \textit{TicrossNet}, is composed of…
▽ More
We propose a conceptually simple and thus fast multi-object tracking (MOT) model that does not require any attached modules, such as the Kalman filter, Hungarian algorithm, transformer blocks, or graph networks. Conventional MOT models are built upon the multi-step modules listed above, and thus the computational cost is high. Our proposed end-to-end MOT model, \textit{TicrossNet}, is composed of a base detector and a cross-attention module only. As a result, the overhead of tracking does not increase significantly even when the number of instances ($N_t$) increases. We show that TicrossNet runs \textit{in real-time}; specifically, it achieves 32.6 FPS on MOT17 and 31.0 FPS on MOT20 (Tesla V100), which includes as many as $>$100 instances per frame. We also demonstrate that TicrossNet is robust to $N_t$; thus, it does not have to change the size of the base detector, depending on $N_t$, as is often done by other models for real-time processing.
△ Less
Submitted 11 July, 2023;
originally announced July 2023.
-
Competing charge-density wave instabilities in the kagome metal ScV$_6$Sn$_6$
Authors:
Saizheng Cao,
Chenchao Xu,
Hiroshi Fukui,
Taishun Manjo,
Ming Shi,
Yang Liu,
Chao Cao,
Yu Song
Abstract:
Owing to its unique geometry, the kagome lattice hosts various many-body quantum states including frustrated magnetism, superconductivity, and charge-density waves (CDWs), with intense efforts focused on kagome metals exhibiting $2\times2$ CDWs associated with the nesting of van Hove saddle points. Recently, a $\sqrt{3}\times\sqrt{3}$ CDW was discovered in the kagome metal ScV$_6$Sn$_6$ below…
▽ More
Owing to its unique geometry, the kagome lattice hosts various many-body quantum states including frustrated magnetism, superconductivity, and charge-density waves (CDWs), with intense efforts focused on kagome metals exhibiting $2\times2$ CDWs associated with the nesting of van Hove saddle points. Recently, a $\sqrt{3}\times\sqrt{3}$ CDW was discovered in the kagome metal ScV$_6$Sn$_6$ below $T_{\rm CDW}\approx91$~K, whose underlying mechanism and formation process remain unclear. Using inelastic X-ray scattering, we discover a short-range $\sqrt{3}\times\sqrt{3}\times2$ CDW that is dominant in ScV$_6$Sn$_6$ well above $T_{\rm CDW}$, distinct from the $\sqrt{3}\times\sqrt{3}\times3$ CDW below $T_{\rm CDW}$. The short-range CDW grows upon cooling, and is accompanied by the softening of phonons, indicative of its dynamic nature. As the $\sqrt{3}\times\sqrt{3}\times3$ CDW appears, the short-range CDW becomes suppressed, revealing a competition between these CDW instabilities. Our first-principles calculations indicate that the $\sqrt{3}\times\sqrt{3}\times2$ CDW is energetically favored, consistent with experimental observations at high temperatures. However, the $\sqrt{3}\times\sqrt{3}\times3$ CDW is selected as the ground state likely due to a large wavevector-dependent electron-phonon coupling, which also accounts for the enhanced electron scattering above $T_{\rm CDW}$. The competing CDW instabilities in ScV$_6$Sn$_6$ lead to an unusual CDW formation process, with the most pronounced phonon softening and the static CDW occurring at different wavevectors.
△ Less
Submitted 17 April, 2023;
originally announced April 2023.
-
Lattice constants and magnetism of L10-ordered FePt under high pressure
Authors:
S. Sawada,
K. Okai,
H. Fukui,
R. Takahashi,
N. Ishimatsu,
H. Maruyama,
N. Kawamura,
S. Kawaguchi,
N. Hirao,
T. Seki,
K. Takanashi,
S. Ohmura,
H. Wadati
Abstract:
We studied the relationship between the lattice constant and magnetism of L10-ordered FePt under high pressure by means of first-principles calculations and synchrotron x-ray measurements. Based on our calculations, we found that the c/a ratio shows an anomaly at ~ 20 GPa and that the Pt magnetic moment is sharply suppressed at ~ 60 GPa. As for the c/a, we experimentally verified the anomaly at ~…
▽ More
We studied the relationship between the lattice constant and magnetism of L10-ordered FePt under high pressure by means of first-principles calculations and synchrotron x-ray measurements. Based on our calculations, we found that the c/a ratio shows an anomaly at ~ 20 GPa and that the Pt magnetic moment is sharply suppressed at ~ 60 GPa. As for the c/a, we experimentally verified the anomaly at ~ 20 GPa by powder x-ray diffraction. We also measured the x-ray magnetic circular dichroism at the Pt L edge up to ~ 20 GPa. Any significant change of the Pt magnetic moment was not observed, in agreement with the calculations. These results thus indicate the possibility that novel magnetic states can be created in L10-ordered FePt by lattice deformation under high pressure.
△ Less
Submitted 22 December, 2022;
originally announced December 2022.
-
Visual Explanation of Deep Q-Network for Robot Navigation by Fine-tuning Attention Branch
Authors:
Yuya Maruyama,
Hiroshi Fukui,
Tsubasa Hirakawa,
Takayoshi Yamashita,
Hironobu Fujiyoshi,
Komei Sugiura
Abstract:
Robot navigation with deep reinforcement learning (RL) achieves higher performance and performs well under complex environment. Meanwhile, the interpretation of the decision-making of deep RL models becomes a critical problem for more safety and reliability of autonomous robots. In this paper, we propose a visual explanation method based on an attention branch for deep RL models. We connect attent…
▽ More
Robot navigation with deep reinforcement learning (RL) achieves higher performance and performs well under complex environment. Meanwhile, the interpretation of the decision-making of deep RL models becomes a critical problem for more safety and reliability of autonomous robots. In this paper, we propose a visual explanation method based on an attention branch for deep RL models. We connect attention branch with pre-trained deep RL model and the attention branch is trained by using the selected action by the trained deep RL model as a correct label in a supervised learning manner. Because the attention branch is trained to output the same result as the deep RL model, the obtained attention maps are corresponding to the agent action with higher interpretability. Experimental results with robot navigation task show that the proposed method can generate interpretable attention maps for a visual explanation.
△ Less
Submitted 17 August, 2022;
originally announced August 2022.
-
Nature of low-temperature dense ice up to 80 GPa observed by x-ray diffraction
Authors:
Hiroshi Fukui,
Hirokazu Kadobayashi,
Hirotaka Abe,
Ryunosuke Takahashi,
Hiroki Wadati,
Naohisa Hirao
Abstract:
We have measured the lattice volume of ice VIII in different pressure-temperature pathways and found isothermal compression at low-temperature conditions makes the volume larger. Ice VIII has become its high-pressure phase with the molar volume of 6.45 cm^3 at 10 K where the pressure can be estimated as 60.4 GPa based on the third-order Birch-Murnaghan equation with parameters determined in this s…
▽ More
We have measured the lattice volume of ice VIII in different pressure-temperature pathways and found isothermal compression at low-temperature conditions makes the volume larger. Ice VIII has become its high-pressure phase with the molar volume of 6.45 cm^3 at 10 K where the pressure can be estimated as 60.4 GPa based on the third-order Birch-Murnaghan equation with parameters determined in this study (K_0= 32.4 GPa, K'_0= 3.7, and V_0= 11.9 cm^3). The present results indicate that this high-pressure state is paraelectric with tetragonal symmetry.
△ Less
Submitted 22 April, 2021;
originally announced April 2021.
-
Density deficit of the Earth's core revealed by a multi-megabar primary pressure scale
Authors:
Daijo Ikuta,
Eiji Ohtani,
Hiroshi Fukui,
Tatsuya Sakamaki,
Rolf Heid,
Daisuke Ishikawa,
Alfred Q. R. Baron
Abstract:
An accurate pressure scale is a fundamental requirement to understand planetary interiors. Here, we establish a primary pressure scale extending to the multi-megabar pressures of the Earth's core, by combined measurement of the acoustic velocities and the density from a rhenium sample in a diamond anvil cell using inelastic x-ray scattering and x-ray diffraction. Our scale agrees well with previou…
▽ More
An accurate pressure scale is a fundamental requirement to understand planetary interiors. Here, we establish a primary pressure scale extending to the multi-megabar pressures of the Earth's core, by combined measurement of the acoustic velocities and the density from a rhenium sample in a diamond anvil cell using inelastic x-ray scattering and x-ray diffraction. Our scale agrees well with previous primary scales and shock Hugoniots in each experimental pressure range, and reveals that previous scales have overestimated laboratory pressures by at least 20% at 230 gigapascals. It suggests that the light element content in the Earth's inner core (the density deficit relative to iron) is likely to be double what was previously estimated, or the Earth's inner core temperature is much higher than expected, or some combination thereof.
△ Less
Submitted 1 July, 2024; v1 submitted 5 April, 2021;
originally announced April 2021.
-
Embedding Human Knowledge into Deep Neural Network via Attention Map
Authors:
Masahiro Mitsuhara,
Hiroshi Fukui,
Yusuke Sakashita,
Takanori Ogata,
Tsubasa Hirakawa,
Takayoshi Yamashita,
Hironobu Fujiyoshi
Abstract:
In this work, we aim to realize a method for embedding human knowledge into deep neural networks. While the conventional method to embed human knowledge has been applied for non-deep machine learning, it is challenging to apply it for deep learning models due to the enormous number of model parameters. To tackle this problem, we focus on the attention mechanism of an attention branch network (ABN)…
▽ More
In this work, we aim to realize a method for embedding human knowledge into deep neural networks. While the conventional method to embed human knowledge has been applied for non-deep machine learning, it is challenging to apply it for deep learning models due to the enormous number of model parameters. To tackle this problem, we focus on the attention mechanism of an attention branch network (ABN). In this paper, we propose a fine-tuning method that utilizes a single-channel attention map which is manually edited by a human expert. Our fine-tuning method can train a network so that the output attention map corresponds to the edited ones. As a result, the fine-tuned network can output an attention map that takes into account human knowledge. Experimental results with ImageNet, CUB-200-2010, and IDRiD demonstrate that it is possible to obtain a clear attention map for a visual explanation and improve the classification performance. Our findings can be a novel framework for optimizing networks through human intuitive editing via a visual interface and suggest new possibilities for human-machine cooperation in addition to the improvement of visual explanations.
△ Less
Submitted 19 December, 2019; v1 submitted 9 May, 2019;
originally announced May 2019.
-
Attention Branch Network: Learning of Attention Mechanism for Visual Explanation
Authors:
Hiroshi Fukui,
Tsubasa Hirakawa,
Takayoshi Yamashita,
Hironobu Fujiyoshi
Abstract:
Visual explanation enables human to understand the decision making of Deep Convolutional Neural Network (CNN), but it is insufficient to contribute the performance improvement. In this paper, we focus on the attention map for visual explanation, which represents high response value as the important region in image recognition. This region significantly improves the performance of CNN by introducin…
▽ More
Visual explanation enables human to understand the decision making of Deep Convolutional Neural Network (CNN), but it is insufficient to contribute the performance improvement. In this paper, we focus on the attention map for visual explanation, which represents high response value as the important region in image recognition. This region significantly improves the performance of CNN by introducing an attention mechanism that focuses on a specific region in an image. In this work, we propose Attention Branch Network (ABN), which extends the top-down visual explanation model by introducing a branch structure with an attention mechanism. ABN can be applicable to several image recognition tasks by introducing a branch for attention mechanism and is trainable for the visual explanation and image recognition in end-to-end manner. We evaluate ABN on several image recognition tasks such as image classification, fine-grained recognition, and multiple facial attributes recognition. Experimental results show that ABN can outperform the accuracy of baseline models on these image recognition tasks while generating an attention map for visual explanation. Our code is available at https://github.com/machine-perception-robotics-group/attention_branch_network.
△ Less
Submitted 10 April, 2019; v1 submitted 24 December, 2018;
originally announced December 2018.
-
Auxiliary Optics For meV-IXS at SPring-8: KB, Analyzer Masks, Soller Slit & Screen, BPM
Authors:
Alfred Q. R. Baron,
Daisuke Ishikawa,
Hiroshi Fukui,
Yoichi Nakajima
Abstract:
This paper discusses several optical elements now in use at BL43LXU, the RIKEN Quantum NanoDynamics Beamline, of the RIKEN SPring-8 Center. BL43LXU is dedicated to meV-resolved inelastic x-rays scattering using spherical analyzers operating between 15.8 and 25.7 keV. The work described here is relevant for setups on the high-resolution spectrometer (10m two-theta arm) with resolution between 2.8 a…
▽ More
This paper discusses several optical elements now in use at BL43LXU, the RIKEN Quantum NanoDynamics Beamline, of the RIKEN SPring-8 Center. BL43LXU is dedicated to meV-resolved inelastic x-rays scattering using spherical analyzers operating between 15.8 and 25.7 keV. The work described here is relevant for setups on the high-resolution spectrometer (10m two-theta arm) with resolution between 2.8 and 0.8 meV. Specific optics discussed include a multilayer Kirkpatrick-Baez (KB) mirror pair that focuses the full (~1x3mm2) beam at 17.79 keV to a 4.4 X 4.1 μm2 spot with ~60% throughput, two different types of Soller slits that help reduce backgrounds, masks for the analyzers that allow increased solid angle to be collected while preserving momentum resolution, and a diamond quadrant beam position monitor (BPM). These elements have been used and facilitate experiments in extreme conditions with diamond anvil cells, and liquid measurements at low momentum transfers, among other work.
△ Less
Submitted 17 July, 2019; v1 submitted 4 July, 2018;
originally announced July 2018.
-
The impact of Hubbard- and van der Waals-corrections on the DFT calculation of epsilon-zeta transition pressure in solid oxygen
Authors:
Le The Anh,
Masahiro Wada,
Hiroshi Fukui,
Toshiaki Iitaka
Abstract:
The aim of this study is to clarify the physics which governs the transition from epsilon phase to zeta phase of solid oxygen observed experimentally at 96 GPa using density functional theory (DFT). The transition was predicted at 40 GPa with PBE functional. Then the Hubbard correction was added to enhance the localization of p-orbital of oxygen. The epsilon-zeta transition pressure was significan…
▽ More
The aim of this study is to clarify the physics which governs the transition from epsilon phase to zeta phase of solid oxygen observed experimentally at 96 GPa using density functional theory (DFT). The transition was predicted at 40 GPa with PBE functional. Then the Hubbard correction was added to enhance the localization of p-orbital of oxygen. The epsilon-zeta transition pressure was significantly improved to 70 GPa. Finally, we included the non-local van der Waals correction. The transition pressure slightly increases to 80 GPa. These results demonstrate that the contribution from Hubbard term is superior to van der Waals term.
△ Less
Submitted 18 March, 2018;
originally announced March 2018.
-
Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets
Authors:
Kenji Enomoto,
Ken Sakurada,
Weimin Wang,
Hiroshi Fukui,
Masashi Matsuoka,
Ryosuke Nakamura,
Nobuo Kawaguchi
Abstract:
In this paper, we propose a method for cloud removal from visible light RGB satellite images by extending the conditional Generative Adversarial Networks (cGANs) from RGB images to multispectral images. Satellite images have been widely utilized for various purposes, such as natural environment monitoring (pollution, forest or rivers), transportation improvement and prompt emergency response to di…
▽ More
In this paper, we propose a method for cloud removal from visible light RGB satellite images by extending the conditional Generative Adversarial Networks (cGANs) from RGB images to multispectral images. Satellite images have been widely utilized for various purposes, such as natural environment monitoring (pollution, forest or rivers), transportation improvement and prompt emergency response to disasters. However, the obscurity caused by clouds makes it unstable to monitor the situation on the ground with the visible light camera. Images captured by a longer wavelength are introduced to reduce the effects of clouds. Synthetic Aperture Radar (SAR) is such an example that improves visibility even the clouds exist. On the other hand, the spatial resolution decreases as the wavelength increases. Furthermore, the images captured by long wavelengths differs considerably from those captured by visible light in terms of their appearance. Therefore, we propose a network that can remove clouds and generate visible light images from the multispectral images taken as inputs. This is achieved by extending the input channels of cGANs to be compatible with multispectral images. The networks are trained to output images that are close to the ground truth using the images synthesized with clouds over the ground truth as inputs. In the available dataset, the proportion of images of the forest or the sea is very high, which will introduce bias in the training dataset if uniformly sampled from the original dataset. Thus, we utilize the t-Distributed Stochastic Neighbor Embedding (t-SNE) to improve the problem of bias in the training dataset. Finally, we confirm the feasibility of the proposed network on the dataset of four bands images, which include three visible light bands and one near-infrared (NIR) band.
△ Less
Submitted 13 October, 2017;
originally announced October 2017.
-
Physical Layer Network Coding: A Cautionary Story with Interference and Spatial Reservation
Authors:
Hironori Fukui,
Hiroyuki Yomo,
Petar Popovski
Abstract:
Physical layer network coding (PLNC) has the potential to improve throughput of multi-hop networks. However, most of the works are focused on the simple, three-node model with two-way relaying, not taking into account the fact that there can be other neighboring nodes that can cause/receive interference. The way to deal with this problem in distributed wireless networks is usage of MAC-layer mecha…
▽ More
Physical layer network coding (PLNC) has the potential to improve throughput of multi-hop networks. However, most of the works are focused on the simple, three-node model with two-way relaying, not taking into account the fact that there can be other neighboring nodes that can cause/receive interference. The way to deal with this problem in distributed wireless networks is usage of MAC-layer mechanisms that make a spatial reservation of the shared wireless medium, similar to the well-known RTS/CTS in IEEE 802.11 wireless networks. In this paper, we investigate two-way relaying in presence of interfering nodes and usage of spatial reservation mechanisms. Specifically, we introduce a reserved area in order to protect the nodes involved in two-way relaying from the interference caused by neighboring nodes. We analytically derive the end-to-end rate achieved by PLNC considering the impact of interference and reserved area. A relevant performance measure is data rate per unit area, in order to reflect the fact that any spatial reservation blocks another data exchange in the reserved area. The numerical results carry a cautionary message that the gains brought by PLNC over one-way relaying may be vanishing when the two-way relaying is considered in a broader context of a larger wireless network.
△ Less
Submitted 6 November, 2013;
originally announced November 2013.
-
On Complexity of Flooding Games on Graphs with Interval Representations
Authors:
Hiroyuki Fukui,
Yota Otachi,
Ryuhei Uehara,
Takeaki Uno,
Yushi Uno
Abstract:
The flooding games, which are called Flood-It, Mad Virus, or HoneyBee, are a kind of coloring games and they have been becoming popular online. In these games, each player colors one specified cell in his/her turn, and all connected neighbor cells of the same color are also colored by the color. This flooding or coloring spreads on the same color cells. It is natural to consider these new coloring…
▽ More
The flooding games, which are called Flood-It, Mad Virus, or HoneyBee, are a kind of coloring games and they have been becoming popular online. In these games, each player colors one specified cell in his/her turn, and all connected neighbor cells of the same color are also colored by the color. This flooding or coloring spreads on the same color cells. It is natural to consider these new coloring games on more general boards, or general graphs. Recently, computational complexities of the variants of the flooding games on several graph classes have been studied. In this paper, we investigate the flooding games on some graph classes characterized by interval representations. Our results state that the number of colors is a key parameter to determine the computational complexity of the flooding games. When the number of colors is a fixed constant, these games can be solved in polynomial time on an interval graph. On the other hand, if the number of colors is not bounded, the flooding game is NP-complete on a proper interval graph. We also state similar results for split graphs.
△ Less
Submitted 24 January, 2013; v1 submitted 27 June, 2012;
originally announced June 2012.
