-
Tracking Small Birds by Detection Candidate Region Filtering and Detection History-aware Association
Authors:
Tingwei Liu,
Yasutomo Kawanishi,
Takahiro Komamizu,
Ichiro Ide
Abstract:
This paper focuses on tracking birds that appear small in a panoramic video. When the size of the tracked object is small in the image (small object tracking) and move quickly, object detection and association suffers. To address these problems, we propose Adaptive Slicing Aided Hyper Inference (Adaptive SAHI), which reduces the candidate regions to apply detection, and Detection History-aware Sim…
▽ More
This paper focuses on tracking birds that appear small in a panoramic video. When the size of the tracked object is small in the image (small object tracking) and move quickly, object detection and association suffers. To address these problems, we propose Adaptive Slicing Aided Hyper Inference (Adaptive SAHI), which reduces the candidate regions to apply detection, and Detection History-aware Similarity Criterion (DHSC), which accurately associates objects in consecutive frames based on the detection history. Experiments on the NUBird2022 dataset verifies the effectiveness of the proposed method by showing improvements in both accuracy and speed.
△ Less
Submitted 27 May, 2024;
originally announced May 2024.
-
One-Stage Open-Vocabulary Temporal Action Detection Leveraging Temporal Multi-scale and Action Label Features
Authors:
Trung Thanh Nguyen,
Yasutomo Kawanishi,
Takahiro Komamizu,
Ichiro Ide
Abstract:
Open-vocabulary Temporal Action Detection (Open-vocab TAD) is an advanced video analysis approach that expands Closed-vocabulary Temporal Action Detection (Closed-vocab TAD) capabilities. Closed-vocab TAD is typically confined to localizing and classifying actions based on a predefined set of categories. In contrast, Open-vocab TAD goes further and is not limited to these predefined categories. Th…
▽ More
Open-vocabulary Temporal Action Detection (Open-vocab TAD) is an advanced video analysis approach that expands Closed-vocabulary Temporal Action Detection (Closed-vocab TAD) capabilities. Closed-vocab TAD is typically confined to localizing and classifying actions based on a predefined set of categories. In contrast, Open-vocab TAD goes further and is not limited to these predefined categories. This is particularly useful in real-world scenarios where the variety of actions in videos can be vast and not always predictable. The prevalent methods in Open-vocab TAD typically employ a 2-stage approach, which involves generating action proposals and then identifying those actions. However, errors made during the first stage can adversely affect the subsequent action identification accuracy. Additionally, existing studies face challenges in handling actions of different durations owing to the use of fixed temporal processing methods. Therefore, we propose a 1-stage approach consisting of two primary modules: Multi-scale Video Analysis (MVA) and Video-Text Alignment (VTA). The MVA module captures actions at varying temporal resolutions, overcoming the challenge of detecting actions with diverse durations. The VTA module leverages the synergy between visual and textual modalities to precisely align video segments with corresponding action labels, a critical step for accurate action identification in Open-vocab scenarios. Evaluations on widely recognized datasets THUMOS14 and ActivityNet-1.3, showed that the proposed method achieved superior results compared to the other methods in both Open-vocab and Closed-vocab settings. This serves as a strong demonstration of the effectiveness of the proposed method in the TAD task.
△ Less
Submitted 30 April, 2024;
originally announced April 2024.
-
Combination of crystal growth with optical floating zone and evaluation of Nd3+:LaAlO3 crystals with the dynamic nuclear polarization of 139La and 27Al
Authors:
Kohei Ishizaki,
Ikuo Ide,
Masaki Fujita,
Hiroki Hotta,
Yuki Ito,
Masataka Iinuma,
Yoichi Ikeda,
Takahiro Iwata,
Masaaki Kitaguchi,
Hideki Kohri,
Taku Matsushita,
Daisuke Miura,
Yoshiyuki Miyachi,
Hirohiko M. Shimizu,
Masaru Yosoi
Abstract:
Producing a polarized lanthanum (La) target with high polarization and long relaxation time is crucial for realizing time-reversal violation experiments using polarized neutron beams. We use a LaAlO3 crystal doped with a small amount of Nd3+ ions for the polarized lanthanum target. Optimizing the amount of Nd3+ ions is considerably important because the achievable polarization and relaxation time…
▽ More
Producing a polarized lanthanum (La) target with high polarization and long relaxation time is crucial for realizing time-reversal violation experiments using polarized neutron beams. We use a LaAlO3 crystal doped with a small amount of Nd3+ ions for the polarized lanthanum target. Optimizing the amount of Nd3+ ions is considerably important because the achievable polarization and relaxation time strongly depend on this amount. We established a fundamental method to grow single crystals of Nd3+:LaAlO3 using an optical floating zone method that employs halogen lamps and evaluated the crystals with the dynamic nuclear polarization (DNP) method for polarizing nuclear spins. Two crystal samples were grown by ourselves and evaluated with the DNP at 1.3 K and 2.3 T for the first time except for the target materials of protons. The enhancement of NMR signals for 139La and 27Al was successfully observed, and the enhancement factors were eventually 3.5+-0.3 and 13+-3 for the samples with Nd3+ ions of 0.05 and 0.01 mol%, respectively. These enhancement factors correspond to absolute vector polarizations of 0.27+-0.02% (Nd 0.05 mol%) and 1.4+-0.3% (Nd 0.01 mol%). Although the obtained polarizations are still low, they are acceptable as a first step. The combination scheme of the crystal growth and evaluation of the crystals is found to be effectively applicable for optimizing the amount of Nd3+ ions for improving the performance of the polarized target.
△ Less
Submitted 1 May, 2024; v1 submitted 11 February, 2024;
originally announced February 2024.
-
High sensitivity of a future search for P-odd/T-odd interactions on the 0.75 eV $p$-wave resonance in $\vec{n}+^{139}\vec{\rm La}$ forward transmission determined using pulsed neutron beam
Authors:
R. Nakabe,
C. J. Auton,
S. Endo,
H. Fujioka,
V. Gudkov,
K. Hirota,
I. Ide,
T. Ino,
M. Ishikado,
W. Kambara,
S. Kawamura,
A. Kimura,
M. Kitaguchi,
R. Kobayashi,
T. Okamura,
T. Oku,
T. Okudaira,
M. Okuizumi,
J. G. Otero Munoz,
J. D. Parker,
K. Sakai,
T. Shima,
H. M. Shimizu,
T. Shinohara,
W. M. Snow
, et al. (5 additional authors not shown)
Abstract:
Neutron transmission experiments can offer a new type of highly sensitive search for time-reversal invariance violating (TRIV) effects in nucleon-nucleon interactions via the same enhancement mechanism observed for large parity violating (PV) effects in neutron-induced compound nuclear processes. In these compound processes, the TRIV cross-section is given as the product of the PV cross-section, a…
▽ More
Neutron transmission experiments can offer a new type of highly sensitive search for time-reversal invariance violating (TRIV) effects in nucleon-nucleon interactions via the same enhancement mechanism observed for large parity violating (PV) effects in neutron-induced compound nuclear processes. In these compound processes, the TRIV cross-section is given as the product of the PV cross-section, a spin-factor $κ$, and a ratio of TRIV and PV matrix elements. We determined $κ$ to be $0.59\pm0.05$ for $^{139}$La+$n$ using both $(n, γ)$ spectroscopy and ($\vec{n}+^{139}\vec{\rm La}$) transmission. This result quantifies for the first time the high sensitivity of the $^{139}$La 0.75~eV $p$-wave resonance in a future search for P-odd/T-odd interactions in ($\vec{n}+^{139}\vec{\rm La}$) forward transmission.
△ Less
Submitted 10 December, 2023;
originally announced December 2023.
-
RecipeMeta: Metapath-enhanced Recipe Recommendation on Heterogeneous Recipe Network
Authors:
Jialiang Shi,
Takahiro Komamizu,
Keisuke Doman,
Haruya Kyutoku,
Ichiro Ide
Abstract:
Recipe is a set of instructions that describes how to make food. It can help people from the preparation of ingredients, food cooking process, etc. to prepare the food, and increasingly in demand on the Web. To help users find the vast amount of recipes on the Web, we address the task of recipe recommendation. Due to multiple data types and relationships in a recipe, we can treat it as a heterogen…
▽ More
Recipe is a set of instructions that describes how to make food. It can help people from the preparation of ingredients, food cooking process, etc. to prepare the food, and increasingly in demand on the Web. To help users find the vast amount of recipes on the Web, we address the task of recipe recommendation. Due to multiple data types and relationships in a recipe, we can treat it as a heterogeneous network to describe its information more accurately. To effectively utilize the heterogeneous network, metapath was proposed to describe the higher-level semantic information between two entities by defining a compound path from peer entities. Therefore, we propose a metapath-enhanced recipe recommendation framework, RecipeMeta, that combines GNN (Graph Neural Network)-based representation learning and specific metapath-based information in a recipe to predict User-Recipe pairs for recommendation. Through extensive experiments, we demonstrate that the proposed model, RecipeMeta, outperforms state-of-the-art methods for recipe recommendation.
△ Less
Submitted 24 October, 2023;
originally announced October 2023.
-
Spin dependence in the $p$-wave resonance of ${^{139}\vec{\rm{La}}+\vec{n}}$
Authors:
T. Okudaira,
R. Nakabe,
S. Endo,
H. Fujioka,
V. Gudkov,
I. Ide,
T. Ino,
M. Ishikado,
W. Kambara,
S. Kawamura,
R. Kobayashi,
M. Kitaguchi,
T. Okamura,
T. Oku,
J. G. Otero Munoz,
J. D. Parker,
K. Sakai,
T. Shima,
H. M. Shimizu,
T. Shinohara,
W. M. Snow,
S. Takada,
Y. Tsuchikawa,
R. Takahashi,
S. Takahashi
, et al. (2 additional authors not shown)
Abstract:
We measured the spin dependence in a neutron-induced $p$-wave resonance by using a polarized epithermal neutron beam and a polarized nuclear target. Our study focuses on the 0.75~eV $p$-wave resonance state of $^{139}$La+$n$, where largely enhanced parity violation has been observed. We determined the partial neutron width of the $p$-wave resonance by measuring the spin dependence of the neutron a…
▽ More
We measured the spin dependence in a neutron-induced $p$-wave resonance by using a polarized epithermal neutron beam and a polarized nuclear target. Our study focuses on the 0.75~eV $p$-wave resonance state of $^{139}$La+$n$, where largely enhanced parity violation has been observed. We determined the partial neutron width of the $p$-wave resonance by measuring the spin dependence of the neutron absorption cross section between polarized $^{139}\rm{La}$ and polarized neutrons. Our findings serve as a foundation for the quantitative study of the enhancement effect of the discrete symmetry violations caused by mixing between partial amplitudes in the compound nuclei.
△ Less
Submitted 16 September, 2023;
originally announced September 2023.
-
MVA2023 Small Object Detection Challenge for Spotting Birds: Dataset, Methods, and Results
Authors:
Yuki Kondo,
Norimichi Ukita,
Takayuki Yamaguchi,
Hao-Yu Hou,
Mu-Yi Shen,
Chia-Chi Hsu,
En-Ming Huang,
Yu-Chen Huang,
Yu-Cheng Xia,
Chien-Yao Wang,
Chun-Yi Lee,
Da Huo,
Marc A. Kastner,
Tingwei Liu,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Takahiro Komamizu,
Ichiro Ide,
Yosuke Shinya,
Xinyao Liu,
Guang Liang,
Syusuke Yasui
Abstract:
Small Object Detection (SOD) is an important machine vision topic because (i) a variety of real-world applications require object detection for distant objects and (ii) SOD is a challenging task due to the noisy, blurred, and less-informative image appearances of small objects. This paper proposes a new SOD dataset consisting of 39,070 images including 137,121 bird instances, which is called the S…
▽ More
Small Object Detection (SOD) is an important machine vision topic because (i) a variety of real-world applications require object detection for distant objects and (ii) SOD is a challenging task due to the noisy, blurred, and less-informative image appearances of small objects. This paper proposes a new SOD dataset consisting of 39,070 images including 137,121 bird instances, which is called the Small Object Detection for Spotting Birds (SOD4SB) dataset. The detail of the challenge with the SOD4SB dataset is introduced in this paper. In total, 223 participants joined this challenge. This paper briefly introduces the award-winning methods. The dataset, the baseline code, and the website for evaluation on the public testset are publicly available.
△ Less
Submitted 18 July, 2023;
originally announced July 2023.
-
IPA-CLIP: Integrating Phonetic Priors into Vision and Language Pretraining
Authors:
Chihaya Matsuhira,
Marc A. Kastner,
Takahiro Komamizu,
Takatsugu Hirayama,
Keisuke Doman,
Yasutomo Kawanishi,
Ichiro Ide
Abstract:
Recently, large-scale Vision and Language (V\&L) pretraining has become the standard backbone of many multimedia systems. While it has shown remarkable performance even in unseen situations, it often performs in ways not intuitive to humans. Particularly, they usually do not consider the pronunciation of the input, which humans would utilize to understand language, especially when it comes to unkn…
▽ More
Recently, large-scale Vision and Language (V\&L) pretraining has become the standard backbone of many multimedia systems. While it has shown remarkable performance even in unseen situations, it often performs in ways not intuitive to humans. Particularly, they usually do not consider the pronunciation of the input, which humans would utilize to understand language, especially when it comes to unknown words. Thus, this paper inserts phonetic prior into Contrastive Language-Image Pretraining (CLIP), one of the V\&L pretrained models, to make it consider the pronunciation similarity among its pronunciation inputs. To achieve this, we first propose a phoneme embedding that utilizes the phoneme relationships provided by the International Phonetic Alphabet (IPA) chart as a phonetic prior. Next, by distilling the frozen CLIP text encoder, we train a pronunciation encoder employing the IPA-based embedding. The proposed model named IPA-CLIP comprises this pronunciation encoder and the original CLIP encoders (image and text). Quantitative evaluation reveals that the phoneme distribution on the embedding space represents phonetic relationships more accurately when using the proposed phoneme embedding. Furthermore, in some multimodal retrieval tasks, we confirm that the proposed pronunciation encoder enhances the performance of the text encoder and that the pronunciation encoder handles nonsense words in a more phonetic manner than the text encoder. Finally, qualitative evaluation verifies the correlation between the pronunciation encoder and human perception regarding pronunciation similarity.
△ Less
Submitted 6 March, 2023;
originally announced March 2023.
-
A Novel Approach for Pill-Prescription Matching with GNN Assistance and Contrastive Learning
Authors:
Trung Thanh Nguyen,
Hoang Dang Nguyen,
Thanh Hung Nguyen,
Huy Hieu Pham,
Ichiro Ide,
Phi Le Nguyen
Abstract:
Medication mistaking is one of the risks that can result in unpredictable consequences for patients. To mitigate this risk, we develop an automatic system that correctly identifies pill-prescription from mobile images. Specifically, we define a so-called pill-prescription matching task, which attempts to match the images of the pills taken with the pills' names in the prescription. We then propose…
▽ More
Medication mistaking is one of the risks that can result in unpredictable consequences for patients. To mitigate this risk, we develop an automatic system that correctly identifies pill-prescription from mobile images. Specifically, we define a so-called pill-prescription matching task, which attempts to match the images of the pills taken with the pills' names in the prescription. We then propose PIMA, a novel approach using Graph Neural Network (GNN) and contrastive learning to address the targeted problem. In particular, GNN is used to learn the spatial correlation between the text boxes in the prescription and thereby highlight the text boxes carrying the pill names. In addition, contrastive learning is employed to facilitate the modeling of cross-modal similarity between textual representations of pill names and visual representations of pill images. We conducted extensive experiments and demonstrated that PIMA outperforms baseline models on a real-world dataset of pill and prescription images that we constructed. Specifically, PIMA improves the accuracy from 19.09% to 46.95% compared to other baselines. We believe our work can open up new opportunities to build new clinical applications and improve medication safety and patient care.
△ Less
Submitted 2 September, 2022;
originally announced September 2022.
-
Characterization of electroless nickel-phosphorus plating for ultracold-neutron storage
Authors:
H. Akatsuka,
T. Andalib,
B. Bell,
J. Berean-Dutcher,
N. Bernier,
C. P. Bidinosti,
C. Cude-Woods,
S. A. Currie,
C. A. Davis,
B. Franke,
R. Gaur,
P. Giampa,
S. Hansen-Romu,
M. T. Hassan,
K. Hatanaka,
T. Higuchi,
C. Gibson,
G. Ichikawa,
I. Ide,
S. Imajo,
T. M. Ito,
B. Jamieson,
S. Kawasaki,
M. Kitaguchi,
W. Klassen
, et al. (29 additional authors not shown)
Abstract:
Electroless nickel plating is an established industrial process that provides a robust and relatively low-cost coating suitable for transporting and storing ultracold neutrons (UCN). Using roughness measurements and UCN-storage experiments we characterized UCN guides made from polished aluminum or stainless-steel tubes plated by several vendors. All electroless nickel platings were similarly suite…
▽ More
Electroless nickel plating is an established industrial process that provides a robust and relatively low-cost coating suitable for transporting and storing ultracold neutrons (UCN). Using roughness measurements and UCN-storage experiments we characterized UCN guides made from polished aluminum or stainless-steel tubes plated by several vendors. All electroless nickel platings were similarly suited for UCN storage with an average loss probability per wall bounce of $2.8\cdot10^{-4}$ to $4.1\cdot10^{-4}$ for energies between 90 neV and 190 neV, or a ratio of imaginary to real Fermi potential $η$ of $1.7\cdot10^{-4}$ to $3.3\cdot10^{-4}$. Measurements at different elevations indicate that the energy dependence of UCN losses is well described by the imaginary Fermi potential. Some special considerations are required to avoid an increase in surface roughness during the plating process and hence a reduction in UCN transmission. Increased roughness had only a minor impact on storage properties. Based on these findings we chose a vendor to plate the UCN-production vessel that will contain the superfluid-helium converter for the new TRIUMF UltraCold Advanced Neutron (TUCAN) source, achieving acceptable UCN-storage properties with ${η=3.5(5)\cdot10^{-4}}$.
△ Less
Submitted 7 February, 2023; v1 submitted 10 August, 2022;
originally announced August 2022.
-
Measurement of nuclear spin relaxation time in lanthanum aluminate for development of polarized lanthanum target
Authors:
K. Ishizaki,
H. Hotta,
I. Ide,
M. Iinuma,
T. Iwata,
M. Kitaguchi,
H. Kohri,
D. Miura,
Y. Miyachi,
T. Ohta,
H. M. Shimizu,
H. Yoshikawa,
M. Yosoi
Abstract:
The nuclear spin-lattice relaxation time ($T_1$) of lanthanum and aluminum nuclei in a single crystal of lanthanum aluminate doped with neodymium ions is studied to estimate the feasibility of the dynamically polarized lanthanum target applicable to beam experiments. The application of our interest is the study of fundamental discrete symmetries in the spin optics of epithermal neutrons. This stud…
▽ More
The nuclear spin-lattice relaxation time ($T_1$) of lanthanum and aluminum nuclei in a single crystal of lanthanum aluminate doped with neodymium ions is studied to estimate the feasibility of the dynamically polarized lanthanum target applicable to beam experiments. The application of our interest is the study of fundamental discrete symmetries in the spin optics of epithermal neutrons. This study requires a highly flexible choice of the applied magnetic field for neutron spin control and favors longer $T_1$ under lower magnetic field and at higher temperature. The $T_1$ of $^{139}{\rm La}$ and ${}^{27}{\rm Al}$ was measured under magnetic fields of $0.5$-$2.5$ T and at temperatures of $0.1$-$1.5$ K and found widely distributed up to 100 h. The result suggests that the $T_1$ can be as long as $T_1 \sim$ 1 h at $0.1$ K with a magnetic field of $0.1$ T, which partially fulfills the requirement of the neutron beam experiment. Possible improvements to achieve a longer $T_1$ are discussed.
△ Less
Submitted 16 September, 2021; v1 submitted 11 May, 2021;
originally announced May 2021.
-
Off-resonant coherent electron transport over three nanometers in multi-heme protein bioelectronic junctions
Authors:
Zdenek Futera,
Ichiro Ide,
Ben Kayser,
Kavita Garg,
Xiuyun Jiang,
Jessica H. van Wonderen,
Julea N. Butt,
Hisao Ishii,
Israel Pecht,
Mordechai Sheves,
David Cahen,
Jochen Blumberger
Abstract:
Multi-heme cytochromes (MHC) are fascinating proteins used by bacterial organisms to shuttle electrons within and between their cells. When placed in a solid state electronic junction, they support temperature-independent currents over several nanometers that are three orders of magnitude higher compared to other redox proteins of comparable size. To gain microscopic insight into their astonishing…
▽ More
Multi-heme cytochromes (MHC) are fascinating proteins used by bacterial organisms to shuttle electrons within and between their cells. When placed in a solid state electronic junction, they support temperature-independent currents over several nanometers that are three orders of magnitude higher compared to other redox proteins of comparable size. To gain microscopic insight into their astonishingly high conductivities, we present herein the first current-voltage calculations of its kind, for a MHC sandwiched between two Au(111) electrodes, complemented by photo-emission spectroscopy experiments. We find that conduction proceeds via off-resonant coherent tunneling mediated by a large number of protein valence-band orbitals that are strongly delocalized over heme and protein residues, effectively "gating" the current between the two electrodes. This picture is profoundly different from the dominant electron hop** mechanism supported by the same protein in aqueous solution. Our results imply that current output in MHC junctions could be even further increased in the resonant regime, e.g. by application of a gate voltage, making these proteins extremely interesting for next-generation bionanoelectronic devices.
△ Less
Submitted 20 July, 2020;
originally announced July 2020.
-
Monitoring the build-up of hydrogen polarization for polarized Hydrogen-Deuteride (HD) targets with NMR at 17 Tesla
Authors:
T. Ohta,
M. Fujiwara,
T. Hotta,
I. Ide,
K. Ishizaki,
H. Kohri,
Y. Yanai,
M. Yosoi
Abstract:
We report on the frozen-spin polarized hydrogen--deuteride (HD) targets for photoproduction experiments at SPring-8/LEPS. Pure HD gas with a small amount of ortho-H2 (~0.1%) was liquefied and solidified by liquid helium. The temperature of the produced solid HD was reduced to about 30 mK with a dilution refrigerator. A magnetic field (17 T) was applied to the HD to grow the polarization with the s…
▽ More
We report on the frozen-spin polarized hydrogen--deuteride (HD) targets for photoproduction experiments at SPring-8/LEPS. Pure HD gas with a small amount of ortho-H2 (~0.1%) was liquefied and solidified by liquid helium. The temperature of the produced solid HD was reduced to about 30 mK with a dilution refrigerator. A magnetic field (17 T) was applied to the HD to grow the polarization with the static method. After the aging of the HD at low temperatures in the presence of a high-magnetic field strength for 3 months, the polarization froze. Almost all ortho-H2 molecules were converted to para-H2 molecules that exhibited weak spin interactions with the HD. If the concentration of the ortho-H2 was reduced at the beginning of the aging process, the aging time can be shortened. We have developed a new nuclear magnetic resonance (NMR) system to measure the relaxation times (T1) of the 1H and 2H nuclei with two frequency sweeps at the respective frequencies of 726 and 111 MHz, and succeeded in the monitoring of the polarization build-up at decreasing temperatures from 600 to 30 mK at 17 T. This technique enables us to optimize the concentration of the ortho-H2 and to efficiently polarize the HD target within a shortened aging time.
△ Less
Submitted 10 September, 2020; v1 submitted 17 February, 2020;
originally announced February 2020.
