-
Inkjet printed intelligent reflecting surface (IRS) for indoor applications
Authors:
Kairi Takimoto,
Kazutomo Nakamura,
Peter Njogu,
Kota Suzuki,
Masato Sugimoto,
Ashif Fathnan,
Takashi Kondo,
Masayuki Mori,
Daisuke Anzai,
Hiroki Wakatsuchi
Abstract:
A passive, low-cost, paper-based intelligent reflecting surface (IRS) is designed to reflect a signal in a desired direction to overcome non-line-of-sight scenarios in indoor environments. The IRS is fabricated using conductive silver ink printed on a paper with a specific nanoparticle arrangement, yielding a cost effective paper-based IRS that can easily be mass-produced. Full-wave numerical simu…
▽ More
A passive, low-cost, paper-based intelligent reflecting surface (IRS) is designed to reflect a signal in a desired direction to overcome non-line-of-sight scenarios in indoor environments. The IRS is fabricated using conductive silver ink printed on a paper with a specific nanoparticle arrangement, yielding a cost effective paper-based IRS that can easily be mass-produced. Full-wave numerical simulation results were consistent with measurements results, demonstrating the IRS's ability to reflect incident wave into a desired nonspecular direction based on the inkjet-printed design and materials.
△ Less
Submitted 14 January, 2024;
originally announced January 2024.
-
Realistic Endoscopic Image Generation Method Using Virtual-to-real Image-domain Translation
Authors:
Masahiro Oda,
Kiyohito Tanaka,
Hirotsugu Takabatake,
Masaki Mori,
Hiroshi Natori,
Kensaku Mori
Abstract:
This paper proposes a realistic image generation method for visualization in endoscopic simulation systems. Endoscopic diagnosis and treatment are performed in many hospitals. To reduce complications related to endoscope insertions, endoscopic simulation systems are used for training or rehearsal of endoscope insertions. However, current simulation systems generate non-realistic virtual endoscopic…
▽ More
This paper proposes a realistic image generation method for visualization in endoscopic simulation systems. Endoscopic diagnosis and treatment are performed in many hospitals. To reduce complications related to endoscope insertions, endoscopic simulation systems are used for training or rehearsal of endoscope insertions. However, current simulation systems generate non-realistic virtual endoscopic images. To improve the value of the simulation systems, improvement of reality of their generated images is necessary. We propose a realistic image generation method for endoscopic simulation systems. Virtual endoscopic images are generated by using a volume rendering method from a CT volume of a patient. We improve the reality of the virtual endoscopic images using a virtual-to-real image-domain translation technique. The image-domain translator is implemented as a fully convolutional network (FCN). We train the FCN by minimizing a cycle consistency loss function. The FCN is trained using unpaired virtual and real endoscopic images. To obtain high quality image-domain translation results, we perform an image cleansing to the real endoscopic image set. We tested to use the shallow U-Net, U-Net, deep U-Net, and U-Net having residual units as the image-domain translator. The deep U-Net and U-Net having residual units generated quite realistic images.
△ Less
Submitted 13 January, 2022;
originally announced January 2022.
-
Depth Estimation from Single-shot Monocular Endoscope Image Using Image Domain Adaptation And Edge-Aware Depth Estimation
Authors:
Masahiro Oda,
Hayato Itoh,
Kiyohito Tanaka,
Hirotsugu Takabatake,
Masaki Mori,
Hiroshi Natori,
Kensaku Mori
Abstract:
We propose a depth estimation method from a single-shot monocular endoscopic image using Lambertian surface translation by domain adaptation and depth estimation using multi-scale edge loss. We employ a two-step estimation process including Lambertian surface translation from unpaired data and depth estimation. The texture and specular reflection on the surface of an organ reduce the accuracy of d…
▽ More
We propose a depth estimation method from a single-shot monocular endoscopic image using Lambertian surface translation by domain adaptation and depth estimation using multi-scale edge loss. We employ a two-step estimation process including Lambertian surface translation from unpaired data and depth estimation. The texture and specular reflection on the surface of an organ reduce the accuracy of depth estimations. We apply Lambertian surface translation to an endoscopic image to remove these texture and reflections. Then, we estimate the depth by using a fully convolutional network (FCN). During the training of the FCN, improvement of the object edge similarity between an estimated image and a ground truth depth image is important for getting better results. We introduced a muti-scale edge loss function to improve the accuracy of depth estimation. We quantitatively evaluated the proposed method using real colonoscopic images. The estimated depth values were proportional to the real depth values. Furthermore, we applied the estimated depth images to automated anatomical location identification of colonoscopic images using a convolutional neural network. The identification accuracy of the network improved from 69.2% to 74.1% by using the estimated depth images.
△ Less
Submitted 12 January, 2022;
originally announced January 2022.
-
Micro CT Image-Assisted Cross Modality Super-Resolution of Clinical CT Images Utilizing Synthesized Training Dataset
Authors:
Tong Zheng,
Hirohisa Oda,
Masahiro Oda,
Shota Nakamura,
Masaki Mori,
Hirotsugu Takabatake,
Hiroshi Natori,
Kensaku Mori
Abstract:
This paper proposes a novel, unsupervised super-resolution (SR) approach for performing the SR of a clinical CT into the resolution level of a micro CT ($μ$CT). The precise non-invasive diagnosis of lung cancer typically utilizes clinical CT data. Due to the resolution limitations of clinical CT (about $0.5 \times 0.5 \times 0.5$ mm$^3$), it is difficult to obtain enough pathological information s…
▽ More
This paper proposes a novel, unsupervised super-resolution (SR) approach for performing the SR of a clinical CT into the resolution level of a micro CT ($μ$CT). The precise non-invasive diagnosis of lung cancer typically utilizes clinical CT data. Due to the resolution limitations of clinical CT (about $0.5 \times 0.5 \times 0.5$ mm$^3$), it is difficult to obtain enough pathological information such as the invasion area at alveoli level. On the other hand, $μ$CT scanning allows the acquisition of volumes of lung specimens with much higher resolution ($50 \times 50 \times 50 μ{\rm m}^3$ or higher). Thus, super-resolution of clinical CT volume may be helpful for diagnosis of lung cancer. Typical SR methods require aligned pairs of low-resolution (LR) and high-resolution (HR) images for training. Unfortunately, obtaining paired clinical CT and $μ$CT volumes of human lung tissues is infeasible. Unsupervised SR methods are required that do not need paired LR and HR images. In this paper, we create corresponding clinical CT-$μ$CT pairs by simulating clinical CT images from $μ$CT images by modified CycleGAN. After this, we use simulated clinical CT-$μ$CT image pairs to train an SR network based on SRGAN. Finally, we use the trained SR network to perform SR of the clinical CT images. We compare our proposed method with another unsupervised SR method for clinical CT images named SR-CycleGAN. Experimental results demonstrate that the proposed method can successfully perform SR of clinical CT images of lung cancer patients with $μ$CT level resolution, and quantitatively and qualitatively outperformed conventional method (SR-CycleGAN), improving the SSIM (structure similarity) form 0.40 to 0.51.
△ Less
Submitted 20 October, 2020;
originally announced October 2020.
-
Super-resolution of clinical CT volumes with modified CycleGAN using micro CT volumes
Authors:
Tong ZHENG,
Hirohisa ODA,
Takayasu MORIYA,
Takaaki SUGINO,
Shota NAKAMURA,
Masahiro ODA,
Masaki MORI,
Hirotsugu TAKABATAKE,
Hiroshi NATORI,
Kensaku MORI
Abstract:
This paper presents a super-resolution (SR) method with unpaired training dataset of clinical CT and micro CT volumes. For obtaining very detailed information such as cancer invasion from pre-operative clinical CT volumes of lung cancer patients, SR of clinical CT volumes to $\m$}CT level is desired. While most SR methods require paired low- and high- resolution images for training, it is infeasib…
▽ More
This paper presents a super-resolution (SR) method with unpaired training dataset of clinical CT and micro CT volumes. For obtaining very detailed information such as cancer invasion from pre-operative clinical CT volumes of lung cancer patients, SR of clinical CT volumes to $\m$}CT level is desired. While most SR methods require paired low- and high- resolution images for training, it is infeasible to obtain paired clinical CT and μCT volumes. We propose a SR approach based on CycleGAN, which could perform SR on clinical CT into $μ$CT level. We proposed new loss functions to keep cycle consistency, while training without paired volumes. Experimental results demonstrated that our proposed method successfully performed SR of clinical CT volume of lung cancer patients into $μ$CT level.
△ Less
Submitted 7 April, 2020;
originally announced April 2020.
-
Multi-modality super-resolution loss for GAN-based super-resolution of clinical CT images using micro CT image database
Authors:
Tong Zheng,
Hirohisa Oda,
Takayasu Moriya,
Shota Nakamura,
Masahiro Oda,
Masaki Mori,
Horitsugu Takabatake,
Hiroshi Natori,
Kensaku Mori
Abstract:
This paper newly introduces multi-modality loss function for GAN-based super-resolution that can maintain image structure and intensity on unpaired training dataset of clinical CT and micro CT volumes. Precise non-invasive diagnosis of lung cancer mainly utilizes 3D multidetector computed-tomography (CT) data. On the other hand, we can take micro CT images of resected lung specimen in 50 micro met…
▽ More
This paper newly introduces multi-modality loss function for GAN-based super-resolution that can maintain image structure and intensity on unpaired training dataset of clinical CT and micro CT volumes. Precise non-invasive diagnosis of lung cancer mainly utilizes 3D multidetector computed-tomography (CT) data. On the other hand, we can take micro CT images of resected lung specimen in 50 micro meter or higher resolution. However, micro CT scanning cannot be applied to living human imaging. For obtaining highly detailed information such as cancer invasion area from pre-operative clinical CT volumes of lung cancer patients, super-resolution (SR) of clinical CT volumes to $μ$CT level might be one of substitutive solutions. While most SR methods require paired low- and high-resolution images for training, it is infeasible to obtain precisely paired clinical CT and micro CT volumes. We aim to propose unpaired SR approaches for clincial CT using micro CT images based on unpaired image translation methods such as CycleGAN or UNIT. Since clinical CT and micro CT are very different in structure and intensity, direct application of GAN-based unpaired image translation methods in super-resolution tends to generate arbitrary images. Aiming to solve this problem, we propose new loss function called multi-modality loss function to maintain the similarity of input images and corresponding output images in super-resolution task. Experimental results demonstrated that the newly proposed loss function made CycleGAN and UNIT to successfully perform SR of clinical CT images of lung cancer patients into micro CT level resolution, while original CycleGAN and UNIT failed in super-resolution.
△ Less
Submitted 7 April, 2020; v1 submitted 30 December, 2019;
originally announced December 2019.