Transformer based Endmember Fusion with Spatial Context for Hyperspectral Unmixing
Authors:
H. M. K. D. Wickramathilaka,
R. M. K. L. Ratnayake,
D. M. U. P. Sumanasekara,
G. M. R. I. Godaliyadda,
M. P. B. Ekanayake,
H. M. V. R. Herath
Abstract:
In recent years, transformer-based deep learning networks have gained popularity in Hyperspectral (HS) unmixing applications due to their superior performance. The attention mechanism within transformers facilitates input-dependent weighting and enhances contextual awareness during training. Drawing inspiration from this, we propose a novel attention based Hyperspectral Unmixing algorithm called T…
▽ More
In recent years, transformer-based deep learning networks have gained popularity in Hyperspectral (HS) unmixing applications due to their superior performance. The attention mechanism within transformers facilitates input-dependent weighting and enhances contextual awareness during training. Drawing inspiration from this, we propose a novel attention based Hyperspectral Unmixing algorithm called Transformer based Endmember Fusion with Spatial Context for Hyperspectral Unmixing (FusionNet). This algorithm can effectively fuse endmember signatures obtained from different endmember extraction algorithms, as opposed to the classical HS unmixing approaches that rely on a single Endmember Extraction Algorithm (EEA). The FusionNet incorporates an Approximation Network (AN), introducing contextual awareness into abundance prediction by considering neighborhood pixels. Unlike Convolutional Neural Networks (CNNs), which are constrained by specific kernel shapes, the Fusion network offers flexibility in choosing any arbitrary configuration of the neighborhood. We conducted a comparative analysis between the FusionNet algorithm and state-of-the-art algorithms using two popular datasets. Remarkably, FusionNet outperformed other algorithms, achieving the lowest Root Mean Square Error (RMSE) for abundance predictions and competitive Spectral Angle Distance (SAD) for signatures associated with each endmember for both datasets.
△ Less
Submitted 19 February, 2024; v1 submitted 6 February, 2024;
originally announced February 2024.
Morphological Profiling for Drug Discovery in the Era of Deep Learning
Authors:
Qiaosi Tang,
Ranjala Ratnayake,
Gustavo Seabra,
Zhe Jiang,
Ruogu Fang,
Lina Cui,
Yousong Ding,
Tamer Kahveci,
Jiang Bian,
Chenglong Li,
Hendrik Luesch,
Yanjun Li
Abstract:
Morphological profiling is a valuable tool in phenotypic drug discovery. The advent of high-throughput automated imaging has enabled the capturing of a wide range of morphological features of cells or organisms in response to perturbations at the single-cell resolution. Concurrently, significant advances in machine learning and deep learning, especially in computer vision, have led to substantial…
▽ More
Morphological profiling is a valuable tool in phenotypic drug discovery. The advent of high-throughput automated imaging has enabled the capturing of a wide range of morphological features of cells or organisms in response to perturbations at the single-cell resolution. Concurrently, significant advances in machine learning and deep learning, especially in computer vision, have led to substantial improvements in analyzing large-scale high-content images at high-throughput. These efforts have facilitated understanding of compound mechanism-of-action (MOA), drug repurposing, characterization of cell morphodynamics under perturbation, and ultimately contributing to the development of novel therapeutics. In this review, we provide a comprehensive overview of the recent advances in the field of morphological profiling. We summarize the image profiling analysis workflow, survey a broad spectrum of analysis strategies encompassing feature engineering- and deep learning-based approaches, and introduce publicly available benchmark datasets. We place a particular emphasis on the application of deep learning in this pipeline, covering cell segmentation, image representation learning, and multimodal learning. Additionally, we illuminate the application of morphological profiling in phenotypic drug discovery and highlight potential challenges and opportunities in this field.
△ Less
Submitted 15 January, 2024; v1 submitted 13 December, 2023;
originally announced December 2023.
