-
InstructProtein: Aligning Human and Protein Language via Knowledge Instruction
Authors:
Zeyuan Wang,
Qiang Zhang,
Keyan Ding,
Ming Qin,
Xiang Zhuang,
Xiaotong Li,
Huajun Chen
Abstract:
Large Language Models (LLMs) have revolutionized the field of natural language processing, but they fall short in comprehending biological sequences such as proteins. To address this challenge, we propose InstructProtein, an innovative LLM that possesses bidirectional generation capabilities in both human and protein languages: (i) taking a protein sequence as input to predict its textual function…
▽ More
Large Language Models (LLMs) have revolutionized the field of natural language processing, but they fall short in comprehending biological sequences such as proteins. To address this challenge, we propose InstructProtein, an innovative LLM that possesses bidirectional generation capabilities in both human and protein languages: (i) taking a protein sequence as input to predict its textual function description and (ii) using natural language to prompt protein sequence generation. To achieve this, we first pre-train an LLM on both protein and natural language corpora, enabling it to comprehend individual languages. Then supervised instruction tuning is employed to facilitate the alignment of these two distinct languages. Herein, we introduce a knowledge graph-based instruction generation framework to construct a high-quality instruction dataset, addressing annotation imbalance and instruction deficits in existing protein-text corpus. In particular, the instructions inherit the structural relations between proteins and function annotations in knowledge graphs, which empowers our model to engage in the causal modeling of protein functions, akin to the chain-of-thought processes in natural languages. Extensive experiments on bidirectional protein-text generation tasks show that InstructProtein outperforms state-of-the-art LLMs by large margins. Moreover, InstructProtein serves as a pioneering step towards text-based protein function prediction and sequence design, effectively bridging the gap between protein and human language understanding.
△ Less
Submitted 4 October, 2023;
originally announced October 2023.
-
Graph Sampling-based Meta-Learning for Molecular Property Prediction
Authors:
Xiang Zhuang,
Qiang Zhang,
Bin Wu,
Keyan Ding,
Yin Fang,
Huajun Chen
Abstract:
Molecular property is usually observed with a limited number of samples, and researchers have considered property prediction as a few-shot problem. One important fact that has been ignored by prior works is that each molecule can be recorded with several different properties simultaneously. To effectively utilize many-to-many correlations of molecules and properties, we propose a Graph Sampling-ba…
▽ More
Molecular property is usually observed with a limited number of samples, and researchers have considered property prediction as a few-shot problem. One important fact that has been ignored by prior works is that each molecule can be recorded with several different properties simultaneously. To effectively utilize many-to-many correlations of molecules and properties, we propose a Graph Sampling-based Meta-learning (GS-Meta) framework for few-shot molecular property prediction. First, we construct a Molecule-Property relation Graph (MPG): molecule and properties are nodes, while property labels decide edges. Then, to utilize the topological information of MPG, we reformulate an episode in meta-learning as a subgraph of the MPG, containing a target property node, molecule nodes, and auxiliary property nodes. Third, as episodes in the form of subgraphs are no longer independent of each other, we propose to schedule the subgraph sampling process with a contrastive loss function, which considers the consistency and discrimination of subgraphs. Extensive experiments on 5 commonly-used benchmarks show GS-Meta consistently outperforms state-of-the-art methods by 5.71%-6.93% in ROC-AUC and verify the effectiveness of each proposed module. Our code is available at https://github.com/HICAI-ZJU/GS-Meta.
△ Less
Submitted 29 June, 2023;
originally announced June 2023.
-
Molecular Contrastive Learning with Chemical Element Knowledge Graph
Authors:
Yin Fang,
Qiang Zhang,
Haihong Yang,
Xiang Zhuang,
Shumin Deng,
Wen Zhang,
Ming Qin,
Zhuo Chen,
Xiaohui Fan,
Huajun Chen
Abstract:
Molecular representation learning contributes to multiple downstream tasks such as molecular property prediction and drug design. To properly represent molecules, graph contrastive learning is a promising paradigm as it utilizes self-supervision signals and has no requirements for human annotations. However, prior works fail to incorporate fundamental domain knowledge into graph semantics and thus…
▽ More
Molecular representation learning contributes to multiple downstream tasks such as molecular property prediction and drug design. To properly represent molecules, graph contrastive learning is a promising paradigm as it utilizes self-supervision signals and has no requirements for human annotations. However, prior works fail to incorporate fundamental domain knowledge into graph semantics and thus ignore the correlations between atoms that have common attributes but are not directly connected by bonds. To address these issues, we construct a Chemical Element Knowledge Graph (KG) to summarize microscopic associations between elements and propose a novel Knowledge-enhanced Contrastive Learning (KCL) framework for molecular representation learning. KCL framework consists of three modules. The first module, knowledge-guided graph augmentation, augments the original molecular graph based on the Chemical Element KG. The second module, knowledge-aware graph representation, extracts molecular representations with a common graph encoder for the original molecular graph and a Knowledge-aware Message Passing Neural Network (KMPNN) to encode complex information in the augmented molecular graph. The final module is a contrastive objective, where we maximize agreement between these two views of molecular graphs. Extensive experiments demonstrated that KCL obtained superior performances against state-of-the-art baselines on eight molecular datasets. Visualization experiments properly interpret what KCL has learned from atoms and attributes in the augmented molecular graphs. Our codes and data are available at https://github.com/ZJU-Fangyin/KCL.
△ Less
Submitted 10 March, 2022; v1 submitted 1 December, 2021;
originally announced December 2021.
-
Knowledge-aware Contrastive Molecular Graph Learning
Authors:
Yin Fang,
Haihong Yang,
Xiang Zhuang,
Xin Shao,
Xiaohui Fan,
Huajun Chen
Abstract:
Leveraging domain knowledge including fingerprints and functional groups in molecular representation learning is crucial for chemical property prediction and drug discovery. When modeling the relation between graph structure and molecular properties implicitly, existing works can hardly capture structural or property changes and complex structure, with much smaller atom vocabulary and highly frequ…
▽ More
Leveraging domain knowledge including fingerprints and functional groups in molecular representation learning is crucial for chemical property prediction and drug discovery. When modeling the relation between graph structure and molecular properties implicitly, existing works can hardly capture structural or property changes and complex structure, with much smaller atom vocabulary and highly frequent atoms. In this paper, we propose the Contrastive Knowledge-aware GNN (CKGNN) for self-supervised molecular representation learning to fuse domain knowledge into molecular graph representation. We explicitly encode domain knowledge via knowledge-aware molecular encoder under the contrastive learning framework, ensuring that the generated molecular embeddings equipped with chemical domain knowledge to distinguish molecules with similar chemical formula but dissimilar functions. Extensive experiments on 8 public datasets demonstrate the effectiveness of our model with a 6\% absolute improvement on average against strong competitors. Ablation study and further investigation also verify the best of both worlds: incorporation of chemical domain knowledge into self-supervised learning.
△ Less
Submitted 24 March, 2021;
originally announced March 2021.
-
A Fully-Automatic Framework for Parkinson's Disease Diagnosis by Multi-Modality Images
Authors:
Jiahang Xu,
Fangyang Jiao,
Yechong Huang,
Xinzhe Luo,
Qian Xu,
Ling Li,
Xueling Liu,
Chuantao Zuo,
** Wu,
Xiahai Zhuang
Abstract:
Background: Parkinson's disease (PD) is a prevalent long-term neurodegenerative disease. Though the diagnostic criteria of PD are relatively well defined, the current medical imaging diagnostic procedures are expertise-demanding, and thus call for a higher-integrated AI-based diagnostic algorithm. Methods: In this paper, we proposed an automatic, end-to-end, multi-modality diagnosis framework, inc…
▽ More
Background: Parkinson's disease (PD) is a prevalent long-term neurodegenerative disease. Though the diagnostic criteria of PD are relatively well defined, the current medical imaging diagnostic procedures are expertise-demanding, and thus call for a higher-integrated AI-based diagnostic algorithm. Methods: In this paper, we proposed an automatic, end-to-end, multi-modality diagnosis framework, including segmentation, registration, feature generation and machine learning, to process the information of the striatum for the diagnosis of PD. Multiple modalities, including T1- weighted MRI and 11C-CFT PET, were used in the proposed framework. The reliability of this framework was then validated on a dataset from the PET center of Huashan Hospital, as the dataset contains paired T1-MRI and CFT-PET images of 18 Normal (NL) subjects and 49 PD subjects. Results: We obtained an accuracy of 100% for the PD/NL classification task, besides, we conducted several comparative experiments to validate the diagnosis ability of our framework. Conclusion: Through experiment we illustrate that (1) automatic segmentation has the same classification effect as the manual segmentation, (2) the multi-modality images generates a better prediction than single modality images, and (3) volume feature is shown to be irrelevant to PD diagnosis.
△ Less
Submitted 26 February, 2019;
originally announced February 2019.
-
The Human Cell Atlas White Paper
Authors:
Aviv Regev,
Sarah Teichmann,
Orit Rozenblatt-Rosen,
Michael Stubbington,
Kristin Ardlie,
Ido Amit,
Paola Arlotta,
Gary Bader,
Christophe Benoist,
Moshe Biton,
Bernd Bodenmiller,
Benoit Bruneau,
Peter Campbell,
Mary Carmichael,
Piero Carninci,
Leslie Castelo-Soccio,
Menna Clatworthy,
Hans Clevers,
Christian Conrad,
Roland Eils,
Jeremy Freeman,
Lars Fugger,
Berthold Goettgens,
Daniel Graham,
Anna Greka
, et al. (56 additional authors not shown)
Abstract:
The Human Cell Atlas (HCA) will be made up of comprehensive reference maps of all human cells - the fundamental units of life - as a basis for understanding fundamental human biological processes and diagnosing, monitoring, and treating disease. It will help scientists understand how genetic variants impact disease risk, define drug toxicities, discover better therapies, and advance regenerative m…
▽ More
The Human Cell Atlas (HCA) will be made up of comprehensive reference maps of all human cells - the fundamental units of life - as a basis for understanding fundamental human biological processes and diagnosing, monitoring, and treating disease. It will help scientists understand how genetic variants impact disease risk, define drug toxicities, discover better therapies, and advance regenerative medicine. A resource of such ambition and scale should be built in stages, increasing in size, breadth, and resolution as technologies develop and understanding deepens. We will therefore pursue Phase 1 as a suite of flagship projects in key tissues, systems, and organs. We will bring together experts in biology, medicine, genomics, technology development and computation (including data analysis, software engineering, and visualization). We will also need standardized experimental and computational methods that will allow us to compare diverse cell and tissue types - and samples across human communities - in consistent ways, ensuring that the resulting resource is truly global.
This document, the first version of the HCA White Paper, was written by experts in the field with feedback and suggestions from the HCA community, gathered during recent international meetings. The White Paper, released at the close of this yearlong planning process, will be a living document that evolves as the HCA community provides additional feedback, as technological and computational advances are made, and as lessons are learned during the construction of the atlas.
△ Less
Submitted 11 October, 2018;
originally announced October 2018.
-
Short-range spectroscopic ruler based on a single-molecule optical switch
Authors:
Mark Bates,
Timothy R. Blosser,
Xiaowei Zhuang
Abstract:
We demonstrate a novel all-optical switch consisting of two molecules: a primary fluorophore that can be switched between a fluorescent and a dark state by light of different wavelengths, and a secondary chromophore that facilitates switching. The interaction between the two molecules exhibits a distance dependence much steeper than that of Forster resonance energy transfer. This enables the swi…
▽ More
We demonstrate a novel all-optical switch consisting of two molecules: a primary fluorophore that can be switched between a fluorescent and a dark state by light of different wavelengths, and a secondary chromophore that facilitates switching. The interaction between the two molecules exhibits a distance dependence much steeper than that of Forster resonance energy transfer. This enables the switch to act as a ruler with the capability to probe distances difficult to access by other spectroscopic methods, thus presenting a new tool for the study of biomolecules at the single-molecule level.
△ Less
Submitted 14 February, 2005;
originally announced February 2005.
