-
Reinforcement Learning Approach for Integrating Compressed Contexts into Knowledge Graphs
Authors:
Ngoc Quach,
Qi Wang,
Zijun Gao,
Qifeng Sun,
Bo Guan,
Lillian Floyd
Abstract:
The widespread use of knowledge graphs in various fields has brought about a challenge in effectively integrating and updating information within them. When it comes to incorporating contexts, conventional methods often rely on rules or basic machine learning models, which may not fully grasp the complexity and fluidity of context information. This research suggests an approach based on reinforcem…
▽ More
The widespread use of knowledge graphs in various fields has brought about a challenge in effectively integrating and updating information within them. When it comes to incorporating contexts, conventional methods often rely on rules or basic machine learning models, which may not fully grasp the complexity and fluidity of context information. This research suggests an approach based on reinforcement learning (RL), specifically utilizing Deep Q Networks (DQN) to enhance the process of integrating contexts into knowledge graphs. By considering the state of the knowledge graph as environment states defining actions as operations for integrating contexts and using a reward function to gauge the improvement in knowledge graph quality post-integration, this method aims to automatically develop strategies for optimal context integration. Our DQN model utilizes networks as function approximators, continually updating Q values to estimate the action value function, thus enabling effective integration of intricate and dynamic context information. Initial experimental findings show that our RL method outperforms techniques in achieving precise context integration across various standard knowledge graph datasets, highlighting the potential and effectiveness of reinforcement learning in enhancing and managing knowledge graphs.
△ Less
Submitted 18 April, 2024;
originally announced April 2024.
-
Adapting LLMs for Efficient Context Processing through Soft Prompt Compression
Authors:
Cangqing Wang,
Yutian Yang,
Ruisi Li,
Dan Sun,
Ruicong Cai,
Yuzhu Zhang,
Chengqian Fu,
Lillian Floyd
Abstract:
The rapid advancement of Large Language Models (LLMs) has inaugurated a transformative epoch in natural language processing, fostering unprecedented proficiency in text generation, comprehension, and contextual scrutiny. Nevertheless, effectively handling extensive contexts, crucial for myriad applications, poses a formidable obstacle owing to the intrinsic constraints of the models' context windo…
▽ More
The rapid advancement of Large Language Models (LLMs) has inaugurated a transformative epoch in natural language processing, fostering unprecedented proficiency in text generation, comprehension, and contextual scrutiny. Nevertheless, effectively handling extensive contexts, crucial for myriad applications, poses a formidable obstacle owing to the intrinsic constraints of the models' context window sizes and the computational burdens entailed by their operations. This investigation presents an innovative framework that strategically tailors LLMs for streamlined context processing by harnessing the synergies among natural language summarization, soft prompt compression, and augmented utility preservation mechanisms. Our methodology, dubbed SoftPromptComp, amalgamates natural language prompts extracted from summarization methodologies with dynamically generated soft prompts to forge a concise yet semantically robust depiction of protracted contexts. This depiction undergoes further refinement via a weighting mechanism optimizing information retention and utility for subsequent tasks. We substantiate that our framework markedly diminishes computational overhead and enhances LLMs' efficacy across various benchmarks, while upholding or even augmenting the caliber of the produced content. By amalgamating soft prompt compression with sophisticated summarization, SoftPromptComp confronts the dual challenges of managing lengthy contexts and ensuring model scalability. Our findings point towards a propitious trajectory for augmenting LLMs' applicability and efficiency, rendering them more versatile and pragmatic for real-world applications. This research enriches the ongoing discourse on optimizing language models, providing insights into the potency of soft prompts and summarization techniques as pivotal instruments for the forthcoming generation of NLP solutions.
△ Less
Submitted 18 April, 2024; v1 submitted 7 April, 2024;
originally announced April 2024.
-
High-Q, low index-contrast polymeric photonic crystal nanobeam cavities
Authors:
Qimin Quan,
Ian B. Burgess,
Sindy K. Y. Tang,
Daniel L. Floyd,
Marko Loncar
Abstract:
We present the design, fabrication and characterization of high-\emph{Q} (\emph{Q}=36,000) polymeric photonic crystal nanobeam cavities made of two polymers that have an ultra-low index contrast (ratio=1.15) and observed thermo-optical bistability at hundred microwatt power level. Due to the extended evanescent field and small mode volumes, polymeric nanobeam cavities are ideal platform for ultra-…
▽ More
We present the design, fabrication and characterization of high-\emph{Q} (\emph{Q}=36,000) polymeric photonic crystal nanobeam cavities made of two polymers that have an ultra-low index contrast (ratio=1.15) and observed thermo-optical bistability at hundred microwatt power level. Due to the extended evanescent field and small mode volumes, polymeric nanobeam cavities are ideal platform for ultra-sensitive biochemical sensing. We demonstrate that these sensors have figures of merit (FOM=9190) two orders of magnitude greater than surface plasmon resonance based sensors, and outperform the commercial Biacore$^{\mathrm{TM}}$ sensors. The demonstration of high-Q cavity in low-index-contrast polymers can open up versatile applications using a broad range of functional and flexible polymeric materials.
△ Less
Submitted 12 August, 2011;
originally announced August 2011.
-
POLAR Investigation of the Sun - POLARIS
Authors:
T. Appourchaux,
P. Liewer,
M. Watt,
D. Alexander,
V. Andretta,
F. Auchere,
P. D'Arrigo,
J. Ayon,
T. Corbard,
S. Fineschi,
W. Finsterle,
L. Floyd,
G. Garbe,
L. Gizon,
D. Hassler,
L. Harra,
A. Kosovichev,
J. Leibacher,
M. Leipold,
N. Murphy,
M. Maksimovic,
V. Martinez-Pillet,
B. S. A. Matthews,
R. Mewaldt,
D. Moses
, et al. (12 additional authors not shown)
Abstract:
The POLAR Investigation of the Sun (POLARIS) mission uses a combination of a gravity assist and solar sail propulsion to place a spacecraft in a 0.48 AU circular orbit around the Sun with an inclination of 75 degrees with respect to solar equator. This challenging orbit is made possible by the challenging development of solar sail propulsion. This first extended view of the high-latitude regions…
▽ More
The POLAR Investigation of the Sun (POLARIS) mission uses a combination of a gravity assist and solar sail propulsion to place a spacecraft in a 0.48 AU circular orbit around the Sun with an inclination of 75 degrees with respect to solar equator. This challenging orbit is made possible by the challenging development of solar sail propulsion. This first extended view of the high-latitude regions of the Sun will enable crucial observations not possible from the ecliptic viewpoint or from Solar Orbiter. While Solar Orbiter would give the first glimpse of the high latitude magnetic field and flows to probe the solar dynamo, it does not have sufficient viewing of the polar regions to achieve POLARIS' primary objective : determining the relation between the magnetism and dynamics of the Sun's polar regions and the solar cycle.
△ Less
Submitted 23 June, 2008; v1 submitted 28 May, 2008;
originally announced May 2008.
