FACTS About Building Retrieval Augmented Generation-based Chatbots
Authors:
Rama Akkiraju,
Anbang Xu,
Deepak Bora,
Tan Yu,
Lu An,
Vishal Seth,
Aaditya Shukla,
Pritam Gundecha,
Hridhay Mehta,
Ashwin Jha,
Prithvi Raj,
Abhinav Balasubramanian,
Murali Maram,
Guru Muthusamy,
Shivakesh Reddy Annepally,
Sidney Knowles,
Min Du,
Nick Burnett,
Sean Javiya,
Ashok Marannan,
Mamta Kumari,
Surbhi Jha,
Ethan Dereszenski,
Anupam Chakraborty,
Subhash Ranjan
, et al. (13 additional authors not shown)
Abstract:
Enterprise chatbots, powered by generative AI, are emerging as key applications to enhance employee productivity. Retrieval Augmented Generation (RAG), Large Language Models (LLMs), and orchestration frameworks like Langchain and Llamaindex are crucial for building these chatbots. However, creating effective enterprise chatbots is challenging and requires meticulous RAG pipeline engineering. This…
▽ More
Enterprise chatbots, powered by generative AI, are emerging as key applications to enhance employee productivity. Retrieval Augmented Generation (RAG), Large Language Models (LLMs), and orchestration frameworks like Langchain and Llamaindex are crucial for building these chatbots. However, creating effective enterprise chatbots is challenging and requires meticulous RAG pipeline engineering. This includes fine-tuning embeddings and LLMs, extracting documents from vector databases, rephrasing queries, reranking results, designing prompts, honoring document access controls, providing concise responses, including references, safeguarding personal information, and building orchestration agents. We present a framework for building RAG-based chatbots based on our experience with three NVIDIA chatbots: for IT/HR benefits, financial earnings, and general content. Our contributions are three-fold: introducing the FACTS framework (Freshness, Architectures, Cost, Testing, Security), presenting fifteen RAG pipeline control points, and providing empirical results on accuracy-latency tradeoffs between large and small LLMs. To the best of our knowledge, this is the first paper of its kind that provides a holistic view of the factors as well as solutions for building secure enterprise-grade chatbots."
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
A Mini Review on The Applications of Nanomaterials in Forensic Science
Authors:
Aaromal Venugopal,
Vanshika Seth,
Shreya Subhash Naik,
Sreya Valappil,
Aman Verma,
Shalini Rajan,
Pranav Vilas Shetgaonkar,
Akshita Sinha,
Sandeep Munjal
Abstract:
Herein, we report a minireview to give a brief introduction of applications of nanomaterials in the field of forensic science. The materials that have their size in nanoscale (1 - 100 nm) comes under the category of nanomaterials. Nanomaterials possess various applications in different fields like cosmetic production, medical, photoconductivity etc. because of their physio-chemical, electrical and…
▽ More
Herein, we report a minireview to give a brief introduction of applications of nanomaterials in the field of forensic science. The materials that have their size in nanoscale (1 - 100 nm) comes under the category of nanomaterials. Nanomaterials possess various applications in different fields like cosmetic production, medical, photoconductivity etc. because of their physio-chemical, electrical and magnetic properties. Due to the different characteristic property that nanomaterials have, they are widely employed in diverse domains. In various fields of forensic science such as fingerprints, toxicology, medicine, serology, nanomaterials are being used extensively. Large surface area to volume ratio of the materials in nano-regime makes the nanomaterials suitable for all these application with high efficiency. This review article briefs about the nanomaterials, their advantages and their novel applications in various fields, focusing especially in the field of forensic science. The basic idea of different areas of forensic science such as development of fingerprints, detection of drugs, estimating the time since death, analysis of GSR, detection of various explosives and for the extraction of DNA etc. has also been provided.
△ Less
Submitted 18 May, 2023; v1 submitted 16 May, 2023;
originally announced May 2023.
