BasedAI: A decentralized P2P network for Zero Knowledge Large Language Models (ZK-LLMs)
Authors:
Sean Wellington
Abstract:
BasedAI is a distributed network of machines which introduces decentralized infrastructure capable of integrating Fully Homomorphic Encryption (FHE) with any large language model (LLM) connected to its network. The proposed framework embeds a default mechanism, called "Cerberus Squeezing", into the mining process which enables the transformation of a standard LLMs into encrypted zero-knowledge LLM…
▽ More
BasedAI is a distributed network of machines which introduces decentralized infrastructure capable of integrating Fully Homomorphic Encryption (FHE) with any large language model (LLM) connected to its network. The proposed framework embeds a default mechanism, called "Cerberus Squeezing", into the mining process which enables the transformation of a standard LLMs into encrypted zero-knowledge LLMs, or "ZK-LLMs", leveraging insights from generative adversarial networks for data privacy. This novel quantization mechanism empowers BasedAI miners to process and respond to prompts derived from User interaction with LLMs without the need for decrypting either the queries or their corresponding responses. The introduction of Cerberus Squeezing significantly improves performance degradation caused by quantized functions in current FHE-compliant computing environments by proactively optimizing calls between users, miners, and validators.
△ Less
Submitted 1 March, 2024;
originally announced March 2024.
Performance of data-driven inner speech decoding with same-task EEG-fMRI data fusion and bimodal models
Authors:
Holly Wilson,
Scott Wellington,
Foteini Simistira Liwicki,
Vibha Gupta,
Rajkumar Saini,
Kanjar De,
Nosheen Abid,
Sumit Rakesh,
Johan Eriksson,
Oliver Watts,
Xi Chen,
Mohammad Golbabaee,
Michael J. Proulx,
Marcus Liwicki,
Eamonn O'Neill,
Benjamin Metcalfe
Abstract:
Decoding inner speech from the brain signal via hybridisation of fMRI and EEG data is explored to investigate the performance benefits over unimodal models. Two different bimodal fusion approaches are examined: concatenation of probability vectors output from unimodal fMRI and EEG machine learning models, and data fusion with feature engineering. Same task inner speech data are recorded from four…
▽ More
Decoding inner speech from the brain signal via hybridisation of fMRI and EEG data is explored to investigate the performance benefits over unimodal models. Two different bimodal fusion approaches are examined: concatenation of probability vectors output from unimodal fMRI and EEG machine learning models, and data fusion with feature engineering. Same task inner speech data are recorded from four participants, and different processing strategies are compared and contrasted to previously-employed hybridisation methods. Data across participants are discovered to encode different underlying structures, which results in varying decoding performances between subject-dependent fusion models. Decoding performance is demonstrated as improved when pursuing bimodal fMRI-EEG fusion strategies, if the data show underlying structure.
△ Less
Submitted 19 June, 2023;
originally announced June 2023.
