-
Histopathology Based AI Model Predicts Anti-Angiogenic Therapy Response in Renal Cancer Clinical Trial
Authors:
Jay Jasti,
Hua Zhong,
Vandana Panwar,
Vipul Jarmale,
Jeffrey Miyata,
Deyssy Carrillo,
Alana Christie,
Dinesh Rakheja,
Zora Modrusan,
Edward Ernest Kadel III,
Niha Beig,
Mahrukh Huseni,
James Brugarolas,
Payal Kapur,
Satwik Rajaram
Abstract:
Predictive biomarkers of treatment response are lacking for metastatic clear cell renal cell carcinoma (ccRCC), a tumor type that is treated with angiogenesis inhibitors, immune checkpoint inhibitors, mTOR inhibitors and a HIF2 inhibitor. The Angioscore, an RNA-based quantification of angiogenesis, is arguably the best candidate to predict anti-angiogenic (AA) response. However, the clinical adopt…
▽ More
Predictive biomarkers of treatment response are lacking for metastatic clear cell renal cell carcinoma (ccRCC), a tumor type that is treated with angiogenesis inhibitors, immune checkpoint inhibitors, mTOR inhibitors and a HIF2 inhibitor. The Angioscore, an RNA-based quantification of angiogenesis, is arguably the best candidate to predict anti-angiogenic (AA) response. However, the clinical adoption of transcriptomic assays faces several challenges including standardization, time delay, and high cost. Further, ccRCC tumors are highly heterogenous, and sampling multiple areas for sequencing is impractical. Here we present a novel deep learning (DL) approach to predict the Angioscore from ubiquitous histopathology slides. To overcome the lack of interpretability, one of the biggest limitations of typical DL models, our model produces a visual vascular network which is the basis of the model's prediction. To test its reliability, we applied this model to multiple cohorts including a clinical trial dataset. Our model accurately predicts the RNA-based Angioscore on multiple independent cohorts (spearman correlations of 0.77 and 0.73). Further, the predictions help unravel meaningful biology such as association of angiogenesis with grade, stage, and driver mutation status. Finally, we find our model can predict response to AA therapy, in both a real-world cohort and the IMmotion150 clinical trial. The predictive power of our model vastly exceeds that of CD31, a marker of vasculature, and nearly rivals the performance (c-index 0.66 vs 0.67) of the ground truth RNA-based Angioscore at a fraction of the cost. By providing a robust yet interpretable prediction of the Angioscore from histopathology slides alone, our approach offers insights into angiogenesis biology and AA treatment response.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
BlendScape: Enabling Unified and Personalized Video-Conferencing Environments through Generative AI
Authors:
Shwetha Rajaram,
Nels Numan,
Balasaravanan Thoravi Kumaravel,
Nicolai Marquardt,
Andrew D. Wilson
Abstract:
Today's video-conferencing tools support a rich range of professional and social activities, but their generic, grid-based environments cannot be easily adapted to meet the varying needs of distributed collaborators. To enable end-user customization, we developed BlendScape, a system for meeting participants to compose video-conferencing environments tailored to their collaboration context by leve…
▽ More
Today's video-conferencing tools support a rich range of professional and social activities, but their generic, grid-based environments cannot be easily adapted to meet the varying needs of distributed collaborators. To enable end-user customization, we developed BlendScape, a system for meeting participants to compose video-conferencing environments tailored to their collaboration context by leveraging AI image generation techniques. BlendScape supports flexible representations of task spaces by blending users' physical or virtual backgrounds into unified environments and implements multimodal interaction techniques to steer the generation. Through an evaluation with 15 end-users, we investigated their customization preferences for work and social scenarios. Participants could rapidly express their design intentions with BlendScape and envisioned using the system to structure collaboration in future meetings, but experienced challenges with preventing distracting elements. We implement scenarios to demonstrate BlendScape's expressiveness in supporting distributed collaboration techniques from prior work and propose composition techniques to improve the quality of environments.
△ Less
Submitted 20 March, 2024;
originally announced March 2024.
-
Scene Recognition Through Visual and Acoustic Cues Using K-Means
Authors:
Sidharth Rajaram,
J. Kenneth Salisbury
Abstract:
We propose a K-Means based prediction system, nicknamed SERVANT (Scene Recognition Through Visual and Acoustic Cues), that is capable of recognizing environmental scenes through analysis of ambient sound and color cues. The concept and implementation originated within the Learning branch of the Intelligent Wearable Robotics Project (also known as the Third Arm project) at the Stanford Artificial I…
▽ More
We propose a K-Means based prediction system, nicknamed SERVANT (Scene Recognition Through Visual and Acoustic Cues), that is capable of recognizing environmental scenes through analysis of ambient sound and color cues. The concept and implementation originated within the Learning branch of the Intelligent Wearable Robotics Project (also known as the Third Arm project) at the Stanford Artificial Intelligence Lab-Toyota Center (SAIL-TC). The Third Arm Project focuses on the development and conceptualization of a robotic arm that can aid users in a whole array of situations: i.e. carrying a cup of coffee, holding a flashlight. Servant uses a K-Means fit-and-predict architecture to classify environmental scenes, such as that of a coffee shop or a basketball gym, using visual and auditory cues. Following such classification, Servant can recommend contextual actions based on prior training.
△ Less
Submitted 25 November, 2018;
originally announced November 2018.
-
Neural Relation Extraction Within and Across Sentence Boundaries
Authors:
Pankaj Gupta,
Subburam Rajaram,
Hinrich Schütze,
Bernt Andrassy,
Thomas Runkler
Abstract:
Past work in relation extraction mostly focuses on binary relation between entity pairs within single sentence. Recently, the NLP community has gained interest in relation extraction in entity pairs spanning multiple sentences. In this paper, we propose a novel architecture for this task: inter-sentential dependency-based neural networks (iDepNN). iDepNN models the shortest and augmented dependenc…
▽ More
Past work in relation extraction mostly focuses on binary relation between entity pairs within single sentence. Recently, the NLP community has gained interest in relation extraction in entity pairs spanning multiple sentences. In this paper, we propose a novel architecture for this task: inter-sentential dependency-based neural networks (iDepNN). iDepNN models the shortest and augmented dependency paths via recurrent and recursive neural networks to extract relationships within (intra-) and across (inter-) sentence boundaries. Compared to SVM and neural network baselines, iDepNN is more robust to false positives in relationships spanning sentences.
We evaluate our models on four datasets from newswire (MUC6) and medical (BioNLP shared task) domains that achieve state-of-the-art performance and show a better balance in precision and recall for inter-sentential relationships. We perform better than 11 teams participating in the BioNLP shared task 2016 and achieve a gain of 5.2% (0.587 vs 0.558) in F1 over the winning team. We also release the crosssentence annotations for MUC6.
△ Less
Submitted 14 January, 2019; v1 submitted 11 October, 2018;
originally announced October 2018.
-
Deep Temporal-Recurrent-Replicated-Softmax for Topical Trends over Time
Authors:
Pankaj Gupta,
Subburam Rajaram,
Hinrich Schütze,
Bernt Andrassy
Abstract:
Dynamic topic modeling facilitates the identification of topical trends over time in temporal collections of unstructured documents. We introduce a novel unsupervised neural dynamic topic model named as Recurrent Neural Network-Replicated Softmax Model (RNNRSM), where the discovered topics at each time influence the topic discovery in the subsequent time steps. We account for the temporal ordering…
▽ More
Dynamic topic modeling facilitates the identification of topical trends over time in temporal collections of unstructured documents. We introduce a novel unsupervised neural dynamic topic model named as Recurrent Neural Network-Replicated Softmax Model (RNNRSM), where the discovered topics at each time influence the topic discovery in the subsequent time steps. We account for the temporal ordering of documents by explicitly modeling a joint distribution of latent topical dependencies over time, using distributional estimators with temporal recurrent connections. Applying RNN-RSM to 19 years of articles on NLP research, we demonstrate that compared to state-of-the art topic models, RNNRSM shows better generalization, topic interpretation, evolution and trends. We also introduce a metric (named as SPAN) to quantify the capability of dynamic topic model to capture word evolution in topics over time.
△ Less
Submitted 1 May, 2018; v1 submitted 15 November, 2017;
originally announced November 2017.
-
Secure Routing Path Using Trust Values for Wireless Sensor Networks
Authors:
S. Rajaram,
A. Babu Karuppiah,
K. Vinoth Kumar
Abstract:
Traditional cryptography-based security mechanisms such as authentication and authorization are not effective against insider attacks like wormhole, sinkhole, selective forwarding attacks, etc., Trust based approaches have been widely used to counter insider attacks in wireless sensor networks. It provides a quantitative way to evaluate the trustworthiness of sensor nodes. An untrustworthy node ca…
▽ More
Traditional cryptography-based security mechanisms such as authentication and authorization are not effective against insider attacks like wormhole, sinkhole, selective forwarding attacks, etc., Trust based approaches have been widely used to counter insider attacks in wireless sensor networks. It provides a quantitative way to evaluate the trustworthiness of sensor nodes. An untrustworthy node can wreak considerable damage and adversely affect the quality and reliability of data. Therefore, analysing the trust level of a node is important. In this paper we focused about indirect trust mechanism, in which each node monitors the forwarding behavior of its neighbors in order to detect any node that behaves selfishly and does not forward the packets it receives. For this, we used a link state routing protocol based indirect trusts which forms the shortest route and finds the best trustworthy route among them by comparing the values of all the calculated route trusts as for each route present in the network. And finally, we compare our work with similar routing protocols and show its advantages over them.
△ Less
Submitted 8 July, 2014;
originally announced July 2014.
-
Photon Counting as a Probe of Superfluidity in a Two-Band Bose Hubbard System Coupled to a Cavity Field
Authors:
Sara Rajaram,
Nandini Trivedi
Abstract:
We show that photon number measurement can be used to detect superfluidity for a two-band Bose-Hubbard model coupled to a cavity field. The atom-photon coupling induces transitions between the two internal atomic levels and results in entangled polaritonic states. In the presence of a cavity field, we find different photon numbers in the Mott-insulating versus superfluid phases, providing a method…
▽ More
We show that photon number measurement can be used to detect superfluidity for a two-band Bose-Hubbard model coupled to a cavity field. The atom-photon coupling induces transitions between the two internal atomic levels and results in entangled polaritonic states. In the presence of a cavity field, we find different photon numbers in the Mott-insulating versus superfluid phases, providing a method of distinguishing the atomic phases by photon counting. Furthermore, we examine the dynamics of the photon field after a rapid quench to zero atomic hop** by increasing the well depth. We find a robust correlation between the field's quench dynamics and the initial superfluid order parameter, thereby providing a novel and accurate method of determining the order parameter.
△ Less
Submitted 26 November, 2012;
originally announced November 2012.
-
Hybrid CMOS-MQCA Logic Architectures using Multi-Layer Spintronic Devices
Authors:
Jayita Das,
Syed M. Alam,
Srinath Rajaram,
Sanjukta Bhanja
Abstract:
We present a novel hybrid CMOS-MQCA architecture using multi-layer Spintronic devices as computing elements. A feasibility study is presented with 22nm CMOS where new approaches for spin transfer torque induced clocking and read-out scheme for variability-tolerance are introduced. A first-of-its-kind Spintronic device model enables circuit simulation using existing CAD infrastructure. Approximatel…
▽ More
We present a novel hybrid CMOS-MQCA architecture using multi-layer Spintronic devices as computing elements. A feasibility study is presented with 22nm CMOS where new approaches for spin transfer torque induced clocking and read-out scheme for variability-tolerance are introduced. A first-of-its-kind Spintronic device model enables circuit simulation using existing CAD infrastructure. Approximately 70% reduction in energy consumption is observed when compared against conventional field-induced clocking scheme.
△ Less
Submitted 17 March, 2012; v1 submitted 19 February, 2011;
originally announced February 2011.
-
Mixing of Quantum Walk on Circulant Bunkbeds
Authors:
P. Lo,
S. Rajaram,
D. Schepens,
D. Sullivan,
C. Tamon,
J. Ward
Abstract:
We give new observations on the mixing dynamics of a continuous-time quantum walk on circulants and their bunkbed extensions. These bunkbeds are defined through two standard graph operators: the join G + H and the Cartesian product of graphs G and H.Our results include the following:
1. The quantum walk is average uniform mixing on circulants with bounded eigenvalue multiplicity. This extends…
▽ More
We give new observations on the mixing dynamics of a continuous-time quantum walk on circulants and their bunkbed extensions. These bunkbeds are defined through two standard graph operators: the join G + H and the Cartesian product of graphs G and H.Our results include the following:
1. The quantum walk is average uniform mixing on circulants with bounded eigenvalue multiplicity. This extends a known fact about the cycles. 2. Explicit analysis of the probability distribution of the quantum walk on the join of circulants. This explains why complete partite graphs are not average uniform mixing, using the fact the complete n-vertex graph is the join of a 1-vertex graph and the (n-1)-vertex complete graph, and that the complete m-partite graph, where each partition has size n, is the m-fold join of the empty n-vertex graph. 3. The quantum walk on the Cartesian product of a m-vertex path P and a circulant G, is average uniform mixing if G is. This highlights a difference between circulants and the hypercubes. Our proofs employ purely elementary arguments based on the spectra of the graphs.
△ Less
Submitted 8 September, 2005;
originally announced September 2005.
