Skip to main content

Showing 1–22 of 22 results for author: Bajcsy, R

.
  1. arXiv:2403.08149  [pdf, other

    cs.RO

    On the Feasibility of EEG-based Motor Intention Detection for Real-Time Robot Assistive Control

    Authors: Ho ** Choi, Satyajeet Das, Shaoting Peng, Ruzena Bajcsy, Nadia Figueroa

    Abstract: This paper explores the feasibility of employing EEG-based intention detection for real-time robot assistive control. We focus on predicting and distinguishing motor intentions of left/right arm movements by presenting: i) an offline data collection and training pipeline, used to train a classifier for left/right motion intention prediction, and ii) an online real-time prediction pipeline leveragi… ▽ More

    Submitted 12 March, 2024; originally announced March 2024.

  2. arXiv:2303.16138  [pdf, other

    cs.RO

    DefGraspNets: Grasp Planning on 3D Fields with Graph Neural Nets

    Authors: Isabella Huang, Yashraj Narang, Ruzena Bajcsy, Fabio Ramos, Tucker Hermans, Dieter Fox

    Abstract: Robotic gras** of 3D deformable objects is critical for real-world applications such as food handling and robotic surgery. Unlike rigid and articulated objects, 3D deformable objects have infinite degrees of freedom. Fully defining their state requires 3D deformation and stress fields, which are exceptionally difficult to analytically compute or experimentally measure. Thus, evaluating grasp can… ▽ More

    Submitted 28 March, 2023; originally announced March 2023.

    Comments: To be published in the IEEE Conference on Robotics and Automation (ICRA), 2023

  3. DefGraspSim: Physics-based simulation of grasp outcomes for 3D deformable objects

    Authors: Isabella Huang, Yashraj Narang, Clemens Eppner, Balakumar Sundaralingam, Miles Macklin, Ruzena Bajcsy, Tucker Hermans, Dieter Fox

    Abstract: Robotic gras** of 3D deformable objects (e.g., fruits/vegetables, internal organs, bottles/boxes) is critical for real-world applications such as food processing, robotic surgery, and household automation. However, develo** grasp strategies for such objects is uniquely challenging. Unlike rigid objects, deformable objects have infinite degrees of freedom and require field quantities (e.g., def… ▽ More

    Submitted 21 March, 2022; originally announced March 2022.

    Comments: For associated web page, see \url{https://sites.google.com/nvidia.com/defgraspsim}. To be published in the IEEE Robotics and Automation Letters (RA-L) special issue on Robotic Handling of Deformable Objects, 2022. arXiv admin note: substantial text overlap with arXiv:2107.05778

  4. arXiv:2107.06924  [pdf, other

    cs.RO

    Deformable Elasto-Plastic Object Sha** using an Elastic Hand and Model-Based Reinforcement Learning

    Authors: Carolyn Matl, Ruzena Bajcsy

    Abstract: Deformable solid objects such as clay or dough are prevalent in industrial and home environments. However, robotic manipulation of such objects has largely remained unexplored in literature due to the high complexity involved in representing and modeling their deformation. This work addresses the problem of sha** elasto-plastic dough by proposing to use a novel elastic end-effector to roll dough… ▽ More

    Submitted 14 July, 2021; originally announced July 2021.

    Comments: 9 pages, 6 figures, To be published in Proc. 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

  5. arXiv:2105.08154  [pdf, other

    cs.RO

    StRETcH: a Soft to Resistive Elastic Tactile Hand

    Authors: Carolyn Matl, Josephine Koe, Ruzena Bajcsy

    Abstract: Soft optical tactile sensors enable robots to manipulate deformable objects by capturing important features such as high-resolution contact geometry and estimations of object compliance. This work presents a variable stiffness soft tactile end-effector called StRETcH, a Soft to Resistive Elastic Tactile Hand, that is easily manufactured and integrated with a robotic arm. An elastic membrane is sus… ▽ More

    Submitted 17 May, 2021; originally announced May 2021.

    Comments: 8 pages, 8 figures, To be published in Proc. 2020 IEEE International Conference on Robotics and Automation (ICRA), expanded figures, added clarification for stiffness estimation (Sec. VI-B, paragraph 4)

  6. arXiv:2011.03136  [pdf, other

    cs.RO

    STReSSD: Sim-To-Real from Sound for Stochastic Dynamics

    Authors: Carolyn Matl, Yashraj Narang, Dieter Fox, Ruzena Bajcsy, Fabio Ramos

    Abstract: Sound is an information-rich medium that captures dynamic physical events. This work presents STReSSD, a framework that uses sound to bridge the simulation-to-reality gap for stochastic dynamics, demonstrated for the canonical case of a bouncing ball. A physically-motivated noise model is presented to capture stochastic behavior of the balls upon collision with the environment. A likelihood-free B… ▽ More

    Submitted 5 November, 2020; originally announced November 2020.

    Comments: 25 pages, 35 figures, The Conference on Robot Learning (CoRL) 2020

  7. arXiv:2003.08032  [pdf, other

    cs.RO cs.GR

    Inferring the Material Properties of Granular Media for Robotic Tasks

    Authors: Carolyn Matl, Yashraj Narang, Ruzena Bajcsy, Fabio Ramos, Dieter Fox

    Abstract: Granular media (e.g., cereal grains, plastic resin pellets, and pills) are ubiquitous in robotics-integrated industries, such as agriculture, manufacturing, and pharmaceutical development. This prevalence mandates the accurate and efficient simulation of these materials. This work presents a software and hardware framework that automatically calibrates a fast physics simulator to accurately simula… ▽ More

    Submitted 5 November, 2020; v1 submitted 18 March, 2020; originally announced March 2020.

    Comments: 8 pages, 6 figures, appeared in ICRA 2020; fixed misplaced image in figure 4; updated video link; fixed resolution for figure 2

  8. arXiv:1806.04620  [pdf, other

    cs.CV

    Fast forwarding Egocentric Videos by Listening and Watching

    Authors: Vinicius S. Furlan, Ruzena Bajcsy, Erickson R. Nascimento

    Abstract: The remarkable technological advance in well-equipped wearable devices is pushing an increasing production of long first-person videos. However, since most of these videos have long and tedious parts, they are forgotten or never seen. Despite a large number of techniques proposed to fast-forward these videos by highlighting relevant moments, most of them are image based only. Most of these techniq… ▽ More

    Submitted 12 June, 2018; originally announced June 2018.

  9. arXiv:1706.07342  [pdf, other

    cs.CV

    A Computer Vision Pipeline for Automated Determination of Cardiac Structure and Function and Detection of Disease by Two-Dimensional Echocardiography

    Authors: Jeffrey Zhang, Sravani Gajjala, Pulkit Agrawal, Geoffrey H. Tison, Laura A. Hallock, Lauren Beussink-Nelson, Eugene Fan, Mandar A. Aras, ChaRandle Jordan, Kirsten E. Fleischmann, Michelle Melisko, Atif Qasim, Alexei Efros, Sanjiv J. Shah, Ruzena Bajcsy, Rahul C. Deo

    Abstract: Automated cardiac image interpretation has the potential to transform clinical practice in multiple ways including enabling low-cost serial assessment of cardiac function in the primary care and rural setting. We hypothesized that advances in computer vision could enable building a fully automated, scalable analysis pipeline for echocardiogram (echo) interpretation. Our approach entailed: 1) prepr… ▽ More

    Submitted 12 January, 2018; v1 submitted 22 June, 2017; originally announced June 2017.

    Comments: 9 figures, 2 tables

  10. arXiv:1705.00748  [pdf, other

    eess.SY

    Robust, Informative Human-in-the-Loop Predictions via Empirical Reachable Sets

    Authors: Katherine Driggs-Campbell, Roy Dong, S. Shankar Sastry, Ruzena Bajcsy

    Abstract: In order to develop provably safe human-in-the-loop systems, accurate and precise models of human behavior must be developed. In the case of intelligent vehicles, one can imagine the need for predicting driver behavior to develop minimally invasive active safety systems or to safely interact with other vehicles on the road. We present a optimization based method for approximating the stochastic re… ▽ More

    Submitted 1 May, 2017; originally announced May 2017.

  11. arXiv:1604.00602  [pdf, other

    eess.SY cs.RO math.DS math.OC

    Convex Computation of the Basin of Stability to Measure the Likelihood of Falling: A Case Study on the Sit-to-Stand Task

    Authors: Victor Shia, Talia Moore, Ruzena Bajcsy, Ram Vasudevan

    Abstract: Locomotion in the real world involves unexpected perturbations, and therefore requires strategies to maintain stability to successfully execute desired behaviours. Ensuring the safety of locomoting systems therefore necessitates a quantitative metric for stability. Due to the difficulty of determining the set of perturbations that induce failure, researchers have used a variety of features as a pr… ▽ More

    Submitted 3 April, 2016; originally announced April 2016.

    Comments: 11 pages, 9 figures

  12. arXiv:1603.02729  [pdf

    cs.CV cs.RO

    Revisiting Active Perception

    Authors: Ruzena Bajcsy, Yiannis Aloimonos, John K. Tsotsos

    Abstract: Despite the recent successes in robotics, artificial intelligence and computer vision, a complete artificial agent necessarily must include active perception. A multitude of ideas and methods for how to accomplish this have already appeared in the past, their broader utility perhaps impeded by insufficient computational power or costly hardware. The history of these ideas, perhaps selective due to… ▽ More

    Submitted 13 March, 2016; v1 submitted 8 March, 2016; originally announced March 2016.

  13. arXiv:1512.06492  [pdf, other

    cs.CV cs.AI

    Remote Health Coaching System and Human Motion Data Analysis for Physical Therapy with Microsoft Kinect

    Authors: Qifei Wang, Gregorij Kurillo, Ferda Ofli, Ruzena Bajcsy

    Abstract: This paper summarizes the recent progress we have made for the computer vision technologies in physical therapy with the accessible and affordable devices. We first introduce the remote health coaching system we build with Microsoft Kinect. Since the motion data captured by Kinect is noisy, we investigate the data accuracy of Kinect with respect to the high accuracy motion capture system. We also… ▽ More

    Submitted 20 December, 2015; originally announced December 2015.

    Comments: 6 pages, Computer Vision for Accessible and Affordable HealthCare Workshop (ICCV2015)

  14. Evaluation of Pose Tracking Accuracy in the First and Second Generations of Microsoft Kinect

    Authors: Qifei Wang, Gregorij Kurillo, Ferda Ofli, Ruzena Bajcsy

    Abstract: Microsoft Kinect camera and its skeletal tracking capabilities have been embraced by many researchers and commercial developers in various applications of real-time human movement analysis. In this paper, we evaluate the accuracy of the human kinematic motion data in the first and second generation of the Kinect system, and compare the results with an optical motion capture system. We collected mo… ▽ More

    Submitted 13 December, 2015; originally announced December 2015.

    Comments: 10 pages, IEEE International Conference on Healthcare Informatics 2015 (ICHI 2015)

  15. arXiv:1512.04115  [pdf, other

    cs.CV

    Unsupervised Temporal Segmentation of Repetitive Human Actions Based on Kinematic Modeling and Frequency Analysis

    Authors: Qifei Wang, Gregorij Kurillo, Ferda Ofli, Ruzena Bajcsy

    Abstract: In this paper, we propose a method for temporal segmentation of human repetitive actions based on frequency analysis of kinematic parameters, zero-velocity crossing detection, and adaptive k-means clustering. Since the human motion data may be captured with different modalities which have different temporal sampling rate and accuracy (e.g., optical motion capture systems vs. Microsoft Kinect), we… ▽ More

    Submitted 13 December, 2015; originally announced December 2015.

    Comments: 9 pages, International Conference on 3D Vision 2015

  16. arXiv:1505.05921  [pdf, other

    eess.SY

    Identifying Modes of Intent from Driver Behaviors in Dynamic Environments

    Authors: Katherine Driggs-Campbell, Ruzena Bajcsy

    Abstract: In light of growing attention of intelligent vehicle systems, we propose develo** a driver model that uses a hybrid system formulation to capture the intent of the driver. This model hopes to capture human driving behavior in a way that can be utilized by semi- and fully autonomous systems in heterogeneous environments. We consider a discrete set of high level goals or intent modes, that is desi… ▽ More

    Submitted 21 May, 2015; originally announced May 2015.

    Comments: Submitted to ITSC 2015

  17. arXiv:1504.07313  [pdf, other

    cs.CR cs.AI cs.IT cs.LG

    Private Disclosure of Information in Health Tele-monitoring

    Authors: Daniel Aranki, Ruzena Bajcsy

    Abstract: We present a novel framework, called Private Disclosure of Information (PDI), which is aimed to prevent an adversary from inferring certain sensitive information about subjects using the data that they disclosed during communication with an intended recipient. We show cases where it is possible to achieve perfect privacy regardless of the adversary's auxiliary knowledge while preserving full utili… ▽ More

    Submitted 27 April, 2015; originally announced April 2015.

  18. arXiv:1401.5039  [pdf, other

    eess.SY cs.HC

    Experimental Design for Human-in-the-Loop Driving Simulations

    Authors: Katherine Driggs-Campbell, Guillaume Bellegarda, Victor Shia, S. Shankar Sastry, Ruzena Bajcsy

    Abstract: This report describes a new experimental setup for human-in-the-loop simulations. A force feedback simulator with four axis motion has been setup for real-time driving experiments. The simulator will move to simulate the forces a driver feels while driving, which allows for a realistic experience for the driver. This setup allows for flexibility and control for the researcher in a realistic simula… ▽ More

    Submitted 20 January, 2014; originally announced January 2014.

  19. Metrization and Simulation of Controlled Hybrid Systems

    Authors: Samuel Burden, Humberto Gonzalez, Ramanarayan Vasudevan, Ruzena Bajcsy, S. Shankar Sastry

    Abstract: The study of controlled hybrid systems requires practical tools for approximation and comparison of system behaviors. Existing approaches to these problems impose undue restrictions on the system's continuous and discrete dynamics. Metrization and simulation of controlled hybrid systems is considered here in a unified framework by constructing a state space metric. The metric is applied to develop… ▽ More

    Submitted 16 September, 2014; v1 submitted 18 February, 2013; originally announced February 2013.

  20. Consistent Approximations for the Optimal Control of Constrained Switched Systems

    Authors: Ramanarayan Vasudevan, Humberto Gonzalez, Ruzena Bajcsy, S. Shankar Sastry

    Abstract: Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In this paper, we devise an algorithm for the computation of an optimal control of constrained nonlinear switched dynamical systems. The control parameter for such s… ▽ More

    Submitted 19 August, 2012; v1 submitted 31 July, 2012; originally announced August 2012.

  21. arXiv:1108.1367  [pdf

    cs.NI cs.SI

    Savings in location management costs leveraging user statistics

    Authors: E Martin, R Bajcsy

    Abstract: The growth in the number of users in mobile communications networks and the rise in the traffic generated by each user, are responsible for the increasing importance of Mobility Management. Within Mobility Management, the main objective of Location Management is to enable the roaming of the user in the coverage area. In this paper, we analyze the savings in Location Management costs obtained lever… ▽ More

    Submitted 5 August, 2011; originally announced August 2011.

    Comments: IJU, 2011, 2, 3

  22. Variability of location management costs with different mobilities and timer periods to update locations

    Authors: E Martin, R Bajcsy

    Abstract: In this article, we examine the Location Management costs in mobile communication networks utilizing the timer-based method. From the study of the probabilities that a mobile terminal changes a number of Location Areas between two calls, we identify a threshold value of 0.7 for the Call-to-Mobility Ratio (CMR) below which the application of the timer-based method is most appropriate. We characteri… ▽ More

    Submitted 5 August, 2011; originally announced August 2011.

    Comments: ijcnc 2011, 3, 4