-
Concept-based Anomaly Detection in Retail Stores for Automatic Correction using Mobile Robots
Authors:
Aditya Kapoor,
Vartika Sengar,
Nijil George,
Vighnesh Vatsal,
Jayavardhana Gubbi,
Balamuralidhar P,
Arpan Pal
Abstract:
Tracking of inventory and rearrangement of misplaced items are some of the most labor-intensive tasks in a retail environment. While there have been attempts at using vision-based techniques for these tasks, they mostly use planogram compliance for detection of any anomalies, a technique that has been found lacking in robustness and scalability. Moreover, existing systems rely on human interventio…
▽ More
Tracking of inventory and rearrangement of misplaced items are some of the most labor-intensive tasks in a retail environment. While there have been attempts at using vision-based techniques for these tasks, they mostly use planogram compliance for detection of any anomalies, a technique that has been found lacking in robustness and scalability. Moreover, existing systems rely on human intervention to perform corrective actions after detection. In this paper, we present Co-AD, a Concept-based Anomaly Detection approach using a Vision Transformer (ViT) that is able to flag misplaced objects without using a prior knowledge base such as a planogram. It uses an auto-encoder architecture followed by outlier detection in the latent space. Co-AD has a peak success rate of 89.90% on anomaly detection image sets of retail objects drawn from the RP2K dataset, compared to 80.81% on the best-performing baseline of a standard ViT auto-encoder. To demonstrate its utility, we describe a robotic mobile manipulation pipeline to autonomously correct the anomalies flagged by Co-AD. This work is ultimately aimed towards develo** autonomous mobile robot solutions that reduce the need for human intervention in retail store management.
△ Less
Submitted 21 October, 2023;
originally announced October 2023.
-
LAMSkyCam: A Low-cost and Miniature Ground-based Sky Camera
Authors:
Mayank Jain,
Vishal Singh Sengar,
Isabella Gollini,
Michela Bertolotto,
Gavin McArdle,
Soumyabrata Dev
Abstract:
Ground-based sky imagers (GSIs) are increasingly becoming popular amongst the remote sensing analysts. This is because such imagers offer fantastic alternatives to satellite measurements for the purpose of earth observations. In this paper, we propose an extremely low-cost and miniature ground-based sky camera for atmospheric study. Built using $3$D printed components and off-the-shelf components,…
▽ More
Ground-based sky imagers (GSIs) are increasingly becoming popular amongst the remote sensing analysts. This is because such imagers offer fantastic alternatives to satellite measurements for the purpose of earth observations. In this paper, we propose an extremely low-cost and miniature ground-based sky camera for atmospheric study. Built using $3$D printed components and off-the-shelf components, our sky camera is lightweight and robust for use in diverse climatic conditions. With a $63^{\circ}$ field of view angle, the camera captures high resolution sky/cloud images for both day and night times at $5$ minute intervals. The camera is designed to be be mounted on a pole-like architecture and with its compact form, it can be installed at any location without requiring any change in the existing infrastructure. For remote areas, the camera has also a local backup facility from which data can be easily accessed manually. We have open-sourced the hardware design of our sky camera, and therefore researchers can easily manufacture and deploy these cameras for their respective use cases.
△ Less
Submitted 13 September, 2022;
originally announced September 2022.
-
Auto-TransRL: Autonomous Composition of Vision Pipelines for Robotic Perception
Authors:
Aditya Kapoor,
Nijil George,
Vartika Sengar,
Vighnesh Vatsal,
Jayavardhana Gubbi
Abstract:
Creating a vision pipeline for different datasets to solve a computer vision task is a complex and time consuming process. Currently, these pipelines are developed with the help of domain experts. Moreover, there is no systematic structure to construct a vision pipeline apart from relying on experience, trial and error or using template-based approaches. As the search space for choosing suitable a…
▽ More
Creating a vision pipeline for different datasets to solve a computer vision task is a complex and time consuming process. Currently, these pipelines are developed with the help of domain experts. Moreover, there is no systematic structure to construct a vision pipeline apart from relying on experience, trial and error or using template-based approaches. As the search space for choosing suitable algorithms for achieving a particular vision task is large, human exploration for finding a good solution requires time and effort. To address the following issues, we propose a dynamic and data-driven way to identify an appropriate set of algorithms that would be fit for building the vision pipeline in order to achieve the goal task. We introduce a Transformer Architecture complemented with Deep Reinforcement Learning to recommend algorithms that can be incorporated at different stages of the vision workflow. This system is both robust and adaptive to dynamic changes in the environment. Experimental results further show that our method also generalizes well to recommend algorithms that have not been used while training and hence alleviates the need of retraining the system on a new set of algorithms introduced during test time.
△ Less
Submitted 7 September, 2022;
originally announced September 2022.
-
Challenges in Applying Robotics to Retail Store Management
Authors:
Vartika Sengar,
Aditya Kapoor,
Nijil George,
Vighnesh Vatsal,
Jayavardhana Gubbi,
Balamuralidhar P,
Arpan Pal
Abstract:
An autonomous retail store management system entails inventory tracking, store monitoring, and anomaly correction. Recent attempts at autonomous retail store management have faced challenges primarily in perception for anomaly detection, as well as new challenges arising in mobile manipulation for executing anomaly correction. Advances in each of these areas along with system integration are neces…
▽ More
An autonomous retail store management system entails inventory tracking, store monitoring, and anomaly correction. Recent attempts at autonomous retail store management have faced challenges primarily in perception for anomaly detection, as well as new challenges arising in mobile manipulation for executing anomaly correction. Advances in each of these areas along with system integration are necessary for a scalable solution in this domain.
△ Less
Submitted 18 August, 2022;
originally announced August 2022.