-
Teat Pose Estimation via RGBD Segmentation for Automated Milking
Authors:
Nicolas Borla,
Fabian Kuster,
Jonas Langenegger,
Juan Ribera,
Marcel Honegger,
Giovanni Toffetti
Abstract:
We present initial results in the development of a novel robot using RGBD cameras, image segmentation, and a simple teat pose estimation algorithm for automated milking. We relate on the analysis of the accuracy of different commercial RGBD cameras in realistic conditions. Although preliminary, our initial implementation shows that 2D image segmentation combined with point cloud processing can ach…
▽ More
We present initial results in the development of a novel robot using RGBD cameras, image segmentation, and a simple teat pose estimation algorithm for automated milking. We relate on the analysis of the accuracy of different commercial RGBD cameras in realistic conditions. Although preliminary, our initial implementation shows that 2D image segmentation combined with point cloud processing can achieve repeatable millimeter-scale precision in estimating (synthetic) teat tip positions and cup attachment approach. The solution is also applicable in a cloud robotics setup, with GPU-based segmentation executed on an edge device or cloud.
△ Less
Submitted 20 May, 2021;
originally announced May 2021.
-
Estimating Phenotypic Traits From UAV Based RGB Imagery
Authors:
Javier Ribera,
Fangning He,
Yuhao Chen,
Ayman F. Habib,
Edward J. Delp
Abstract:
In many agricultural applications one wants to characterize physical properties of plants and use the measurements to predict, for example biomass and environmental influence. This process is known as phenoty**. Traditional collection of phenotypic information is labor-intensive and time-consuming. Use of imagery is becoming popular for phenoty**. In this paper, we present methods to estimate…
▽ More
In many agricultural applications one wants to characterize physical properties of plants and use the measurements to predict, for example biomass and environmental influence. This process is known as phenoty**. Traditional collection of phenotypic information is labor-intensive and time-consuming. Use of imagery is becoming popular for phenoty**. In this paper, we present methods to estimate traits of sorghum plants from RBG cameras on board of an unmanned aerial vehicle (UAV). The position and orientation of the imagery together with the coordinates of sparse points along the area of interest are derived through a new triangulation method. A rectified orthophoto mosaic is then generated from the imagery. The number of leaves is estimated and a model-based method to analyze the leaf morphology for leaf segmentation is proposed. We present a statistical model to find the location of each individual sorghum plant.
△ Less
Submitted 2 July, 2018;
originally announced July 2018.
-
Locating Objects Without Bounding Boxes
Authors:
Javier Ribera,
David Güera,
Yuhao Chen,
Edward J. Delp
Abstract:
Recent advances in convolutional neural networks (CNN) have achieved remarkable results in locating objects in images. In these networks, the training procedure usually requires providing bounding boxes or the maximum number of expected objects. In this paper, we address the task of estimating object locations without annotated bounding boxes which are typically hand-drawn and time consuming to la…
▽ More
Recent advances in convolutional neural networks (CNN) have achieved remarkable results in locating objects in images. In these networks, the training procedure usually requires providing bounding boxes or the maximum number of expected objects. In this paper, we address the task of estimating object locations without annotated bounding boxes which are typically hand-drawn and time consuming to label. We propose a loss function that can be used in any fully convolutional network (FCN) to estimate object locations. This loss function is a modification of the average Hausdorff distance between two unordered sets of points. The proposed method has no notion of bounding boxes, region proposals, or sliding windows. We evaluate our method with three datasets designed to locate people's heads, pupil centers and plant centers. We outperform state-of-the-art generic object detectors and methods fine-tuned for pupil tracking.
△ Less
Submitted 3 April, 2019; v1 submitted 20 June, 2018;
originally announced June 2018.
-
Blip: JIT and Footloose On The Edge
Authors:
Andy Edmonds,
Chris Woods,
Ana Juan Ferrer,
Juan Francisco Ribera,
Thomas Micheal Bohnert
Abstract:
Edge environments offer a number of advantages for software developers including the ability to create services which can offer lower latency, better privacy, and reduced operational costs than traditional cloud hosted services. However large technical challenges exist, which prevent developers from utilising the Edge; complexities related to the heterogeneous nature of the Edge environment, issue…
▽ More
Edge environments offer a number of advantages for software developers including the ability to create services which can offer lower latency, better privacy, and reduced operational costs than traditional cloud hosted services. However large technical challenges exist, which prevent developers from utilising the Edge; complexities related to the heterogeneous nature of the Edge environment, issues with orchestration and application management and lastly, the inherent issues in creating decentralised distributed applications which operate at a large geographic scale. In this conceptual and architectural paper we envision a solution, Blip, which offers an easy to use programming and operational environment which addresses the these issues. It aims to remove the technical barriers which will inhibit the wider adoption Edge application development. This paper validates the Blip concept by demonstrating how it will deliver on the advantages of the Edge for a familiar scenario.
△ Less
Submitted 31 May, 2018;
originally announced June 2018.
