-
Toward Semantic Scene Understanding for Fine-Grained 3D Modeling of Plants
Authors:
Mohamad Qadri,
Harry Freeman,
Eric Schneider,
George Kantor
Abstract:
Agricultural robotics is an active research area due to global population growth and expectations of food and labor shortages. Robots can potentially help with tasks such as pruning, harvesting, phenoty**, and plant modeling. However, agricultural automation is hampered by the difficulty in creating high resolution 3D semantic maps in the field that would allow for safe manipulation and navigati…
▽ More
Agricultural robotics is an active research area due to global population growth and expectations of food and labor shortages. Robots can potentially help with tasks such as pruning, harvesting, phenoty**, and plant modeling. However, agricultural automation is hampered by the difficulty in creating high resolution 3D semantic maps in the field that would allow for safe manipulation and navigation. In this paper, we build toward solutions for this issue and showcase how the use of semantics and environmental priors can help in constructing accurate 3D maps for the target application of sorghum. Specifically, we 1) use sorghum seeds as semantic landmarks to build a visual Simultaneous Localization and Map** (SLAM) system that enables us to map 78\\% of a sorghum range on average, compared to 38% with ORB-SLAM2; and 2) use seeds as semantic features to improve 3D reconstruction of a full sorghum panicle from images taken by a robotic in-hand camera.
△ Less
Submitted 28 December, 2023;
originally announced December 2023.
-
Autonomous Apple Fruitlet Sizing with Next Best View Planning
Authors:
Harry Freeman,
George Kantor
Abstract:
In this paper, we present a next-best-view planning approach to autonomously size apple fruitlets. State-of-the-art viewpoint planners in agriculture are designed to size large and more sparsely populated fruit. They rely on lower resolution maps and sizing methods that do not generalize to smaller fruit sizes. To overcome these limitations, our method combines viewpoint sampling around semantical…
▽ More
In this paper, we present a next-best-view planning approach to autonomously size apple fruitlets. State-of-the-art viewpoint planners in agriculture are designed to size large and more sparsely populated fruit. They rely on lower resolution maps and sizing methods that do not generalize to smaller fruit sizes. To overcome these limitations, our method combines viewpoint sampling around semantically labeled regions of interest, along with an attention-guided information gain mechanism to more strategically select viewpoints that target the small fruits' volume. Additionally, we integrate a dual-map representation of the environment that is able to both speed up expensive ray casting operations and maintain the high occupancy resolution required to informatively plan around the fruit. When sizing, a robust estimation and graph clustering approach is introduced to associate fruit detections across images. Through simulated experiments, we demonstrate that our viewpoint planner improves sizing accuracy compared to state of the art and ablations. We also provide quantitative results on data collected by a real robotic system in the field.
△ Less
Submitted 24 September, 2023;
originally announced September 2023.
-
Autonomous Apple Fruitlet Sizing and Growth Rate Tracking using Computer Vision
Authors:
Harry Freeman,
Mohamad Qadri,
Abhisesh Silwal,
Paul O'Connor,
Zachary Rubinstein,
Daniel Cooley,
George Kantor
Abstract:
In this paper, we present a computer vision-based approach to measure the sizes and growth rates of apple fruitlets. Measuring the growth rates of apple fruitlets is important because it allows apple growers to determine when to apply chemical thinners to their crops in order to optimize yield. The current practice of obtaining growth rates involves using calipers to record sizes of fruitlets acro…
▽ More
In this paper, we present a computer vision-based approach to measure the sizes and growth rates of apple fruitlets. Measuring the growth rates of apple fruitlets is important because it allows apple growers to determine when to apply chemical thinners to their crops in order to optimize yield. The current practice of obtaining growth rates involves using calipers to record sizes of fruitlets across multiple days. Due to the number of fruitlets needed to be sized, this method is laborious, time-consuming, and prone to human error. With images collected by a hand-held stereo camera, our system, segments, clusters, and fits ellipses to fruitlets to measure their diameters. The growth rates are then calculated by temporally associating clustered fruitlets across days. We provide quantitative results on data collected in an apple orchard, and demonstrate that our system is able to predict abscise rates within 3.5% of the current method with a 6 times improvement in speed, while requiring significantly less manual effort. Moreover, we provide results on images captured by a robotic system in the field, and discuss the next steps required to make the process fully autonomous.
△ Less
Submitted 6 December, 2023; v1 submitted 2 December, 2022;
originally announced December 2022.
-
3D Reconstruction-Based Seed Counting of Sorghum Panicles for Agricultural Inspection
Authors:
Harry Freeman,
Eric Schneider,
Chung Hee Kim,
Moonyoung Lee,
George Kantor
Abstract:
In this paper, we present a method for creating high-quality 3D models of sorghum panicles for phenoty** in breeding experiments. This is achieved with a novel reconstruction approach that uses seeds as semantic landmarks in both 2D and 3D. To evaluate the performance, we develop a new metric for assessing the quality of reconstructed point clouds without having a ground-truth point cloud. Final…
▽ More
In this paper, we present a method for creating high-quality 3D models of sorghum panicles for phenoty** in breeding experiments. This is achieved with a novel reconstruction approach that uses seeds as semantic landmarks in both 2D and 3D. To evaluate the performance, we develop a new metric for assessing the quality of reconstructed point clouds without having a ground-truth point cloud. Finally, a counting method is presented where the density of seed centers in the 3D model allows 2D counts from multiple views to be effectively combined into a whole-panicle count. We demonstrate that using this method to estimate seed count and weight for sorghum outperforms count extrapolation from 2D images, an approach used in most state of the art methods for seeds and grains of comparable size.
△ Less
Submitted 14 November, 2022;
originally announced November 2022.
-
Multidimensional Interactive Fixed-Effects
Authors:
Hugo Freeman
Abstract:
This paper studies a linear and additively separable model for multidimensional panel data of three or more dimensions with unobserved interactive fixed effects. Two approaches are considered to account for these unobserved interactive fixed-effects when estimating coefficients on the observed covariates. First, the model is embedded within the standard two-dimensional panel framework and restrict…
▽ More
This paper studies a linear and additively separable model for multidimensional panel data of three or more dimensions with unobserved interactive fixed effects. Two approaches are considered to account for these unobserved interactive fixed-effects when estimating coefficients on the observed covariates. First, the model is embedded within the standard two-dimensional panel framework and restrictions are derived under which the factor structure methods in Bai (2009) lead to consistent estimation of model parameters, but at potentially slow rates of convergence. The second approach utilises popular machine learning techniques to develop group fixed-effects and kernel weighted fixed-effects that are more robust to the multidimensional nature of the problem and can achieve the parametric rate of consistency under certain conditions. Theoretical results and simulations show the benefit of standard two-dimensional panel methods when the structure of the interactive fixed-effect term is known, but also highlight how the group fixed-effects and kernel methods perform well without knowledge of this structure. The methods are implemented to estimate the demand elasticity for beer under a handful of models for demand.
△ Less
Submitted 10 March, 2023; v1 submitted 23 September, 2022;
originally announced September 2022.
-
Positively Charged Additives Facilitate Incorporation in Inorganic Single Crystals
Authors:
Ouassef Nahi,
Alexander Broad,
Alexander N. Kulak,
Helen M. Freeman,
Shuheng Zhang,
Thomas D. Turner,
Lucien Roach,
Robert Darkins,
Ian J. Ford,
Fiona C. Meldrum
Abstract:
Incorporation of guest additives within inorganic single crystals offers a unique strategy for creating nanocomposites with tailored properties. While anionic additives have been widely used to control the properties of crystals, their effective incorporation remains a key challenge. Here, we show that cationic additives are an excellent alterative for the synthesis of nanocomposites, where they a…
▽ More
Incorporation of guest additives within inorganic single crystals offers a unique strategy for creating nanocomposites with tailored properties. While anionic additives have been widely used to control the properties of crystals, their effective incorporation remains a key challenge. Here, we show that cationic additives are an excellent alterative for the synthesis of nanocomposites, where they are shown to deliver exceptional levels of incorporation of up to 70 wt% of positively charged amino acids, polymer particles, gold nanoparticles, and silver nanoclusters within inorganic single crystals. This high additive loading endows the nanocomposites with new functional properties including plasmon coupling, bright fluorescence, and surface-enhanced Raman scattering (SERS). Cationic additives are also shown to outperform their acidic counterparts, where they are highly active in a wider range of crystal systems, owing to their outstanding colloidal stability in the crystallization media and strong affinity for the crystal surfaces. This work demonstrates that although often overlooked, cationic additives can make valuable crystallization additives to create composite materials with tailored composition-structure-property relationships. This versatile and straightforward approach advances the field of single-crystal composites and provides exciting prospects for the design and fabrication of new hybrid materials with tunable functional properties.
△ Less
Submitted 10 January, 2022;
originally announced January 2022.
-
Linear Panel Regressions with Two-Way Unobserved Heterogeneity
Authors:
Hugo Freeman,
Martin Weidner
Abstract:
We study linear panel regression models in which the unobserved error term is an unknown smooth function of two-way unobserved fixed effects. In standard additive or interactive fixed effect models the individual specific and time specific effects are assumed to enter with a known functional form (additive or multiplicative). In this paper, we allow for this functional form to be more general and…
▽ More
We study linear panel regression models in which the unobserved error term is an unknown smooth function of two-way unobserved fixed effects. In standard additive or interactive fixed effect models the individual specific and time specific effects are assumed to enter with a known functional form (additive or multiplicative). In this paper, we allow for this functional form to be more general and unknown. We discuss two different estimation approaches that allow consistent estimation of the regression parameters in this setting as the number of individuals and the number of time periods grow to infinity. The first approach uses the interactive fixed effect estimator in Bai (2009), which is still applicable here, as long as the number of factors in the estimation grows asymptotically. The second approach first discretizes the two-way unobserved heterogeneity (similar to what Bonhomme, Lamadon and Manresa 2021 are doing for one-way heterogeneity) and then estimates a simple linear fixed effect model with additive two-way grouped fixed effects. For both estimation methods we obtain asymptotic convergence results, perform Monte Carlo simulations, and employ the estimators in an empirical application to UK house price data.
△ Less
Submitted 12 August, 2022; v1 submitted 24 September, 2021;
originally announced September 2021.
-
3D Human Reconstruction in the Wild with Collaborative Aerial Cameras
Authors:
Cherie Ho,
Andrew Jong,
Harry Freeman,
Rohan Rao,
Rogerio Bonatti,
Sebastian Scherer
Abstract:
Aerial vehicles are revolutionizing applications that require capturing the 3D structure of dynamic targets in the wild, such as sports, medicine, and entertainment. The core challenges in develo** a motion-capture system that operates in outdoors environments are: (1) 3D inference requires multiple simultaneous viewpoints of the target, (2) occlusion caused by obstacles is frequent when trackin…
▽ More
Aerial vehicles are revolutionizing applications that require capturing the 3D structure of dynamic targets in the wild, such as sports, medicine, and entertainment. The core challenges in develo** a motion-capture system that operates in outdoors environments are: (1) 3D inference requires multiple simultaneous viewpoints of the target, (2) occlusion caused by obstacles is frequent when tracking moving targets, and (3) the camera and vehicle state estimation is noisy. We present a real-time aerial system for multi-camera control that can reconstruct human motions in natural environments without the use of special-purpose markers. We develop a multi-robot coordination scheme that maintains the optimal flight formation for target reconstruction quality amongst obstacles. We provide studies evaluating system performance in simulation, and validate real-world performance using two drones while a target performs activities such as jogging and playing soccer. Supplementary video: https://youtu.be/jxt91vx0cns
△ Less
Submitted 9 August, 2021;
originally announced August 2021.
-
Low-Rank Approximations of Nonseparable Panel Models
Authors:
Iván Fernández-Val,
Hugo Freeman,
Martin Weidner
Abstract:
We provide estimation methods for nonseparable panel models based on low-rank factor structure approximations. The factor structures are estimated by matrix-completion methods to deal with the computational challenges of principal component analysis in the presence of missing data. We show that the resulting estimators are consistent in large panels, but suffer from approximation and shrinkage bia…
▽ More
We provide estimation methods for nonseparable panel models based on low-rank factor structure approximations. The factor structures are estimated by matrix-completion methods to deal with the computational challenges of principal component analysis in the presence of missing data. We show that the resulting estimators are consistent in large panels, but suffer from approximation and shrinkage biases. We correct these biases using matching and difference-in-differences approaches. Numerical examples and an empirical application to the effect of election day registration on voter turnout in the U.S. illustrate the properties and usefulness of our methods.
△ Less
Submitted 3 March, 2021; v1 submitted 23 October, 2020;
originally announced October 2020.
-
Mechanism of saponite crystallization from a rapidly formed amorphous intermediate
Authors:
Rogier Besselink,
Tomasz M. Stawski,
Helen M. Freeman,
Joern Hoevelmann,
Dominique J. Tobler,
Liane G. Benning
Abstract:
Although clays are crucial mineral phases in Earth's weathering engine, it is unclear how they form in surface environments under (near-)ambient pressures and temperature. Most synthesis routes, attempting to give insights into the plausible mechanisms, rely on hydrothermal conditions, yet many geological studies showed that clays may actually form at moderate temperatures (< 100 deg. C) in most t…
▽ More
Although clays are crucial mineral phases in Earth's weathering engine, it is unclear how they form in surface environments under (near-)ambient pressures and temperature. Most synthesis routes, attempting to give insights into the plausible mechanisms, rely on hydrothermal conditions, yet many geological studies showed that clays may actually form at moderate temperatures (< 100 deg. C) in most terrestrial settings. Here, we present the mechanism of the low-temperature (25-95 deg. C) crystallization of a synthetic Mg-clay, saponite. We describe the pathway at the various sub-stages of the reaction, as we derived from high-energy X-ray diffraction, infrared spectroscopy and transmission electron microscopy data. Our results reveal that saponite crystallizes via a two stage process: 1) a rapid (several minutes) co-precipitation where ~20% of the available magnesium becomes incorporated into an aluminosilicate network followed by 2) a much slower crystallization mechanism (many hours to days) where the remaining magnesium becomes gradually incorporated into the growing saponite sheet structure.
△ Less
Submitted 19 June, 2020; v1 submitted 18 June, 2019;
originally announced June 2019.
-
Particle-mediated nucleation pathways are imprinted in the internal structure of calcium sulfate single crystals
Authors:
Tomasz M. Stawski,
Helen M. Freeman,
Alexander E. S. Van Driessche,
Jörn Hövelmann,
Rogier Besselink,
Richard Wirth,
Liane G. Benning
Abstract:
Calcium sulfate minerals are found under the form of three crystalline phases: gypsum (CaSO4.2H2O), bassanite (CaSO4.0.5H2O), and anhydrite (CaSO4). Due to its relevance in natural and industrial processes, the formation pathways of these calcium sulphate phases from aqueous solution have been the subject of intensive research. There is a growing body of literature, that calcium sulfate forms esse…
▽ More
Calcium sulfate minerals are found under the form of three crystalline phases: gypsum (CaSO4.2H2O), bassanite (CaSO4.0.5H2O), and anhydrite (CaSO4). Due to its relevance in natural and industrial processes, the formation pathways of these calcium sulphate phases from aqueous solution have been the subject of intensive research. There is a growing body of literature, that calcium sulfate forms essentially through a non-classical nanoparticle- or cluster-mediated crystallisation process. At the early stages of precipitation calcium sulfate crystals grow through the reorganization and coalescence of aggregates rather than through classical unit addition. Here, we show by using low-dose dark field (DF) transmission electron microscopy (TEM) and electron diffraction, that these re-structuring processes by no means continue until a near-perfectly homogeneous single crystal is obtained. Instead the growth process yields a final imperfect mesocrystal of the overall morphology resembling that of a single crystal, yet composed of smaller nano-domains. Hence, our data indicate that organic-free mesocrystal grown by a particle mediated-pathway may preserve a 'memory or 'imprint' of the non-classical growth process in the final crystal structure, something that has been largely overlooked until now. Furthermore, the nano-scale misalignment of the structural sub-units within crystals might propagate through the length-scales, and potentially is expressed macroscopically as misaligned zones/domains in large single crystals, e.g. as those observed in some of the giant crystals from the Naica Mine, Chihuahua, Mexico.
△ Less
Submitted 4 July, 2019; v1 submitted 7 December, 2018;
originally announced December 2018.
-
Soccer matches as experiments: how often does the 'best' team win?
Authors:
G. K. Skinner,
G. H. Freeman
Abstract:
Models in which the number of goals scored by a team in a soccer match follow a Poisson distribution, or a closely related one, have been widely discussed. We here consider a soccer match as an experiment to assess which of two teams is superior and examine the probability that the outcome of the experiment (match) truly represents the relative abilities of the two teams. Given a final score, it…
▽ More
Models in which the number of goals scored by a team in a soccer match follow a Poisson distribution, or a closely related one, have been widely discussed. We here consider a soccer match as an experiment to assess which of two teams is superior and examine the probability that the outcome of the experiment (match) truly represents the relative abilities of the two teams. Given a final score, it is possible by using a Bayesian approach to quantify the probability that it was or was not the case that 'the best team won'. For typical scores, the probability of a misleading result is significant. Modifying the rules of the game to increase the typical number of goals scored would improve the situation, but a level of confidence that would normally be regarded as satisfactory could not be obtained unless the character of the game was radically changed.
△ Less
Submitted 24 September, 2009;
originally announced September 2009.
-
An implementation of the Deutsch-Jozsa algorithm on a three-qubit NMR quantum computer
Authors:
N Linden H Barjat R Freeman
Abstract:
A new approach to the implementation of a quantum computer by high-resolution nuclear magnetic resonance (NMR) is described. The key feature is that two or more line-selective radio-frequency pulses are applied simultaneously. A three-qubit quantum computer has been investigated using the 400 MHz NMR spectrum of the three coupled protons in 2,3-dibromopropanoic acid. It has been employed to impl…
▽ More
A new approach to the implementation of a quantum computer by high-resolution nuclear magnetic resonance (NMR) is described. The key feature is that two or more line-selective radio-frequency pulses are applied simultaneously. A three-qubit quantum computer has been investigated using the 400 MHz NMR spectrum of the three coupled protons in 2,3-dibromopropanoic acid. It has been employed to implement the Deutsch-Jozsa algorithm for distinguishing between constant and balanced functions. The extension to systems containing more coupled spins is straightforward and does not require a more protracted experiment.
△ Less
Submitted 21 August, 1998;
originally announced August 1998.