-
Optimising robotic operation speed with edge computing over 5G networks: Insights from selective harvesting robots
Authors:
Usman A. Zahidi,
Arshad Khan,
Tsvetan Zhivkov,
Johann Dichtl,
Dom Li,
Soran Parsa,
Marc Hanheide,
Grzegorz Cielniak,
Elizabeth I. Sklar,
Simon Pearson,
Amir Ghalamzan
Abstract:
Selective harvesting by autonomous robots will be a critical enabling technology for future farming. Increases in inflation and shortages of skilled labour are driving factors that can help encourage user acceptability of robotic harvesting. For example, robotic strawberry harvesting requires real-time high-precision fruit localisation, 3D map** and path planning for 3-D cluster manipulation. Wh…
▽ More
Selective harvesting by autonomous robots will be a critical enabling technology for future farming. Increases in inflation and shortages of skilled labour are driving factors that can help encourage user acceptability of robotic harvesting. For example, robotic strawberry harvesting requires real-time high-precision fruit localisation, 3D map** and path planning for 3-D cluster manipulation. Whilst industry and academia have developed multiple strawberry harvesting robots, none have yet achieved human-cost parity. Achieving this goal requires increased picking speed (perception, control and movement), accuracy and the development of low-cost robotic system designs. We propose the edge-server over 5G for Selective Harvesting (E5SH) system, which is an integration of high bandwidth and low latency Fifth Generation (5G) mobile network into a crop harvesting robotic platform, which we view as an enabler for future robotic harvesting systems. We also consider processing scale and speed in conjunction with system environmental and energy costs. A system architecture is presented and evaluated with support from quantitative results from a series of experiments that compare the performance of the system in response to different architecture choices, including image segmentation models, network infrastructure (5G vs WiFi) and messaging protocols such as Message Queuing Telemetry Transport (MQTT) and Transport Control Protocol Robot Operating System (TCPROS). Our results demonstrate that the E5SH system delivers step-change peak processing performance speedup of above 18-fold than a stand-alone embedded computing Nvidia Jetson Xavier NX (NJXN) system.
△ Less
Submitted 1 July, 2024;
originally announced July 2024.
-
Multispectral Fine-Grained Classification of Blackgrass in Wheat and Barley Crops
Authors:
Madeleine Darbyshire,
Shaun Coutts,
Eleanor Hammond,
Fazilet Gokbudak,
Cengiz Oztireli,
Petra Bosilj,
Junfeng Gao,
Elizabeth Sklar,
Simon Parsons
Abstract:
As the burden of herbicide resistance grows and the environmental repercussions of excessive herbicide use become clear, new ways of managing weed populations are needed. This is particularly true for cereal crops, like wheat and barley, that are staple food crops and occupy a globally significant portion of agricultural land. Even small improvements in weed management practices across these major…
▽ More
As the burden of herbicide resistance grows and the environmental repercussions of excessive herbicide use become clear, new ways of managing weed populations are needed. This is particularly true for cereal crops, like wheat and barley, that are staple food crops and occupy a globally significant portion of agricultural land. Even small improvements in weed management practices across these major food crops worldwide would yield considerable benefits for both the environment and global food security. Blackgrass is a major grass weed which causes particular problems in cereal crops in north-west Europe, a major cereal production area, because it has high levels of of herbicide resistance and is well adapted to agronomic practice in this region. With the use of machine vision and multispectral imaging, we investigate the effectiveness of state-of-the-art methods to identify blackgrass in wheat and barley crops. As part of this work, we provide a large dataset with which we evaluate several key aspects of blackgrass weed recognition. Firstly, we determine the performance of different CNN and transformer-based architectures on images from unseen fields. Secondly, we demonstrate the role that different spectral bands have on the performance of weed classification. Lastly, we evaluate the role of dataset size in classification performance for each of the models trialled. We find that even with a fairly modest quantity of training data an accuracy of almost 90% can be achieved on images from unseen fields.
△ Less
Submitted 3 May, 2024;
originally announced May 2024.
-
Computational Argumentation-based Chatbots: a Survey
Authors:
Federico Castagna,
Nadin Kokciyan,
Isabel Sassoon,
Simon Parsons,
Elizabeth Sklar
Abstract:
Chatbots are conversational software applications designed to interact dialectically with users for a plethora of different purposes. Surprisingly, these colloquial agents have only recently been coupled with computational models of arguments (i.e. computational argumentation), whose aim is to formalise, in a machine-readable format, the ordinary exchange of information that characterises human co…
▽ More
Chatbots are conversational software applications designed to interact dialectically with users for a plethora of different purposes. Surprisingly, these colloquial agents have only recently been coupled with computational models of arguments (i.e. computational argumentation), whose aim is to formalise, in a machine-readable format, the ordinary exchange of information that characterises human communications. Chatbots may employ argumentation with different degrees and in a variety of manners. The present survey sifts through the literature to review papers concerning this kind of argumentation-based bot, drawing conclusions about the benefits and drawbacks that this approach entails in comparison with standard chatbots, while also envisaging possible future development and integration with the Transformer-based architecture and state-of-the-art Large Language models.
△ Less
Submitted 7 January, 2024;
originally announced January 2024.
-
Hierarchical Mask2Former: Panoptic Segmentation of Crops, Weeds and Leaves
Authors:
Madeleine Darbyshire,
Elizabeth Sklar,
Simon Parsons
Abstract:
Advancements in machine vision that enable detailed inferences to be made from images have the potential to transform many sectors including agriculture. Precision agriculture, where data analysis enables interventions to be precisely targeted, has many possible applications. Precision spraying, for example, can limit the application of herbicide only to weeds, or limit the application of fertilis…
▽ More
Advancements in machine vision that enable detailed inferences to be made from images have the potential to transform many sectors including agriculture. Precision agriculture, where data analysis enables interventions to be precisely targeted, has many possible applications. Precision spraying, for example, can limit the application of herbicide only to weeds, or limit the application of fertiliser only to undernourished crops, instead of spraying the entire field. The approach promises to maximise yields, whilst minimising resource use and harms to the surrounding environment. To this end, we propose a hierarchical panoptic segmentation method to simultaneously identify indicators of plant growth and locate weeds within an image. We adapt Mask2Former, a state-of-the-art architecture for panoptic segmentation, to predict crop, weed and leaf masks. We achieve a PQ† of 75.99. Additionally, we explore approaches to make the architecture more compact and therefore more suitable for time and compute constrained applications. With our more compact architecture, inference is up to 60% faster and the reduction in PQ† is less than 1%.
△ Less
Submitted 10 October, 2023;
originally announced October 2023.
-
A Variable Autonomy approach for an Automated Weeding Platform
Authors:
Ionut Moraru,
Tsvetan Zhivkov,
Shaun Coutts,
Dom Li,
Elizabeth I. Sklar
Abstract:
Climate change, increase in world population and the war in Ukraine have led nations such as the UK to put a larger focus on food security, while simultaneously trying to halt declines in biodiversity and reduce risks to human health posed by chemically-reliant farming practices. Achieving these goals simultaneously will require novel approaches and accelerating the deployment of Agri-Robotics fro…
▽ More
Climate change, increase in world population and the war in Ukraine have led nations such as the UK to put a larger focus on food security, while simultaneously trying to halt declines in biodiversity and reduce risks to human health posed by chemically-reliant farming practices. Achieving these goals simultaneously will require novel approaches and accelerating the deployment of Agri-Robotics from the lab and into the field. In this paper we describe the ARWAC robot platform for mechanical weeding. We explain why the mechanical weeding approach is beneficial compared to the use of pesticides for removing weeds from crop fields. Thereafter, we present the system design and processing pipeline for generating a course of action for the robot to follow, such that it removes as many weeds as possible. Finally, we end by proposing a trust-based ladder of autonomy that will be used, based on the users' confidence in the robot system.
△ Less
Submitted 9 March, 2023;
originally announced March 2023.
-
5G on the Farm: Evaluating Wireless Network Capabilities for Agricultural Robotics
Authors:
Tsvetan Zhivkov,
Elizabeth I. Sklar
Abstract:
Global food security is an issue that is fast becoming a critical matter in the world today. Global warming, climate change and a range of other impacts caused by humans, such as carbon emissions, sociopolitical and economical challenges (e.g. war), traditional workforce/labour decline and population growth are straining global food security. The need for high-speed and reliable wireless communica…
▽ More
Global food security is an issue that is fast becoming a critical matter in the world today. Global warming, climate change and a range of other impacts caused by humans, such as carbon emissions, sociopolitical and economical challenges (e.g. war), traditional workforce/labour decline and population growth are straining global food security. The need for high-speed and reliable wireless communication in agriculture is becoming more of a necessity rather than a technological demonstration or showing superiority in the field. Governments and industries around the world are seeing more urgency in establishing communication infrastructure to scale up agricultural activities and improve sustainability, by employing autonomous agri-robotics and agri-technologies. The work presented here evaluates the physical performance of 5G in an agri-robotics application, and the results are compared against 4G and WiFi6 (a newly emerging wireless communication standard), which are typically used in agricultural environments. In addition, a series of simulation experiments were performed to assess the ``real-time'' operational delay in critical tasks that may require a human-in-the-loop to support decision making. The results lead to the conclusion that 4G cannot be used in the agricultural domain for applications that require high throughput and reliable communication between robot and user. Moreover, a single wireless solution does not exist for the agricultural domain, but instead multiple solutions can be combined to meet the necessary telecommunications requirements. Finally, the results show that 5G greatly outperforms 4G in all performance metrics, and on average only 18.2ms slower than WiFi6 making it very reliable.
△ Less
Submitted 9 December, 2022;
originally announced January 2023.
-
Towards practical object detection for weed spraying in precision agriculture
Authors:
Adrian Salazar-Gomez,
Madeleine Darbyshire,
Junfeng Gao,
Elizabeth I Sklar,
Simon Parsons
Abstract:
The evolution of smaller, faster processors and cheaper digital storage mechanisms across the last 4-5 decades has vastly increased the opportunity to integrate intelligent technologies in a wide range of practical environments to address a broad spectrum of tasks. One exciting application domain for such technologies is precision agriculture, where the ability to integrate on-board machine vision…
▽ More
The evolution of smaller, faster processors and cheaper digital storage mechanisms across the last 4-5 decades has vastly increased the opportunity to integrate intelligent technologies in a wide range of practical environments to address a broad spectrum of tasks. One exciting application domain for such technologies is precision agriculture, where the ability to integrate on-board machine vision with data-driven actuation means that farmers can make decisions about crop care and harvesting at the level of the individual plant rather than the whole field. This makes sense both economically and environmentally. However, the key driver for this capability is fast and robust machine vision -- typically driven by machine learning (ML) solutions and dependent on accurate modelling. One critical challenge is that the bulk of ML-based vision research considers only metrics that evaluate the accuracy of object detection and do not assess practical factors. This paper introduces three metrics that highlight different aspects relevant for real-world deployment of precision weeding and demonstrates their utility through experimental results.
△ Less
Submitted 22 September, 2021;
originally announced September 2021.
-
Current and Emergent Economic Impacts of Covid-19 and Brexit on UK Fresh Produce and Horticultural Businesses
Authors:
Lilian Korir,
Archie Drake,
Martin Collison,
Tania Carolina Camacho-Villa,
Elizabeth Sklar,
Simon Pearson
Abstract:
This paper describes a study designed to investigate the current and emergent impacts of Covid-19 and Brexit on UK horticultural businesses. Various characteristics of UK horticultural production, notably labour reliance and import dependence, make it an important sector for policymakers concerned to understand the effects of these disruptive events as we move from 2020 into 2021. The study design…
▽ More
This paper describes a study designed to investigate the current and emergent impacts of Covid-19 and Brexit on UK horticultural businesses. Various characteristics of UK horticultural production, notably labour reliance and import dependence, make it an important sector for policymakers concerned to understand the effects of these disruptive events as we move from 2020 into 2021. The study design prioritised timeliness, using a rapid survey to gather information from a relatively small (n = 19) but indicative group of producers. The main novelty of the results is to suggest that a very substantial majority of producers either plan to scale back production in 2021 (47%) or have been unable to make plans for 2021 because of uncertainty (37%). The results also add to broader evidence that the sector has experienced profound labour supply challenges, with implications for labour cost and quality. The study discusses the implications of these insights from producers in terms of productivity and automation, as well as in terms of broader economic implications. Although automation is generally recognised as the long-term future for the industry (89%), it appeared in the study as the second most referred short-term option (32%) only after changes to labour schemes and policies (58%). Currently, automation plays a limited role in contributing to the UK's horticultural workforce shortage due to economic and socio-political uncertainties. The conclusion highlights policy recommendations and future investigative intentions, as well as suggesting methodological and other discussion points for the research community.
△ Less
Submitted 27 January, 2021;
originally announced January 2021.
-
The Application of Market-based Multi-Robot Task Allocation to Ambulance Dispatch
Authors:
Eric Schneider,
Marcus Poulton,
Archie Drake,
Leanne Smith,
George Roussos,
Simon Parsons,
Elizabeth I Sklar
Abstract:
Multi-Robot Task Allocation (MRTA) is the problem of distributing a set of tasks to a team of robots with the objective of optimising some criteria, such as minimising the amount of time or energy spent to complete all the tasks or maximising the efficiency of the team's joint activity. The exploration of MRTA methods is typically restricted to laboratory and field experimentation. There are few e…
▽ More
Multi-Robot Task Allocation (MRTA) is the problem of distributing a set of tasks to a team of robots with the objective of optimising some criteria, such as minimising the amount of time or energy spent to complete all the tasks or maximising the efficiency of the team's joint activity. The exploration of MRTA methods is typically restricted to laboratory and field experimentation. There are few existing real-world models in which teams of autonomous mobile robots are deployed "in the wild", e.g., in industrial settings. In the work presented here, a market-based MRTA approach is applied to the problem of ambulance dispatch, where ambulances are allocated in respond to patients' calls for help. Ambulances and robots are limited (and perhaps scarce), specialised mobile resources; incidents and tasks represent time-sensitive, specific, potentially unlimited, precisely-located demands for the services which the resources provide. Historical data from the London Ambulance Service describing a set of more than 1 million (anonymised) incidents are used as the basis for evaluating the predicted performance of the market-based approach versus the current, largely manual, method of allocating ambulances to incidents. Experimental results show statistically significant improvement in response times when using the market-based approach.
△ Less
Submitted 11 March, 2020;
originally announced March 2020.
-
A semi-autonomous approach to connecting proprietary EHR standards to FHIR
Authors:
Martin Chapman,
Vasa Curcin,
Elizabeth I Sklar
Abstract:
HL7's Fast Healthcare Interoperability Resources (FHIR) standard is designed to provide a consistent way in which to represent and exchange healthcare data, such as electronic health records (EHRs). SMART--on--FHIR (SoF) technology uses this standard to augment existing healthcare data systems with a standard FHIR interface. While this is an important goal, little attention has been paid to develo…
▽ More
HL7's Fast Healthcare Interoperability Resources (FHIR) standard is designed to provide a consistent way in which to represent and exchange healthcare data, such as electronic health records (EHRs). SMART--on--FHIR (SoF) technology uses this standard to augment existing healthcare data systems with a standard FHIR interface. While this is an important goal, little attention has been paid to develo** mechanisms that convert EHR data structured using proprietary schema to the FHIR standard, in order to be served by such an interface. In this paper, a formal process is proposed that both identifies a set of FHIR resources that best capture the elements of an EHR, and transitions the contents of that EHR to FHIR, with a view to supporting the operation of SoF containers, and the wider interoperability of health records with the FHIR standard. This process relies on a number of techniques that enable us to understand when two terms are equivalent, in particular a set of similarity metrics, which are combined along with a series of parameters in order to enable the approach to be tuned to the different EHR standards encountered. Thus, when realised in software, the translation process is semi-autonomous, requiring only the specification of these parameters before performing an arbitrary number of future conversions. The approach is demonstrated by utilising it as part of the CONSULT project, a wider decision support system that aims to provide intelligent decision support for stroke patients.
△ Less
Submitted 23 January, 2020; v1 submitted 27 November, 2019;
originally announced November 2019.
-
Longitudinal Analysis of Discussion Topics in an Online Breast Cancer Community using Convolutional Neural Networks
Authors:
Shaodian Zhang,
Edouard Grave,
Elizabeth Sklar,
Noemie Elhadad
Abstract:
Identifying topics of discussions in online health communities (OHC) is critical to various applications, but can be difficult because topics of OHC content are usually heterogeneous and domain-dependent. In this paper, we provide a multi-class schema, an annotated dataset, and supervised classifiers based on convolutional neural network (CNN) and other models for the task of classifying discussio…
▽ More
Identifying topics of discussions in online health communities (OHC) is critical to various applications, but can be difficult because topics of OHC content are usually heterogeneous and domain-dependent. In this paper, we provide a multi-class schema, an annotated dataset, and supervised classifiers based on convolutional neural network (CNN) and other models for the task of classifying discussion topics. We apply the CNN classifier to the most popular breast cancer online community, and carry out a longitudinal analysis to show topic distributions and topic changes throughout members' participation. Our experimental results suggest that CNN outperforms other classifiers in the task of topic classification, and that certain trajectories can be detected with respect to topic changes.
△ Less
Submitted 7 April, 2016; v1 submitted 28 March, 2016;
originally announced March 2016.
