Performing tasks in agriculture, such as fruit monitoring or harvesting, requires perceiving the objects’ spatial position. RGB-D cameras are limited under open-field environments due to lightning interferences. So, in this study, we state to answer the research question: “How can we use and control monocular sensors to perceive objects’ position in the 3D task space?” Towards this aim, we approached histogram filters (Bayesian discrete filters) to estimate the position of tomatoes in the tomato plant through the algorithm MonoVisual3DFilter. Two kernel filters were studied: the square kernel and the Gaussian kernel. The implemented algorithm was essayed in simulation, with and without Gaussian noise and random noise, and in a testbed at laboratory conditions. The algorithm reported a mean absolute error lower than 10 mm in simulation and 20 mm in the testbed at laboratory conditions with an assessing distance of about 0.5 m. So, the results are viable for real environments and should be improved at closer distances.

This paper presents a decentralized, cooperative, real-time avoidance control strategy for robotic manipulators. The proposed avoidance control law builds on the concepts of artificial potential field functions and provides tighter bounds on the minimum safe distance when compared to traditional potential-based controllers. Moreover, the proposed avoidance control law is given in analytical, continuous closed form, avoiding the use of optimization techniques and discrete algorithms, and is rigorously proven to guarantee collision avoidance at all times. Examples of planar and 3D manipulators with cylindrical links under the proposed avoidance control are given and compared with the traditional approach of modeling links and obstacles with multiple spheres. The results show that the proposed avoidance control law can achieve, in general, faster convergence, smaller tracking errors, and lower control torques than the traditional approach. Furthermore, we provide extensions of the avoidance control to robotic manipulators with bounded control torques.

When generating simultaneous joint movements of a humanoid with multiple degrees of freedom to replicate human-like movements, the approach of joint synergy can facilitate the generation of whole-body robotic movement with a reduced number of control inputs. However, the trade-off of minimizing control inputs and keeping characteristics of movements makes it difficult to improve movement performance in a simple control manner. In this paper, we introduce an approach by connecting and constraining these joints. It is inspired by the fascia network of the human body, which constrains the whole-body movements of a human. Compared to when only joint synergy is used, the effectiveness of the proposed method is verified by calculating the errors of joint positions of generated movements and human movements. The paper provides a detailed exploration of the proposed method, presenting simulation-experimental results that affirm its effectiveness in generated movements that closely resemble human movements. Furthermore, we provide one possible method on how these concepts can be implemented in actual robotic hardware, offering a pathway to improve movement control in humanoid robots within their mechanical limitations.

Kinematics remains one of the cornerstones of robotics, and over the decade, Robotica has been one of the venues in which groundbreaking work in kinematics has always been welcome. A number of works in the kinematics community have addressed metrics for rigid-body motions in multiple different venues. An essential feature of any distance metric is the triangle inequality. Here, relationships between the triangle inequality for kinematic metrics and so-called trace inequalities are established. In particular, we show that the Golden-Thompson inequality (a particular trace inequality from the field of statistical mechanics) which holds for Hermitian matrices remarkably also holds for restricted classes of real skew-symmetric matrices. We then show that this is related to the triangle inequality for $SO(3)$ and $SO(4)$ metrics.

Collaborative robotics is a field of growing industrial interest, within which understanding the energetic behavior of manipulators is essential. In this work, we present the electro-mechanical modeling of the UR5 e-series robot through the identification of its dynamics and electrical parameters. By means of the identified robot model, it is then possible to compute and optimize the energy consumption of the robot during prescribed trajectories. The proposed model is derived from data acquired from the robot controller during bespoke experimental tests, using model identification procedures and datasheet provided by manipulator, motors, and gearbox manufacturers. The entire procedure does not require the use of any additional sensor, so it can be easily replicated with an off-the-shelf manipulator, and applied to other robots of the same family.

This paper presents a concurrent optimization approach for the design and motion of a quadruped in order to achieve energy-efficient cyclic behaviors. Computational techniques are applied to improve the development of a novel quadruped prototype. The scale of the robot and its actuators are optimized for energy efficiency considering the complete actuator model including friction, torque, and bandwidth limitations. This method and the optimal bounding trajectories are tested on the first (non-optimized) prototype design iteration showing that our formulation produces a trajectory that (i) can be easily replayed on the real robot and (ii) reduces the power consumption w.r.t. hand-tuned motion heuristics. Power consumption is then optimized for several periodic tasks with co-design. Our results include, but are not limited to, a bounding and backflip task. It appears that, for jumping forward, robots with longer thighs perform better, while, for backflips, longer shanks are better suited. To explore the tradeoff between these different designs, a Pareto set is constructed to guide the next iteration of the prototype. On this set, we find a new design, which will be produced in future work, showing an improvement of at least 52% for each separate task.

This paper proposes a virtual reality-based dual-mode teleoperation architecture to assist human operators in remotely operating robotic manipulation systems in a safe and flexible way. The architecture, implemented via a finite state machine, enables the operator to switch between two operational modes: the Approach mode, where the operator indirectly controls the robotic system by specifying its target configuration via the immersive virtual reality (VR) interface, and the Telemanip mode, where the operator directly controls the robot end-effector motion via input devices. The two independent control modes have been tested along the task of reaching a glass on a table by a sample population of 18 participants. Two working groups have been considered to distinguish users with previous experience with VR technologies from the novices. The results of the user study presented in this work show the potential of the proposed architecture in terms of usability, both physical and mental workload, and user satisfaction. Finally, a statistical analysis showed no significant differences along these three metrics between the two considered groups demonstrating ease of use of the proposed architecture by both people with and with no previous experience in VR.

Autonomous navigation has been a long-standing research topic, and researchers have worked on many challenging problems in indoor and outdoor environments. One application area of navigation solutions is material handling in industrial environments. With Industry 4.0, the simple problem in traditional factories has evolved into the use of autonomous mobile robots within flexible production islands in a self-decision-making structure. Two main stages of such a navigation system are safe transportation of the vehicle from one point to another and reaching destinations at industrial standards. The main concern in the former is roughly determining the vehicle’s pose to follow the route, while the latter aims to reach the target with high accuracy and precision. Often, it may not be possible or require extra effort to satisfy requirements with a single localization method. Therefore, a multi-stage localization approach is proposed in this study. Particle filter-based large-scale localization approaches are utilized during the vehicle’s movement from one point to another, while scan-matching-based methods are used in the docking stage. The localization system enables the appropriate approach based on the vehicle’s status and task through a decision-making mechanism. The decision-making mechanism uses a similarity metric obtained through the correntropy criterion to decide when and how to switch from large-scale localization to precise localization. The feasibility and performance of the developed method are corroborated through field tests. These evaluations demonstrate that the proposed method accomplishes tasks with sub-centimeter and sub-degree accuracy and precision without affecting the operation of the navigation algorithms in real time.

This paper deals with generally routed, pre-bent cable-driven continuum robots (CCR). A CCR consists of a flexible backbone to which multiple disks are attached. Cables are passed through holes in the disk, and when pulled, the flexible backbone and the CCR can attain different shapes based on their routing and backbone configuration. An optimization-based approach, using minimization of strain energy, is shown to give good results for the pose and motion of the CCR and to determine contact with external objects. The pose, motion, and the contact obtained from the model are shown to match very well with experimental results obtained from a 3D-printed CCR. An algorithm is proposed to generate the pre-bent backbone for a CCR which on actuation can attain the desired shape. Using the algorithm, three 3D-printed CCRs with pre-bent backbones are fabricated and these are used to demonstrate a compliant gripper that can grip a spherical object similar to that done by tentacles, and another three-fingered gripper with straight backbone CCRs is used to orient a square object gripped at the end.

In this paper, an $\textrm{H}_{{\infty }}$ dynamic output feedback controller is experimentally implemented for the position regulation of a fully actuated tilted-rotor octocopter unmanned aerial vehicle (UAV) to improve wind disturbance rejection during station-keeping. To apply the lateral forces, besides the standard tilt-to-translate (attitude-thrust) movement, tilted-rotor UAVs can generate vectored (horizontal) thrust. Vectored-thrust is high-bandwidth but saturation-constrained, while attitude-thrust generates larger forces with lower bandwidth. For the first time, this paper emphasizes the frequency-dependent allocation of weighting matrices in $\textrm{H}_{{\infty }}$ control design based on the physical capabilities of the fully actuated UAV (vectored-thrust and attitude-thrust). A dynamic model of the tilted-rotor octocopter, including aerodynamic effects and rotor dynamics, is presented to design the controller. The proposed $\textrm{H}_{{\infty }}$ controller solves the frequency-dependent actuator allocation problem by augmenting the dynamic model with weighting transfer functions. This novel frequency-dependent allocation utilizes the attitude-thrust for low-frequency disturbances and vectored-thrust for high-frequency disturbances, which exploits the maximum potential of the fully actuated UAV. Several wind tunnel experiments are conducted to validate the model and wind disturbance rejection performance, and the results are compared to the baseline PX4 Autopilot controller on both the tilted-rotor and a planar octocopter. The $\textrm{H}_{{\infty }}$controller is shown to reduce station-keeping error by up to 50% for an actuator usage 25% higher in free-flight tests.

Dynamic simulations of the cable-driven parallel robots (CDPRs) with cable models closer to reality can predict the motions of moving platforms more accurately than those with idealisations. Hence, the present work proposes an efficient and modular computational framework for this purpose. The primary focus is on the developments required in the context of CDPRs actuated by moving the exit points of cables while the lengths are held constant. Subsequently, the framework is extended to those cases where simultaneous changes in the lengths of cables are employed. Also, the effects due to the inertia, stiffness and damping properties of the cables undergoing 3D motions are included in their dynamic models. The efficient recursive forward dynamics algorithms from the prior works are utilised to minimise the computational effort. Finally, the efficacy of the proposed framework and the need for such an inclusive dynamic model are illustrated by applying it to different application scenarios using the spatial $4$-$4$ CDPR as an example.

In recent years, many microrobots have been developed for search applications using swarms in places where humans cannot enter, such as disaster sites. Hexapod robots are suitable for moving over uneven terrain. In order to use micro-hexapod robots for swarm exploration, it is necessary to reduce the robot’s size while maintaining its rigidity. Herein, we propose a micro-hexapod with an SU-8 rigid frame that can be assembled from a single sheet. By applying the SU-8 coating as a structure to the hexapod and increasing the rigidity, the substrate size can be reduced to within 40 mm × 40 mm and the total length when assembled to approximately 30 mm. This enables the integration of the micro electromechanical systems (MEMS) process into small and inexpensive hexapod robots. In this study, we assembled the hexapod with a rigid frame from a sheet created using the MEMS process and evaluated the leg motion.

This paper explores and experimentally compares the effectiveness of robot-stopping approaches based on the speed and separation monitoring for improving fluency in collaborative robotics. In the compared approaches, a supervisory controller checks the distance between the bounding volumes enclosing human operator and robot and prevents potential collisions by determining the robot’s stop time and triggering a stop trajectory if necessary. The methods are tested on a Franka Emika robot with 7 degrees of freedom, involving 27 volunteer participants, who are asked to walk along assigned paths to cyclically intrude the robot workspace, while the manipulator is working. The experimental results show that scaling online the dynamic safety zones is beneficial for improving fluency of human-robot collaboration, showing significant statistical differences with respect to alternative approaches.

As the proportion of the elderly population in the USA expands, so will the demand for rehabilitation and social care, which play an important role in maintaining function and mediating motor and cognitive decline in older adults. The use of social robotics and telemedicine are each potential solutions but each have limitations. To address challenges with classical telemedicine for rehabilitation, we propose to use a social robot-augmented telepresence (SRAT), Flo, which was deployed for long-term use in a community-based rehabilitation facility catering to older adults. Our goals were to explore how clinicians and patients would use and respond to the robot during rehab interactions. In this pilot study, three clinicians were recruited and asked to rate usability after receiving training for operating the robot and two of them conducted multiple rehab interactions with their patients using the robot (eleven patients with cognitive impairment and/or motor impairment and 23 rehab sessions delivered via SRAT in total). We report on the experience of both therapists and patients after the interactions.

This paper systematically investigates a soft-rigid hybrid pneumatic actuator (SRHPA), which consists of a rigid-foldable twisting skeleton capable of a large range of helical motion and a soft bellows muscle with high linear driving force. Considering the unique varying-pitch helical motion of the foldable skeleton, the analytical model mapping the input force generated by the bellows muscle and output forces of the actuator is revealed and verified with a simulation of the force analysis. Prototypes of the actuator are developed by fabricating the twisting skeleton with multilayered aluminum composite panels and 3D-printing the bellows muscle with thermoplastic polyurethane (TPU) 95A filament. The static and dynamic performances of the prototypes are tested to validate the analytical modeling of output forces. Using the actuator as a module, a novel bipedal inchworm robot with four modules is developed and tested to demonstrate its adaptability in confined space by switching between the going-straight, the turning-around, and the rotating gaits. The hybrid actuator and the inchworm robot with zero onboard electronics have the potential to be deployed in extreme environments where pneumatically actuated systems are preferred over electrical machines and drives, such as in nuclear and explosive environments.

Accurate prediction for mechanisms’ dynamic responses has always been a challenging task for designers. For modeling easiness purposes, mechanisms’ synthesis and optimization have been mostly limited to rigid systems, making consequently the designer unable to vow that the manufactured mechanism satisfies the target responses. To address this limitation, flexible mechanism synthesis is aimed in this work. Two benchmark mechanisms being the core of myriad mechanical devices are of scope, mainly, the flexible slider-crank and the four-bar. In addition to the mechanism dimensions, materials properties have been embedded in the synthesis problem. Two responses are of interest for the slider-crank mechanism, the slider velocity, and the midpoint axial displacement for the flexible connecting rod. Whereas five responses have been compiled for the four-bar mechanism synthesis. A comparative analysis of seven optimization techniques to solve the synthesis problem for both mechanisms has been performed. Subsequently, an executable computer-aided design tool for mechanisms synthesis has been developed under MATLAB®. Numerical outcomes emphasize the limits of a single-response-based synthesis for a flexible mechanism. It has been proven that combining different responses alleviates possible error and fulfill high-accuracy requirement.

Differentially flat under-actuated robots are characterized by more degrees of freedom (DOF) than actuators: this makes possible the design of lightweight cheap robots with high dexterity. The main issue of such robots is the control of the passive joint, which requires accurate dynamic modeling of the robot.

Friction is usually discarded to simplify the models, especially in the case of low-speed trajectories. However, this simplification leads to oscillations of the end-effector about the final position, which are incompatible with fast and accurate motions.

This paper focuses on planar $n$-DOF serial robotic arms with $n-1$ actuated rotational joints plus one final passive rotational joint with stiffness and friction properties. These robots, if properly balanced, are differentially flat. When the non-actuated joint can be considered frictionless, differentially flat robots can be controlled in open loop, calculating the motor torques demanded by point-to-point motions. This paper extends the open-loop control to robots with a passive joint with viscous friction adopting a Laplace transform method. This method can be adopted by exploiting the particular structure of the equations of motion of differentially flat under-actuated robots in which the last equations are linear. Analytical expressions of the motor torques are obtained. The work is enriched by an experimental validation of a $2$-DOF under-actuated robot and by numerical simulations of the $2$- and $4$-DOF robots showing the suppression of unwanted oscillations.

Real-time and efficient path planning is critical for all robotic systems. In particular, it is of greater importance for industrial robots since the overall planning and execution time directly impact the cycle time and automation economics in production lines. While the problem may not be complex in static environments, classical approaches are inefficient in high-dimensional environments in terms of planning time and optimality. Collision checking poses another challenge in obtaining a real-time solution for path planning in complex environments. To address these issues, we propose an end-to-end learning-based framework viz., Path Planning and Collision checking Network (PPCNet). The PPCNet generates the path by computing waypoints sequentially using two networks: the first network generates a waypoint, and the second one determines whether the waypoint is on a collision-free segment of the path. The end-to-end training process is based on imitation learning that uses data aggregation from the experience of an expert planner to train the two networks, simultaneously. We utilize two approaches for training a network that efficiently approximates the exact geometrical collision checking function. Finally, the PPCNet is evaluated in two different simulation environments and a practical implementation on a robotic arm for a bin-picking application. Compared to the state-of-the-art path-planning methods, our results show significant improvement in performance by greatly reducing the planning time with comparable success rates and path lengths.

Flexible endoscopy is the gold standard modality for diagnosis and therapeutic intervention of various colorectal conditions. A high bar is currently set for any new technology to replace the current modern colonoscope, but limitations do exist. For a robotic system to gain acceptance, ideally a clear advantage over the established standard needs to be demonstrated. The application of robotic technology inspired by locomotion observed in animals has been demonstrated in many fields including colonoscopy. A myriad of novel concepts has been proposed, which can overcome the anatomical and technical challenges.

This review discusses novel and innovative examples of bioinspired robotic locomotion in the colon with a detailed comparison of studies alongside separating the discussion by animal sections of insect, marine and reptile locomotion. We also discuss the current advantages and challenges a bioinspired robot will bring to the colon.

Bioinspired robotics in the colon is an exciting field of research with the potential to improve upon current existing high standards of practice in colonoscopy. By addressing areas that the conventional colonoscope is weaker in, studies are demonstrating improvement upon current limitations of standard practice and providing an insight into new methods of engineering and fabrication. Focus on the technological, mechanical and regulatory barriers is key to achieve acceptance into standard practice and will allow the aspiration of a safe, low discomfort, low cost and potentially fully autonomous robotic colonoscope to be not too distant in the future of colonoscopy.

Motion planning for high-DOF multi-arm systems operating in complex environments remains a challenging problem, with many motion planning algorithms requiring evaluation of the minimum collision distance and its derivative. Because of the computational complexity of calculating the collision distance, recent methods have attempted to leverage data-driven machine learning methods to learn the collision distance. Because of the significant training dataset requirements for high-DOF robots, existing kernel-based methods, which require $O(N^2)$ memory and computation resources, where $N$ denotes the number of dataset points, often perform poorly. This paper proposes a new active learning method for learning the collision distance function that overcomes the limitations of existing methods: (i) the size of the training dataset remains fixed, with the dataset containing more points near the collision boundary as learning proceeds, and (ii) calculating collision distances in the higher-dimensional link $SE(3)^n$ configuration space – here $n$ denotes the number of links – leads to more accurate and robust collision distance function learning. Performance evaluations with high-DOF multi-arm robot systems demonstrate the advantages of the proposed active learning-based strategy vis-$\grave{\text{a}}$-vis existing learning-based methods.