In scenarios such as environmental data collection and traffic monitoring, timely responses to real-time situations are facilitated by persistently accessing nodes with revisiting constraints using unmanned aerial vehicles (UAVs). However, imbalanced task allocation may pose risks to the safety of UAVs and potentially lead to failures in monitoring tasks. For instance, continuous visits to nodes without replenishment may damage UAV batteries, while delays in recharging could result in missing task deadlines, ultimately causing task failures. Therefore, this study investigates the problem of achieving balanced multi-UAV path planning for persistent monitoring tasks, which has not been previously researched according to the authors’ knowledge. The main contribution of this study is the proposal of two novel indicators to assist in balancing task allocation regarding multi-UAV path planning for persistent monitoring. One of the indicators is namely the waiting factor, which reflects the urgency of a task node waiting to be accessed, and the other is the difficulty level which is introduced to measure the difficulty of tasks undertaken by a UAV. By minimizing differences in difficulty level among UAVs, we can ensure equilibrium in task allocation. For a single UAV, the ant colony initialized genetic algorithm (ACIGA) has been proposed to plan its path and obtain its difficulty level. For multiple UAVs, the K-means clustering algorithm has been improved based on difficulty levels to achieve balanced task allocation. Simulation experiments demonstrated that the difficulty level could effectively reflect the difficulty of tasks and that the proposed algorithms could enable UAVs to achieve balanced task allocation.

In response to the complex and challenging task of long-distance inspection of small-diameter and variable-diameter mine holes, this paper presents a design for an adaptive small-sized mine hole robot. First, focusing on the environment of small-diameter mine holes, the paper analyzes the robot’s functions and overall structural framework. A two-wheeled wall-pressing robot with good mobility, arranged in a straight line, is designed. Furthermore, an adaptive variable-diameter method is devised, which involves constructing an adaptive variable-diameter model and proposing a control method based on position and force estimators, enabling the robot to perceive external forces. Lastly, to verify the feasibility of the structural design and adaptive variable-diameter method, performance tests and analyses are conducted on the robot’s mobility and adaptive variable-diameter capabilities. Experimental results demonstrate that the robot can move within small-diameter mine holes at any inclination angle, with a maximum horizontal crawling speed of 3.96 m/min. By employing the adaptive variable-diameter method, the robot can smoothly navigate convex platform obstacles and slope obstacles in mine holes with diameters ranging from 70 mm to 100 mm, achieving the function of adaptive variable-diameter within 2 s. Thus, it can meet the requirements of moving inside mine holes under complex conditions such as steep slopes and small and variable diameters.

The inverse dynamics model of an industrial robot can predict and control the robot’s motion and torque output, improving its motion accuracy, efficiency, and adaptability. However, the existing inverse rigid body dynamics models still have some unmodelled residuals, and their calculation results differ significantly from the actual industrial robot conditions. The bootstrap aggregating (bagging) algorithm is combined with a long short-term memory network, the linear layer is introduced as the network optimization layer, and a compensation method of hybrid inverse dynamics model for robots based on the BLL residual prediction algorithm is proposed to meet the above needs. The BLL residual prediction algorithm framework is presented. Based on the rigid body inverse dynamics of the Newton–Euler method, the BLL residual prediction network is used to perform error compensation on the inverse dynamics model of the Franka robot. The experimental results show that the hybrid inverse dynamics model based on the BLL residual prediction algorithm can reduce the average residuals of the robot joint torque from 0.5651 N·m to 0.1096 N·m, which improves the accuracy of the inverse dynamics model compared with those of the rigid body inverse dynamics model. This study lays the foundation for performing more accurate operation tasks using industrial robots.

In this paper, a novel fast nonsingular integral terminal sliding mode controller based on an adaptive neural network (ANN-FNITSMC) is proposed for the trajectory tracking control of cable-driven continuum robots (CDCRs) in complex underwater environments with uncertainties. First, a novel fast nonsingular integral terminal sliding mode control (FNITSMC) is designed to solve the chattering and singularity problems of the conventional terminal sliding mode control (TSMC). Second, an adaptive neural network (ANN) based on a radial basis function (RBF) is established to derive the uncertainties and compensate for the control input of CDCRs, enabling high-stable accuracy and strong robustness trajectory tracking in complex underwater environments. Simulation results are presented to demonstrate the high accuracy and strong robustness of the ANN-FNITSMC. Finally, the high accuracy, high stability, and strong robustness of the proposed trajectory tracking strategy are verified through an underwater experiment platform.

This paper presents the novel concept of a singularity-free tube (SFT) in the constant orientation workspace of a spatial parallel manipulator. The concept is developed and demonstrated in the context of a $6$-$6$ spatial parallel manipulator, namely, the semi-regular Stewart platform manipulator. Given two points in the said workspace, the SFT is a tubular volume which contains these points and is free of gain-type or forward-kinematic singularities. The purpose of identifying such regions in space is to allow abundant freedom to the path-planner to connect the said points by a path, which can be free of gain-type singularities simply by remaining inside the SFT at all times. To demonstrate the concept, two smooth paths obtained by formulating two different optimisation problems have been presented as examples. The SFT can be of great help in singularity-free path-planning in many similar manipulators.

In this work, we propose a novel approach for tomato pollination that utilizes visual servo control. The objective is to meet the growing demand for automated robotic pollinators to overcome the decline in bee populations. Our approach focuses on addressing this challenge by leveraging visual servo control to guide the pollination process. The proposed method leverages deep learning to estimate the orientations and depth of detected flower, incorporating CAD-based synthetic images to ensure dataset diversity. By utilizing a 3D camera, the system accurately estimates flower depth information for visual servoing. The robustness of the approach is validated through experiments conducted in a laboratory environment with a 3D printed tomato flower plant. The results demonstrate a high detection rate, with a mean average precision of 91.2 %. Furthermore, the average depth error for accurately localizing the pollination target is impressively minimal, measuring only 1.1 cm. This research presents a promising solution for tomato pollination, showcasing the effectiveness of visual-guided servo control and its potential to address the challenges posed by diminishing bee populations in greenhouses.

Gripping devices for harvesting fruits have such types of work as cutting, tearing and unscrewing. For apples, it is preferable to use slicing or unscrewing, while the fruit leg should not remain, damaging the apple during storage. In this article, we are developing a grab for harvesting apples. The gripper is used both for holding the fruit and for jamming, followed by unscrewing. One of the advantages is that the proposed method of collecting apples allows you not to waste time moving the manipulator from the tree to the basket, but only to grab and tear them off. The fruit enters the gripper device; after which it enters the fruit collection container through a rigid or flexible pipe. The gripper device is built on the basis of a ball-screw transmission, which is supplemented by a gear drive along the helical surface. This allows for rotation and rectilinear movement of the held fruit. The gripping device has a ratchet mechanism that allows you to fix the fruit. A mathematical model of the gripper device has been developed, which allows determining the torque of the engine depending on the position of the fingers. The parameters of the mechanism were optimized using a genetic algorithm, and the results are presented in the form of a Pareto set. A 3D model of the gripper device has been built and a layout has been developed using 3D printing. Experimental laboratory and field tests of the gripping device were carried out.

The cable-driven parallel mechanism (CDPM) is known as an interesting application in industry to pick and place objects owing to its advantages such as large workspaces. In addition to the advantages of this mechanism, there are some challenges to improving performance by considering constraints in different components, such as the behavior of cables, shape, size of the end effector and base, and model of pulleys and actuators. Moreover, the impact of online geometry reconfiguration must be analyzed. This paper demonstrates the impact of these constraints on the performance of reconfigurable CDPM. The methodology is based on the systematic review and meta-analysis guidelines to report the results. The databases used to find the papers are extracted from Scopus and Google Scholar, using related keywords. As a result, the impact of physical constraints on system performance is discussed. A total of 90 and 37 articles are selected, respectively. After removing duplicates and unrelated papers, 88 studies that met the inclusion criteria are selected for review. Even when considering the physical constraints in modeling the mechanism, simplifications in designing a model for the reconfigurable CDPM generate errors. There is a gap in designing high-performance controllers to track desired trajectories while reconfiguring the geometry, and the satisfaction of physical constraints needs to be satisfied. In conclusion, this review presents several constraints in designing a controller to track desired trajectories and improve performance in future work. This paper presents an integrated controller architecture that includes physical constraints and predictive control.

Imitation from Observation (IfO) prompts the robot to imitate tasks from unlabeled videos via reinforcement learning (RL). The performance of the IfO algorithm depends on its ability to extract task-relevant representations since images are informative. Existing IfO algorithms extract image representations by using a simple encoding network or pre-trained network. Due to the lack of action labels, it is challenging to design a supervised task-relevant proxy task to train the simple encoding network. Representations extracted by a pre-trained network such as Resnet are often task-irrelevant. In this article, we propose a new approach for robot IfO via multimodal observations. Different modalities describe the same information from different sides, which can be used to design an unsupervised proxy task. Our approach contains two modules: the unsupervised cross-modal representation (UCMR) module and a self-behavioral cloning (self-BC)-based RL module. The UCMR module learns to extract task-relevant representations via a multimodal unsupervised proxy task. The Self-BC for further offline policy optimization collects successful experiences during the RL training. We evaluate our approach on the real robot pouring water task, quantitative pouring task, and pouring sand task. The robot achieves state-of-the-art performance.

Maintaining object grasp stability represents a pivotal challenge within the domain of robotic manipulation and upper-limb prosthetics. Perturbations originating from external sources frequently disrupt the stability of grasps, resulting in slippage occurrences. Also, if the grasping forces are not optimal while controlling the slip, it may result in the deformation of the objects. This study investigates the robustification of a reinforcement learning (RL) policy for implementing intelligent bionic reflex control, i.e., slip and deformation prevention of the grasped objects. RL-derived policies are vulnerable to failures in environments characterized by dynamic variability. To mitigate this vulnerability, we propose a methodology involving the incorporation of an adaptive sliding mode controller into a pre-trained RL policy. By exploiting the inherent invariance property of the sliding mode algorithm in the presence of uncertainties, our approach strengthens the robustness of the RL policies against diverse and dynamic variations. Numerical simulations substantiate the efficacy of our approach in robustifying RL policies trained within simulated environments.

Continuum robots offer unique advantages in performing tasks within extremely confined environments due to their exceptional dexterity and adaptability. However, their soft materials and elastic structures inherently introduce nonlinearity and shape instability, especially when the robot encounters external contact forces. To address these challenges, this paper presents a comprehensive model and experimental study to estimate the shape deformation of a switchable rigid-continuum robot (SRC-Bot). The kinematic analysis is first conducted to specify the degrees of freedom (DoF) and basic motions of SRC-Bot, including motion of bending, rotating, and elongating. This analysis assumes that the curvature varies along the central axis and maps the relationship between joint space and driven space. Subsequently, an equivalence concept is proposed to unify the stiffness addressing each DoF, which is then utilized in the establishment of the dynamic model. According to the mechanical structural design, the deformed posture of SRC-Bot is discretized into five segments, corresponding to the distribution of the guiders. The dynamics model is then derived using Newton’s second law and Euler’s method to simulate the deformation under gravity, friction, and external forces. Additionally, the stiffness in three directions is quantified through an identification process to complete the theoretical model. Furthermore, a series of experiments are conducted and compared with simulated results to validate the response and deformed behavior of SRC-Bot. The comparative results demonstrate that the proposed model-based simulation accurately captures the deformable characteristics of the robot, encompassing both static deformed postures and dynamic time-domain responses induced by external and actuation forces.

This study focuses on the kinematic and dynamic modeling of a wheeled-legged robot (WLR), taking into account kinematic and dynamic slippage. In this regard, the Gibbs–Appell formulation was utilized to derive dynamic equations. Determining the slippage in the wheels for movement equations is a challenging task due to its dependency on factors such as the robot’s postures, velocities, and surface characteristics. To address this challenge, machine vision was used to quantify the slippage of the wheels on the body based on the pose estimation method. This data served as input for movement equations to analyze the robot’s deviation from its path and posture. In the following, the robot’s movement was simulated using Webots and MATLAB, followed by various experimental tests involving acceleration and changes in leg angles on the WLR. The results were then compared to the simulations to demonstrate the accuracy of the developed system modeling. Additionally, an IMU sensor was utilized to measure the robot’s motion and validate against machine vision data. The findings revealed that neglecting the slippage of the wheels in the robot’s motion modeling resulted in errors ranging from 5% to 11.5%. Furthermore, lateral slippage ranging from 1.1 to 5.2 cm was observed in the robot’s accelerated movement. This highlights the importance of including lateral slippage in the equations for a more precise modeling of the robot’s behavior.

Continuum robot-based surgical systems are becoming an effective tool for minimally invasive surgery. A flexible, dexterous, and compact robot structure is suitable for carrying out complex surgical operations. In this paper, we propose performance metrics for dexterity based on data density. Data density at a point in the workspace is higher if the number of reachable points is higher, with a unique configuration lying in a small square box around a point. The computation of these metrics is performed with forward kinematics using the Monte Carlo method and, hence, is computationally efficient. The data density at a particular point is a measure of dexterity at that point. In contrast, the dexterity distribution property index is a measure of how well dexterity is distributed across the workspace according to desired criteria. We compare the dexterity distribution property index across the workspace with the dexterity index based on the dexterous solid angle and manipulability-based approach. A comparative study reveals that the proposed method is simple and straightforward because it uses only the position of the reachable point as the input parameter. The method can quantify and compare the performance of different geometric designs of hyper-redundant and multisegment continuum robots based on dexterity.

This paper proposes a seat support mechanism to solve the problem of misalignment between the chest examination and probe scanning areas when the patient is bent in a seated-style echocardiography robot. To guide the patient to an appropriate body position where their chest is within the examination range of the chest examination unit while minimizing the physical load of the patient, the posture of the patient must satisfy the three following conditions. (i) The breech must be in contact with the seat surface, (ii) the legs must be vertical to the floor, and (iii) the chest and mechanism must be parallel while the probe scanning and chest examination ranges must match. The human body was modeled to derive a posture that satisfies the aforementioned conditions for the height of each individual, and a seat support mechanism with four degrees of freedom was installed to guide the user to the derived posture. By installing this mechanism, the body load of the left biceps brachii, right biceps brachii, left latissimus dorsi, and right latissimus dorsi was reduced to 64.7%, 52.7%, 86.4%, and 80.2%, respectively. The sharpness of the image contours was improved to 103.8%.

Motion assistance for elderly people is a field of application for service robotic systems that can be characterized by requirements and constraints of human–machine interaction and by the specificity of the user’s conditions. The main aspects of characterization and constraints are examined for the application of service systems that can be specifically conceived or adapted for elderly motion assistance by having to consider conditions of motion deficiency and muscular strength weakness as well as psychological aptitudes of users. The analysis is discussed in general terms with reference to elderly people who may not even suffer from specific pathologies. Therefore, the discussion focuses on the need for motion exercise in proper environments, including domestic ones and frame familiar to a user. The challenges of such applications oriented toward elderly users are discussed as requiring research and design of solutions in terms of specific portability, user-oriented operation, low costs, and clinical-physiotherapeutic functionality. Results of the author’s team experiences are presented as an example of problems and attempted solutions to meet the new challenges of service systems for motion assistance applications for elderly people.

This paper presents an eight wire-driven parallel robot (WDPR-8) designed to serve as a suspension manipulator for aircraft models during wind tunnel testing. The precision of these tests is significantly influenced by the system’s stability and workspace, both of which are shaped by the geometric configuration of the structure and the tension in the wires. To acquire the efficiency principle of the suspension scheme design for the model, a kinematics model for a WDPR-8 was established. Based on the kinematics model, the stiffness of a WDPR-8 was theoretically studied, and the analytical expression of stiffness matrix of a WDPR was deduced. The stiffness matrix was composed of two terms, one of which is determined by the configuration of suspension system and the other term is determined by the wire tension. Based on the analysis result, a set of suspension scheme was discussed under the calculation of stiffness matrix and workspace analysis. In the discussion process, in addition to the stiffness-maximum calculation, another criterion as force closure is presented, which is useful for increasing the stiffness and workspace of the robot. Finally, a prototype was established according to the analysis result, and the workspace experiments are conducted. Test results indicate that the workspace meets the design requirements, validating the system suspension design method of a WDPR for aircraft model suspension in wind tunnel test considering of the systematic stiffness and workspace.

In this paper, a novel tensioning and relaxing wearable system is introduced to improve the wearing comfort and load-bearing capabilities of knee exoskeletons. The research prototype of the novel system, which features a distinctive overrunning clutch drive, is presented. Through co-simulation with ANSYS, MATLAB, and SOLIDWORKS software, a comprehensive multi-objective optimization is performed to enhance the dynamics performance of the prototype. Firstly, the wearing contact stiffness of the prototype and the mechanical parameters of the relevant materials are simulated and fitted based on the principle of functional equivalence. And then, its equivalent nonlinear circumferential stiffness model is obtained. Secondly, to enhance the wearing comfort of the exoskeleton, a novel comprehensive performance evaluation index, termed wearing comfort, is introduced. The index considers multiple factors such as the duration of vibration transition, the acceleration encountered during wear, and the average pressure applied. Finally, through the utilization of this indicator, the system’s dynamics performance is optimized via multi-platform co-simulation, and the simulation results validate the effectiveness of the research method and the proposed wearable comfort index. The theoretical basis for the subsequent research on the effectiveness of prototype weight-bearing is provided.

The flexible flat cable (FFC) assembly task is a prime challenge in electronic manufacturing. Its characteristics of being prone to deformation under external force, tiny assembly tolerance, and fragility impede the application of robotic assembly in this field. To achieve reliable and stable robotic automation assembly of FFC, an efficient assembly skill acquisition strategy is presented by combining a parallel robot skill learning algorithm with adaptive impedance control. The parallel robot skill learning algorithm is proposed to enhance the efficiency of FFC assembly skill acquisition, which reduces the risk of damaging FFC and tackles the uncertain influence resulting from deformation during the assembly process. Moreover, FFC assembly is also a complex contact-rich manipulation task. An adaptive impedance controller is designed to implement force tracking during the assembly process without precise environment information, and the stability is also analyzed based on the Lyapunov function. Experiments of FFC assembly are conducted to illustrate the efficiency of the proposed method. The experimental results demonstrate that the proposed method is robust and efficient.

Precise and efficient performance in remote robotic teleoperation relies on intuitive interaction. This requires both accurate control actions and complete perception (vision, haptic, and other sensory feedback) of the remote environment. Especially in immersive remote teleoperation, the complete perception of remote environments in 3D allows operators to gain improved situational awareness. Color and Depth (RGB-D) cameras capture remote environments as dense 3D point clouds for real-time visualization. However, providing enough situational awareness needs fast, high-quality data transmission from acquisition to virtual reality rendering. Unfortunately, dense point-cloud data can suffer from network delays and limits, impacting the teleoperator’s situational awareness. Understanding how the human eye works can help mitigate these challenges. This paper introduces a solution by implementing foveation, mimicking the human eye’s focus by smartly sampling and rendering dense point clouds for an intuitive remote teleoperation interface. This provides high resolution in the user’s central field, which gradually reduces toward the edges. However, this systematic visualization approach in the peripheral vision may benefit or risk losing information and burdening the user’s cognitive load. This work investigates these advantages and drawbacks through an experimental study and describes the overall system, with its software, hardware, and communication framework. This will show significant enhancements in both latency and throughput, surpassing 60% and 40% improvements in both aspects when compared with state-of-the-art research works. A user study reveals that the framework has minimal impact on the user’s visual quality of experience while helping to reduce the error rate significantly. Further, a 50% reduction in task execution time highlights the benefits of the proposed framework in immersive remote telerobotics applications.