In this paper, a novel fast nonsingular integral terminal sliding mode controller based on an adaptive neural network (ANN-FNITSMC) is proposed for the trajectory tracking control of cable-driven continuum robots (CDCRs) in complex underwater environments with uncertainties. First, a novel fast nonsingular integral terminal sliding mode control (FNITSMC) is designed to solve the chattering and singularity problems of the conventional terminal sliding mode control (TSMC). Second, an adaptive neural network (ANN) based on a radial basis function (RBF) is established to derive the uncertainties and compensate for the control input of CDCRs, enabling high-stable accuracy and strong robustness trajectory tracking in complex underwater environments. Simulation results are presented to demonstrate the high accuracy and strong robustness of the ANN-FNITSMC. Finally, the high accuracy, high stability, and strong robustness of the proposed trajectory tracking strategy are verified through an underwater experiment platform.

This paper presents the novel concept of a singularity-free tube (SFT) in the constant orientation workspace of a spatial parallel manipulator. The concept is developed and demonstrated in the context of a $6$-$6$ spatial parallel manipulator, namely, the semi-regular Stewart platform manipulator. Given two points in the said workspace, the SFT is a tubular volume which contains these points and is free of gain-type or forward-kinematic singularities. The purpose of identifying such regions in space is to allow abundant freedom to the path-planner to connect the said points by a path, which can be free of gain-type singularities simply by remaining inside the SFT at all times. To demonstrate the concept, two smooth paths obtained by formulating two different optimisation problems have been presented as examples. The SFT can be of great help in singularity-free path-planning in many similar manipulators.

In this work, we propose a novel approach for tomato pollination that utilizes visual servo control. The objective is to meet the growing demand for automated robotic pollinators to overcome the decline in bee populations. Our approach focuses on addressing this challenge by leveraging visual servo control to guide the pollination process. The proposed method leverages deep learning to estimate the orientations and depth of detected flower, incorporating CAD-based synthetic images to ensure dataset diversity. By utilizing a 3D camera, the system accurately estimates flower depth information for visual servoing. The robustness of the approach is validated through experiments conducted in a laboratory environment with a 3D printed tomato flower plant. The results demonstrate a high detection rate, with a mean average precision of 91.2 %. Furthermore, the average depth error for accurately localizing the pollination target is impressively minimal, measuring only 1.1 cm. This research presents a promising solution for tomato pollination, showcasing the effectiveness of visual-guided servo control and its potential to address the challenges posed by diminishing bee populations in greenhouses.

Gripping devices for harvesting fruits have such types of work as cutting, tearing and unscrewing. For apples, it is preferable to use slicing or unscrewing, while the fruit leg should not remain, damaging the apple during storage. In this article, we are developing a grab for harvesting apples. The gripper is used both for holding the fruit and for jamming, followed by unscrewing. One of the advantages is that the proposed method of collecting apples allows you not to waste time moving the manipulator from the tree to the basket, but only to grab and tear them off. The fruit enters the gripper device; after which it enters the fruit collection container through a rigid or flexible pipe. The gripper device is built on the basis of a ball-screw transmission, which is supplemented by a gear drive along the helical surface. This allows for rotation and rectilinear movement of the held fruit. The gripping device has a ratchet mechanism that allows you to fix the fruit. A mathematical model of the gripper device has been developed, which allows determining the torque of the engine depending on the position of the fingers. The parameters of the mechanism were optimized using a genetic algorithm, and the results are presented in the form of a Pareto set. A 3D model of the gripper device has been built and a layout has been developed using 3D printing. Experimental laboratory and field tests of the gripping device were carried out.

The cable-driven parallel mechanism (CDPM) is known as an interesting application in industry to pick and place objects owing to its advantages such as large workspaces. In addition to the advantages of this mechanism, there are some challenges to improving performance by considering constraints in different components, such as the behavior of cables, shape, size of the end effector and base, and model of pulleys and actuators. Moreover, the impact of online geometry reconfiguration must be analyzed. This paper demonstrates the impact of these constraints on the performance of reconfigurable CDPM. The methodology is based on the systematic review and meta-analysis guidelines to report the results. The databases used to find the papers are extracted from Scopus and Google Scholar, using related keywords. As a result, the impact of physical constraints on system performance is discussed. A total of 90 and 37 articles are selected, respectively. After removing duplicates and unrelated papers, 88 studies that met the inclusion criteria are selected for review. Even when considering the physical constraints in modeling the mechanism, simplifications in designing a model for the reconfigurable CDPM generate errors. There is a gap in designing high-performance controllers to track desired trajectories while reconfiguring the geometry, and the satisfaction of physical constraints needs to be satisfied. In conclusion, this review presents several constraints in designing a controller to track desired trajectories and improve performance in future work. This paper presents an integrated controller architecture that includes physical constraints and predictive control.

Imitation from Observation (IfO) prompts the robot to imitate tasks from unlabeled videos via reinforcement learning (RL). The performance of the IfO algorithm depends on its ability to extract task-relevant representations since images are informative. Existing IfO algorithms extract image representations by using a simple encoding network or pre-trained network. Due to the lack of action labels, it is challenging to design a supervised task-relevant proxy task to train the simple encoding network. Representations extracted by a pre-trained network such as Resnet are often task-irrelevant. In this article, we propose a new approach for robot IfO via multimodal observations. Different modalities describe the same information from different sides, which can be used to design an unsupervised proxy task. Our approach contains two modules: the unsupervised cross-modal representation (UCMR) module and a self-behavioral cloning (self-BC)-based RL module. The UCMR module learns to extract task-relevant representations via a multimodal unsupervised proxy task. The Self-BC for further offline policy optimization collects successful experiences during the RL training. We evaluate our approach on the real robot pouring water task, quantitative pouring task, and pouring sand task. The robot achieves state-of-the-art performance.

Maintaining object grasp stability represents a pivotal challenge within the domain of robotic manipulation and upper-limb prosthetics. Perturbations originating from external sources frequently disrupt the stability of grasps, resulting in slippage occurrences. Also, if the grasping forces are not optimal while controlling the slip, it may result in the deformation of the objects. This study investigates the robustification of a reinforcement learning (RL) policy for implementing intelligent bionic reflex control, i.e., slip and deformation prevention of the grasped objects. RL-derived policies are vulnerable to failures in environments characterized by dynamic variability. To mitigate this vulnerability, we propose a methodology involving the incorporation of an adaptive sliding mode controller into a pre-trained RL policy. By exploiting the inherent invariance property of the sliding mode algorithm in the presence of uncertainties, our approach strengthens the robustness of the RL policies against diverse and dynamic variations. Numerical simulations substantiate the efficacy of our approach in robustifying RL policies trained within simulated environments.

Continuum robots offer unique advantages in performing tasks within extremely confined environments due to their exceptional dexterity and adaptability. However, their soft materials and elastic structures inherently introduce nonlinearity and shape instability, especially when the robot encounters external contact forces. To address these challenges, this paper presents a comprehensive model and experimental study to estimate the shape deformation of a switchable rigid-continuum robot (SRC-Bot). The kinematic analysis is first conducted to specify the degrees of freedom (DoF) and basic motions of SRC-Bot, including motion of bending, rotating, and elongating. This analysis assumes that the curvature varies along the central axis and maps the relationship between joint space and driven space. Subsequently, an equivalence concept is proposed to unify the stiffness addressing each DoF, which is then utilized in the establishment of the dynamic model. According to the mechanical structural design, the deformed posture of SRC-Bot is discretized into five segments, corresponding to the distribution of the guiders. The dynamics model is then derived using Newton’s second law and Euler’s method to simulate the deformation under gravity, friction, and external forces. Additionally, the stiffness in three directions is quantified through an identification process to complete the theoretical model. Furthermore, a series of experiments are conducted and compared with simulated results to validate the response and deformed behavior of SRC-Bot. The comparative results demonstrate that the proposed model-based simulation accurately captures the deformable characteristics of the robot, encompassing both static deformed postures and dynamic time-domain responses induced by external and actuation forces.

This study focuses on the kinematic and dynamic modeling of a wheeled-legged robot (WLR), taking into account kinematic and dynamic slippage. In this regard, the Gibbs–Appell formulation was utilized to derive dynamic equations. Determining the slippage in the wheels for movement equations is a challenging task due to its dependency on factors such as the robot’s postures, velocities, and surface characteristics. To address this challenge, machine vision was used to quantify the slippage of the wheels on the body based on the pose estimation method. This data served as input for movement equations to analyze the robot’s deviation from its path and posture. In the following, the robot’s movement was simulated using Webots and MATLAB, followed by various experimental tests involving acceleration and changes in leg angles on the WLR. The results were then compared to the simulations to demonstrate the accuracy of the developed system modeling. Additionally, an IMU sensor was utilized to measure the robot’s motion and validate against machine vision data. The findings revealed that neglecting the slippage of the wheels in the robot’s motion modeling resulted in errors ranging from 5% to 11.5%. Furthermore, lateral slippage ranging from 1.1 to 5.2 cm was observed in the robot’s accelerated movement. This highlights the importance of including lateral slippage in the equations for a more precise modeling of the robot’s behavior.

Continuum robot-based surgical systems are becoming an effective tool for minimally invasive surgery. A flexible, dexterous, and compact robot structure is suitable for carrying out complex surgical operations. In this paper, we propose performance metrics for dexterity based on data density. Data density at a point in the workspace is higher if the number of reachable points is higher, with a unique configuration lying in a small square box around a point. The computation of these metrics is performed with forward kinematics using the Monte Carlo method and, hence, is computationally efficient. The data density at a particular point is a measure of dexterity at that point. In contrast, the dexterity distribution property index is a measure of how well dexterity is distributed across the workspace according to desired criteria. We compare the dexterity distribution property index across the workspace with the dexterity index based on the dexterous solid angle and manipulability-based approach. A comparative study reveals that the proposed method is simple and straightforward because it uses only the position of the reachable point as the input parameter. The method can quantify and compare the performance of different geometric designs of hyper-redundant and multisegment continuum robots based on dexterity.

This paper proposes a seat support mechanism to solve the problem of misalignment between the chest examination and probe scanning areas when the patient is bent in a seated-style echocardiography robot. To guide the patient to an appropriate body position where their chest is within the examination range of the chest examination unit while minimizing the physical load of the patient, the posture of the patient must satisfy the three following conditions. (i) The breech must be in contact with the seat surface, (ii) the legs must be vertical to the floor, and (iii) the chest and mechanism must be parallel while the probe scanning and chest examination ranges must match. The human body was modeled to derive a posture that satisfies the aforementioned conditions for the height of each individual, and a seat support mechanism with four degrees of freedom was installed to guide the user to the derived posture. By installing this mechanism, the body load of the left biceps brachii, right biceps brachii, left latissimus dorsi, and right latissimus dorsi was reduced to 64.7%, 52.7%, 86.4%, and 80.2%, respectively. The sharpness of the image contours was improved to 103.8%.

Motion assistance for elderly people is a field of application for service robotic systems that can be characterized by requirements and constraints of human–machine interaction and by the specificity of the user’s conditions. The main aspects of characterization and constraints are examined for the application of service systems that can be specifically conceived or adapted for elderly motion assistance by having to consider conditions of motion deficiency and muscular strength weakness as well as psychological aptitudes of users. The analysis is discussed in general terms with reference to elderly people who may not even suffer from specific pathologies. Therefore, the discussion focuses on the need for motion exercise in proper environments, including domestic ones and frame familiar to a user. The challenges of such applications oriented toward elderly users are discussed as requiring research and design of solutions in terms of specific portability, user-oriented operation, low costs, and clinical-physiotherapeutic functionality. Results of the author’s team experiences are presented as an example of problems and attempted solutions to meet the new challenges of service systems for motion assistance applications for elderly people.

This paper presents an eight wire-driven parallel robot (WDPR-8) designed to serve as a suspension manipulator for aircraft models during wind tunnel testing. The precision of these tests is significantly influenced by the system’s stability and workspace, both of which are shaped by the geometric configuration of the structure and the tension in the wires. To acquire the efficiency principle of the suspension scheme design for the model, a kinematics model for a WDPR-8 was established. Based on the kinematics model, the stiffness of a WDPR-8 was theoretically studied, and the analytical expression of stiffness matrix of a WDPR was deduced. The stiffness matrix was composed of two terms, one of which is determined by the configuration of suspension system and the other term is determined by the wire tension. Based on the analysis result, a set of suspension scheme was discussed under the calculation of stiffness matrix and workspace analysis. In the discussion process, in addition to the stiffness-maximum calculation, another criterion as force closure is presented, which is useful for increasing the stiffness and workspace of the robot. Finally, a prototype was established according to the analysis result, and the workspace experiments are conducted. Test results indicate that the workspace meets the design requirements, validating the system suspension design method of a WDPR for aircraft model suspension in wind tunnel test considering of the systematic stiffness and workspace.

In this paper, a novel tensioning and relaxing wearable system is introduced to improve the wearing comfort and load-bearing capabilities of knee exoskeletons. The research prototype of the novel system, which features a distinctive overrunning clutch drive, is presented. Through co-simulation with ANSYS, MATLAB, and SOLIDWORKS software, a comprehensive multi-objective optimization is performed to enhance the dynamics performance of the prototype. Firstly, the wearing contact stiffness of the prototype and the mechanical parameters of the relevant materials are simulated and fitted based on the principle of functional equivalence. And then, its equivalent nonlinear circumferential stiffness model is obtained. Secondly, to enhance the wearing comfort of the exoskeleton, a novel comprehensive performance evaluation index, termed wearing comfort, is introduced. The index considers multiple factors such as the duration of vibration transition, the acceleration encountered during wear, and the average pressure applied. Finally, through the utilization of this indicator, the system’s dynamics performance is optimized via multi-platform co-simulation, and the simulation results validate the effectiveness of the research method and the proposed wearable comfort index. The theoretical basis for the subsequent research on the effectiveness of prototype weight-bearing is provided.

The flexible flat cable (FFC) assembly task is a prime challenge in electronic manufacturing. Its characteristics of being prone to deformation under external force, tiny assembly tolerance, and fragility impede the application of robotic assembly in this field. To achieve reliable and stable robotic automation assembly of FFC, an efficient assembly skill acquisition strategy is presented by combining a parallel robot skill learning algorithm with adaptive impedance control. The parallel robot skill learning algorithm is proposed to enhance the efficiency of FFC assembly skill acquisition, which reduces the risk of damaging FFC and tackles the uncertain influence resulting from deformation during the assembly process. Moreover, FFC assembly is also a complex contact-rich manipulation task. An adaptive impedance controller is designed to implement force tracking during the assembly process without precise environment information, and the stability is also analyzed based on the Lyapunov function. Experiments of FFC assembly are conducted to illustrate the efficiency of the proposed method. The experimental results demonstrate that the proposed method is robust and efficient.

Precise and efficient performance in remote robotic teleoperation relies on intuitive interaction. This requires both accurate control actions and complete perception (vision, haptic, and other sensory feedback) of the remote environment. Especially in immersive remote teleoperation, the complete perception of remote environments in 3D allows operators to gain improved situational awareness. Color and Depth (RGB-D) cameras capture remote environments as dense 3D point clouds for real-time visualization. However, providing enough situational awareness needs fast, high-quality data transmission from acquisition to virtual reality rendering. Unfortunately, dense point-cloud data can suffer from network delays and limits, impacting the teleoperator’s situational awareness. Understanding how the human eye works can help mitigate these challenges. This paper introduces a solution by implementing foveation, mimicking the human eye’s focus by smartly sampling and rendering dense point clouds for an intuitive remote teleoperation interface. This provides high resolution in the user’s central field, which gradually reduces toward the edges. However, this systematic visualization approach in the peripheral vision may benefit or risk losing information and burdening the user’s cognitive load. This work investigates these advantages and drawbacks through an experimental study and describes the overall system, with its software, hardware, and communication framework. This will show significant enhancements in both latency and throughput, surpassing 60% and 40% improvements in both aspects when compared with state-of-the-art research works. A user study reveals that the framework has minimal impact on the user’s visual quality of experience while helping to reduce the error rate significantly. Further, a 50% reduction in task execution time highlights the benefits of the proposed framework in immersive remote telerobotics applications.

This paper deals with the optimization of a new redundant spherical parallel manipulator (New SPM). This manipulator consists of two spherical five-bar mechanisms connected by the end-effector, providing three degrees of freedom, and has an unlimited self-rotation capability. Three optimization procedures based on the genetic algorithm method were carried out to improve the dexterity of the New SPM. The first and the second optimizations were applied to a symmetric New SPM structure, while the third was applied to an asymmetric New SPM structure. In both cases, the optimization was performed using an objective function defined by the quadratic sum of link angles. In addition, certain criteria and constraints were implemented. The obtained results demonstrate significant improvements in the dexterity of the New SPM and its capability of an unlimited self-rotate in an extended workspace. A comparison of the self-rotation performances between the classical 3-RRR SPM (R for revolute joint) and the New SPM is also presented.

In recent years, unmanned aerial vehicles (UAVs) have been applied in underground mine inspection and other similar works depending on their versatility and mobility. However, accurate localization of UAVs in perceptually degraded mines is full of challenges due to the harsh light conditions and similar roadway structures. Due to the unique characteristics of the underground mines, this paper proposes a semantic knowledge database-based localization method for UAVs. By minimizing the spatial point-to-edge distance and point-to-plane distance, the relative pose constraint factor between keyframes is designed for UAV continuous pose estimation. To reduce the accumulated localization errors during the long-distance flight in a perceptual-degraded mine, a semantic knowledge database is established by segmenting the intersection point cloud from the prior map of the mine. The topological feature of the current keyframe is detected in real time during the UAV flight. The intersection position constraint factor is constructed by comparing the similarity between the topological feature of the current keyframe and the intersections in the semantic knowledge database. Combining the relative pose constraint factor of LiDAR keyframes and the intersection position constraint factor, the optimization model of the UAV pose factor graph is established to estimate UAV flight pose and eliminate the cumulative error. Two UAV localization experiments conducted on the simulated large-scale Edgar Mine and a mine-like indoor corridor indicate that the proposed UAV localization method can realize accurate localization during long-distance flight in degraded mines.

In recent years, dangerous gas leakage events occur frequently. Rapid and accurate location of gas leakage sources by mobile robots is the key to avoid the expansion of disasters. In order to solve the problem of discontinuous gas concentration gradient and sparse gas environment in three-dimensional space, particle filter, and whale swarm optimization algorithm are integrated to locate gas source. Firstly, the Z-shape search and comb search are used to locate the plume, and then, the particle filter algorithm is combined with the whale optimization method to guide the particle movement, and the random inertial disturbance term is designed to improve the convergence speed and search accuracy of the algorithm. Experimental results in three-dimensional environment show that the proposed information-driven particle filter whale optimization hybrid algorithm effectively guides the robot in localizing gas source within a certain range, significantly enhancing both the efficiency and accuracy of localization compared to other algorithms.