This paper introduces a novel bipedal robot model designed for adaptive transition between walking and running gaits solely through changes in locomotion speed. The bipedal robot model comprises two sub-components: a mechanical model for the legs that accommodates both walking and running and a continuous state model that does not explicitly switch states. The mechanical model employs a structure combining a linear cylinder with springs, dampers, and stoppers, designed to have mechanistic properties of both the inverted pendulum model used for walking and the spring-loaded inverted pendulum model used for running. The state model utilizes a virtual leg representation to abstractly describe the actual support leg, capable of commonly representing both a double support leg in walking and a single support leg in running. These models enable a simple gait controller to determine the kick force and the foot touchdown point based solely on the parameter of the target speed, thus allowing a robot to walk and run stably. Hence, simulation validation demonstrates the adaptive robot transition to an energy-efficient gait depending on locomotion speed without explicit gait-type instructions and maintaining stable locomotion across a wide range of speeds.

In certain scenarios, the large footprint of a robot is not conducive to multi-robot cooperative operations. This paper presents a generalized single-loop parallel manipulator with remote center of motion (GSLPM-RCM), which addresses this issue by incorporating a reconfigurable base. The footprint of this RCM manipulator can be adjusted by varying the parameters of the reconfigurable base. First, utilizing configuration evolution, a reconfigurable base is constructed based on the principle of forming RCM motion. Then, according to the modular analysis method, the inverse kinematics of this parallel RCM manipulator is analyzed, and the workspace is also analyzed. Subsequently, the motion/force transmissibility of this RCM manipulator is analyzed by considering its single-loop and multi-degree of freedom characteristics. Leveraging the workspace index and transmissibility indices, dimension optimization of the manipulator is implemented. Finally, the influence of the reconfigurable base on the workspace and the transmissibility performance of the optimized manipulator is studied.

Traditional bulky and complex control devices such as remote control and ground station cannot meet the requirement of fast and flexible control of unmanned aerial vehicles (UAVs) in complex environments. Therefore, a data glove based on multi-sensor fusion is designed in this paper. In order to achieve the goal of gesture control of UAVs, the method can accurately recognize various gestures and convert them into corresponding UAV control commands. First, the wireless data glove fuses flexible fiber optic sensors and inertial sensors to construct a gesture dataset. Then, the trained neural network model is deployed to the STM32 microcontroller-based data glove for real-time gesture recognition, in which the convolutional neural network-Attention mechanism (CNN-Attention) network is used for static gesture recognition, and the convolutional neural network-bidirectional long and short-term memory (CNN-Bi-LSTM) network is used for dynamic gesture recognition. Finally, the gestures are converted into control commands and sent to the vehicle terminal to control the UAV. Through the UAV simulation test on the simulation platform, the average recognition accuracy of 32 static gestures reaches 99.7%, and the average recognition accuracy of 13 dynamic gestures reaches 99.9%, which indicates that the system’s gesture recognition effect is perfect. The task test in the scene constructed in the real environment shows that the UAV can respond to the gestures quickly, and the method proposed in this paper can realize the real-time stable control of the UAV on the terminal side.

Cable-guiding mechanisms (CGMs) and the stiffness characteristics directly influence the dynamic features of the cable-driven upper limb rehabilitation robot (PCUR), which will affect PCUR’s performance. This paper introduces a novel CGM design. Given the precision and movement stability considerations of the mechanism, an analytical model is developed. Using this model, we analyze the error of the CGM and derive velocity and acceleration mappings from the moving platform to the cables. Continuity of cable trajectory and tension is rigorously demonstrated. Subsequently, a mathematical model for PCUR stiffness is formulated. Utilizing MATLAB/Simscape Multibody, simulation models for the CGM and stiffness characteristics are constructed. The feasibility of the proposed CGM design is validated through simulation and experimentation, while the influence of stiffness characteristics on PCUR motion stability is comprehensively analyzed.

This paper proposes a mobile robot recovery mechanism for low-cost robotic systems due to vision sensor failure in vSLAM systems. The approach takes advantage of ROS architecture and adopts the Shannon Nyquist sampling theory to selectively sample path parameters that will be used for back travel in case of vision sensor failure. As opposed to point clouds normally used to store vSLAM data, this paper proposes to store and use lightweight variables namely distance between sampled points, velocity combinations, i.e., linear and angular velocity, sampled period, and yaw angle values to describe the robot path and reduce the memory space required to store these variables. In this study, low-cost robotic systems typically using cameras aided by proprioceptive sensors such as IMU during vSLAM activities are investigated. A demonstration is made on how the ROS architecture can be used in a scenario where vision sensing is adversely affected, resulting in mapping failure. Additionally, a recommendation is made for adoption of the approach for vSLAM platforms implemented on both ROS1 and ROS2. Furthermore, a proposal is made to add an additional layer to vSLAM systems that will be exclusively used for back travel in case of vision loss during vSLAM activities resulting in mapping failure.

For precision-required robot operations, the robot’s positioning accuracy, repeatability, and stiffness characteristics should be considered. If the mechanism has the desired repeatability performance, a kinematic calibration process can enhance the positioning accuracy. However, for robot operations where high accelerations are needed, the compliance characteristics of the mechanism affect the trajectory-tracking accuracy adversely. In this paper, a novel approach is proposed to enhance the trajectory-tracking accuracy of a robot operating at high accelerations by predicting the compliant displacements when there is no physical contact of the robot with its environment. Also, this case study compares the trajectory-tracking characteristics of an over-constrained and a normal-constrained 2-degrees-of-freedom (DoF) planar parallel mechanism during high-acceleration operations up to 5 g accelerations. In addition, the influence of the end-effector’s center of mass (CoM) position along the normal of the plane is investigated in terms of its effects on the proposed trajectory-enhancing algorithm.

Treating inertial measurement unit (IMU) measurements as inputs to a motion model and then preintegrating these measurements have almost become a de facto standard in many robotics applications. However, this approach has a few shortcomings. First, it conflates the IMU measurement noise with the underlying process noise. Second, it is unclear how the state will be propagated in the case of IMU measurement dropout. Third, it does not lend itself well to dealing with multiple high-rate sensors such as a lidar and an IMU or multiple asynchronous IMUs. In this paper, we compare treating an IMU as an input to a motion model against treating it as a measurement of the state in a continuous-time state estimation framework. We methodically compare the performance of these two approaches on a 1D simulation and show that they perform identically, assuming that each method’s hyperparameters have been tuned on a training set. We also provide results for our continuous-time lidar-inertial odometry in simulation and on the Newer College Dataset. In simulation, our approach exceeds the performance of an imu-as-input baseline during highly aggressive motion. On the Newer College Dataset, we demonstrate state-of-the art results. These results show that continuous-time techniques and the treatment of the IMU as a measurement of the state are promising areas of further research. Code for our lidar-inertial odometry can be found at: https://github.com/utiasASRL/steam_icp.

Biped wall-climbing robots (BWCRs) serve as viable alternatives to human workers for inspection and maintenance tasks within three-dimensional (3D) curtain wall environments. However, autonomous climbing in such environments presents significant challenges, particularly related to localization and navigation. This paper presents a pioneering navigation framework tailored for BWCRs to navigate through 3D curtain wall environments. The framework comprises three essential stages: Building Information Model (BIM)-based map extraction, 3D climbing path planning (based on our previous work), and path tracking. An algorithm is developed to extract a detailed 3D map from the BIM, including structural elements such as walls, frames, and ArUco markers. This generated map is input into a proposed path planner to compute a viable climbing motion. For path tracking during actual climbing, an ArUco marker-based global localization method is introduced to estimate the pose of the robot, enabling adjustments to the target foothold by comparing desired and actual poses. The conducted experiments validate the feasibility and efficacy of the proposed navigation framework and associated algorithms, aiming to enhance the autonomous climbing capability of BWCRs.

Automatic license plate recognition (ALPR) systems are increasingly used to solve issues related to surveillance and security. However, these systems assume constrained recognition scenarios, thereby restricting their practical use. Therefore, we address in this article the challenge of recognizing vehicle license plates (LPs) from the video feeds of a mobile security robot by proposing an efficient two-stage ALPR system. Our ALPR system combines the on-the-shelf YOLOv7x model with a novel LP recognition model, called vision transformer-based LP recognizer (ViTLPR). ViTLPR is based on the self-attention mechanism to read character sequences on LPs. To ease the deployment of our ALPR system on mobile security robots and improve its inference speed, we also propose an optimization strategy. As an additional contribution, we provide an ALPR dataset, named PGTLP-v2, collected from surveillance robots patrolling several plants. The PGTLP-v2 dataset has multiple features to cover chiefly the in-the-wild scenario. To evaluate the effectiveness of our ALPR system, experiments are carried out on the PGTLP-v2 dataset and five benchmark ALPR datasets collected from different countries. Extensive experiments demonstrate that our proposed ALPR system outperforms state-of-the-art baselines.

This paper presents a climbing robot (CR) designed for the purpose of pipeline maintenance, with capability to avoid the risks inherent in manual operations. In the design process, a three degree of freedom (DOF) parallel mechanism coupled with a remote center of motion (RCM) mechanism linkage mechanism were designed to serve as the CR’s climbing mechanism, which met the specific demands for climbing movements. The modified Kutzbach–Grübler formula and the screw theory were applied to calculate the DOFs of the CR. Then, the inverse and forward position analysis for the CR was derived. Furthermore, velocity and acceleration analysis of parallel mechanism were conducted and derived the Jacobian matrix, through which the singularity of parallel mechanism was analyzed. In order to evaluate kinematic performance of parallel mechanism, the motion/force transmission index (LTI) of workspace was calculated, which directed the followed dimensional optimization process. According to the optimization result, a prototype was constructed and a series of motion experiments were carried out to validate its climbing capability.

This paper investigates a closed-loop visual servo control scheme for controlling the position of a fully constrained cable-driven parallel robot (CDPR) designed for functional rehabilitation tasks. The control system incorporates real-time position correction using an Intel RealSense camera. Our CDPR features four cables exiting from pulleys, driven by AC servomotors, to move the moving platform (MP). The focus of this work is the development of a control scheme for a closed-loop visual servoing system utilizing depth/RGB images. The developed algorithm uses this data to determine the actual Cartesian position of the MP, which is then compared to the desired position to calculate the required Cartesian displacement. This displacement is fed into the inverse kinematic model to generate the servomotor commands. Three types of trajectories (circular, square, and triangular) are used to test the controller’s compliance with its position. Compared to the open-loop control of the robot, the new control system increases positional accuracy and effectively handles cable behavior, various perturbations, and modeling errors. The obtained results showed significant improvements in control performance, notably reduced root mean square error and maximal error in terms of position.

The estimation of workspace for parallel kinematic machines (PKMs) typically relies on geometric considerations, which is suitable for PKMs operating under light load conditions. However, when subjected to heavy load, PKMs may experience significant deformation in certain postures, potentially compromising their stiffness. Additionally, heavy load conditions can impact motor loading performance, leading to inadequate motor loading in specific postures. Consequently, in addition to geometric constraints, the workspace of PKMs under heavy load is also constrained by mechanism deformation and motor loading performance.

This paper aims at developing a new heavy load 6-PSS PKM for multi-degree of freedom forming process. Additionally, it proposes a new method for estimating the workspace, which takes into account both mechanism deformation and motor loading performance. Initially, the geometric workspace of the machine is predicted based on its geometric configuration. Subsequently, the workspace is predicted while considering the effects of mechanism deformation and motor loading performance separately. Finally, the workspace is synthesized by simultaneously accounting for both mechanism deformation and motor loading performance, and a new index of workspace utilization rate is proposed. The results indicate that the synthesized workspace of the machine diminishes as the load magnitude and load arm increase. Specifically, under a heavy load magnitude of 6000 kN and a load arm of 200 mm, the utilization rate of the synthesized workspace is only 9.9% of the geometric workspace.

Elbow, with complex physiological structure, plays an important role in upper limb motion which can be assisted with exoskeleton in rehabilitation. However, the stiffness of elbow changes while training which decline the comfort and effect of rehabilitation. Moreover, the rotation axis of elbow is changing which will cause secondary injuries. In this paper, we design an elbow exoskeleton with a variable stiffness actuator and a deviation compensation unit to assist elbow rehabilitation. Firstly, we design a variable stiffness actuator by symmetric actuation principle to adapt the change of elbow stiffness. The parameters of the variable stiffness actuator are optimized by motion simulation. Next, we design a deviation compensation unit to follow the rotation axis deviation outside the horizontal plane. The compensation area is simulated to cover the deviation. Finally, simulation and experiments are carried out to show the performance of our elbow exoskeleton. The workspace can meet the need of daily elbow motion while the variable stiffness actuator can adjust the exoskeleton stiffness as expectation.

Soft robots show an advantage when conducting tasks in complex environments due to their enormous flexibility and adaptability. However, soft robots suffer interactions and nonlinear deformation when interacting with soft and fluid materials. The reason behind is the free boundary interactions, which refers to undetermined contact between soft materials, specifically containing nonlinear deformation in air and nonlinear interactions in fluid for soft robot simulation. Therefore, we propose a new approach using material point method (MPM), which can solve the free boundary interactions problem, to simulate soft robots under such environments. The proposed approach can autonomously predict the flexible and versatile behaviors of soft robots. Our approach entails incorporating automatic differentiation into the algorithm of MPM to simplify the computation and implement an efficient implicit time integration algorithm. We perform two groups of experiments with an ordinary pneumatic soft finger in different free boundary interactions. The results indicate that it is possible to simulate soft robots with nonlinear interactions and deformation, and such environmental effects on soft robots can be restored.

Remote center-of-motion (RCM) manipulators are a key issue in minimally invasive surgeries (MIS). The existing RCM parallel mechanisms (PMs) can only generate RCM motion based on the invariant RCM. To provide mobility for RCM, this paper designed a new family of RCM PMs with movable RCM that features a double-stage topological structure. Drawing mainly on configuration evolution and Lie-group, a general approach is proposed to design double-stage PMs with movable RCM. Feasible limbs for 2R1T RCM motion are enumerated and used to construct the secondary PM. Type synthesis of the primary PMs that realize movable RCM is accomplished based on the method presented. Different connection styles between the two stages that ensure the geometrical conditions of RCM motion are designed. Using different connection styles, double-stage PMs with movable RCM are constructed. These new RCM PMs can realize precise positioning of RCM by taking advantage of the primary PMs, which indicates their potential application prospects in MIS.

The path planning and obstacle-crossing motion planning of cable trench inspection robots are essential for achieving automated inspection. To improve path planning efficiency and obstacle navigation in complex environments, an enhanced global path planning algorithm based on the A* algorithm has been developed, combined with an improved Dynamic Window Approach (DWA) for local path planning. For unavoidable obstacles, a specific obstacle-crossing motion planning strategy has been formulated. The enhanced A* algorithm improves efficiency and safety through adaptive neighborhood expansion and the elimination of redundant path points. The improved DWA algorithm enables real-time dynamic obstacle avoidance in local path planning. The simulation results on a $20 \times 20$ grid map indicate that the improved A* algorithm reduces the number of nodes by 58.4% and shortens the path length by 6.1% compared to the traditional A* algorithm, demonstrating significant advantages over other conventional path planning algorithms. In the simulation experiments integrating global and local path planning, the enhanced A* algorithm combined with the improved DWA algorithm reduces the path length by 3.2% on the $20 \times 20$ grid map compared to the integration with the traditional DWA algorithm. On the $30 \times 30$ grid maps with different obstacle configurations, the path lengths are reduced by 3.5% and 3.6%, respectively. In the obstacle-crossing experiments, the robot successfully overcame obstacles of 10 cm and 20 cm in height. The proposed path planning algorithm and obstacle-crossing motion planning strategy hold substantial application potential in complex environments, offering reliable technical support for cable trench inspection robots.

This paper presents Hybrid Modified A* (HMA*) algorithm which is used to control an omnidirectional mecanum wheel automated guided vehicle (AGV). HMA* employs Modified A* and PSO to determine the best AGV path. The HMA* overcomes the A* technique’s drawbacks, including a large number of nodes, imprecise trajectories, long calculation times, and expensive path initialization. Repetitive point removal refines Modified A*’s path to locate more important nodes. Real-time hardware control experiments and extensive simulations using Matlab software prove the HMA* technique works well. To evaluate the practicability and efficiency of HMA* in route planning and control for AGVs, various algorithms are introduced like A*, Probabilistic Roadmap (PRM), Rapidly-exploring Random Tree (RRT), and bidirectional RRT (Bi-RRT). Simulations and real-time testing show that HMA* path planning algorithm reduces AGV running time and path length compared to the other algorithms. The HMA* algorithm shows promising results, providing an enhancement and outperforming A*, PRM, RRT, and Bi-RRT in the average length of the path by 12.08%, 10.26%, 7.82%, and 4.69%, and in average motion time by 21.88%, 14.84%, 12.62%, and 8.23%, respectively. With an average deviation of 4.34% in path length and 3% in motion time between simulation and experiments, HMA* closely approximates real-world conditions. Thus, the proposed HMA* algorithm is ideal for omnidirectional mecanum wheel AGV’s static as well as dynamic movements, making it a reliable and efficient alternative for sophisticated AGV control systems.

Optical microrobots are activated by a laser in a liquid medium using optical tweezers. To create visual control loops for robotic automation, this work describes a deep learning-based method for orientation estimation of optical microrobots, focusing on detecting 3-D rotational movements and localizing microrobots and trapping points (TPs). We integrated and fine-tuned You Only Look Once (YOLOv7) and Deep Simple Online Real-time Tracking (DeepSORT) algorithms, improving microrobot and TP detection accuracy by $\sim 3$% and $\sim 11$%, respectively, at the 0.95 Intersection over Union (IoU) threshold in our test set. Additionally, it increased mean average precision (mAP) by 3% at the 0.5:0.95 IoU threshold during training. Our results showed a 99% success rate in trapping events with no false-positive detection. We introduced a model that employs EfficientNet as a feature extractor combined with custom convolutional neural networks (CNNs) and feature fusion layers. To demonstrate its generalization ability, we evaluated the model on an independent in-house dataset comprising 4,757 image frames, where microrobots executed simultaneous rotations across all three axes. Our method provided mean rotation angle errors of $1.871^\circ$, $2.308^\circ$, and $2.808^\circ$ for X (yaw), Y (roll), and Z (pitch) axes, respectively. Compared to pre-trained models, our model provided the lowest error in the Y and Z axes while offering competitive results for X-axis. Finally, we demonstrated the explainability and transparency of the model’s decision-making process. Our work contributes to the field of microrobotics by providing an efficient 3-axis orientation estimation pipeline, with a clear focus on automation.

Precise pose estimation is crucial to various robots. In this paper, we present a localization method using correlative scan matching (CSM) technique for indoor mobile robots equipped with 2D-LiDAR to provide precise and fast pose estimation based on the common occupancy map. A pose tracking module and a global localization module are included in our method. On the one hand, the pose tracking module corrects accumulated odometry errors by CSM in the classical Bayesian filtering framework. A low-pass filter associating the predictive pose from odometer with the corrected pose by CSM is applied to improve precision and smoothness of the pose tracking module. On the other hand, our localization method can autonomously detect localization failures with several designed trigger criteria. Once a localization failure occurs, the global localization module can recover correct robot pose quickly by leveraging branch-and-bound method that can minimize the volume of CSM-evaluated candidates. Our localization method has been validated extensively in simulated, public dataset-based, and real environments. The experimental results reveal that the proposed method achieves high-precision, real-time pose estimation, and quick pose retrieve and outperforms other compared methods.

Extensible continuum robots (ECRs) offer distinct advantages over conventional continuum robots due to their ability to enhance workspace adaptability through length adjustments. This makes ECRs particularly promising for applications that require variable lengths involving the manipulation of objects in challenging environments, such as risky, cluttered, or confined. The development of ECRs necessitates careful consideration of mechanical structures, actuation methods, methods of stiffness variability, and control methods. The selection of papers is based on their relevance to ECRs within the period of 2010 to 2023 in the databases of Scopus and Web of Science. Distinguishing itself from other review papers, this paper aims to deliver a comprehensive and critical discussion about the advantages and disadvantages of ECRs concerning their mechanical structures, actuation methods, stiffness variability, and control methods. It is a beneficial resource for researchers and engineers interested in ECRs, providing essential insights to guide future developments in this field. Based on the literature, existing ECRs exhibit an inherent trade-off between flexibility and structural strength due to the absence of systematic design methods. Additionally, there is a lack of intelligent and effective controllers for achieving complex control performance and autonomous stiffness variability.