The autonomous navigation and obstacle avoidance capabilities of autonomous underwater vehicles (AUVs) are essential for ensuring their safe navigation and long-term, efficient operation. However, the complexity of the marine environment poses significant challenges to safe and effective obstacle avoidance. To address this issue, this study proposes an AUV obstacle avoidance control algorithm based on offline reinforcement learning. This method adopts the Conservative Q-learning (CQL) algorithm, which is based on the Soft Actor-Critic (SAC) framework. It learns from obtained historical obstacle avoidance data and ultimately achieves a favorable obstacle avoidance control strategy. In this method, PID and SAC control algorithms are utilized to generate expert obstacle avoidance data to construct a diversified offline database. Additionally, based on the line-of-sight (LOS) guidance method and artificial potential field (APF) method, information regarding the distance and orientation of targets and obstacles is incorporated into the state space, and heading and obstacle avoidance reward terms are integrated into the reward function design. The algorithm successfully guides the AUV in autonomous navigation and dynamic obstacle avoidance in three-dimensional space. Furthermore, the algorithm exhibits a certain degree of anti-interference capability against uncertain disturbances and ocean currents, enhancing the safety and robustness of the AUV system. Simulation results fully demonstrate the feasibility and effectiveness of the intelligent obstacle avoidance method based on offline reinforcement learning. This study highlights the profound significance of offline reinforcement learning in enabling robust and reliable control systems for AUVs, paving the way for enhanced operational capabilities in challenging marine environments.

Autonomous underwater vehicles (AUVs) have played a pivotal role in advancing ocean exploration and exploitation. However, traditional AUVs face limitations when executing missions at minimal or near-zero forward velocities due to the ineffectiveness of their control surfaces, considerably constraining their potential applications. To address this challenge, this paper introduces an innovative vectored thruster system based on a 3RRUR parallel manipulator tailored for micro-sized AUVs. The incorporation of a vectored thruster enhances the performance of micro-sized AUVs when operating at minimal and low forward speeds. A comprehensive exploration of the kinematics of the thrust-vectoring mechanism has been undertaken through theoretical analysis and experimental validation. The findings from theoretical analysis and experimental confirmation unequivocally affirm the feasibility of the devised thrust-vectoring mechanism. The precise control of the vector device is studied using Physics-informed Neural Network and Model Predictive Control (PINN-MPC). Through the adoption of this pioneering thrust-vectoring mechanism rooted in the 3RRUR parallel manipulator, AUVs can efficiently and effectively generate the requisite motion for thrust-vectoring propulsion, overcoming the limitations of traditional AUVs and expanding their potential applications across various domains.

Although topographic mapping missions and geological surveys carried out by Autonomous Underwater Vehicles (AUVs) are becoming increasingly prevalent, the lack of precise navigation in these scenarios still limits their application. This paper deals with the problems of long-term underwater navigation for AUVs and provides new mapping techniques by developing a Bathymetric Simultaneous Localisation And Mapping (BSLAM) method based on graph SLAM technology. To considerably reduce the calculation cost, the trajectory of the AUV is divided into various submaps based on Differences of Normals (DoN). Loop closures between submaps are obtained by terrain matching; meanwhile, maximum likelihood terrain estimation is also introduced to build weak data association within the submap. Assisted by one weight voting method for loop closures, the global and local trajectory corrections work together to provide an accurate navigation solution for AUVs with weak data association and inaccurate loop closures. The viability, accuracy and real-time performance of the proposed algorithm are verified with data collected onboard, including an 8 km planned track recorded at a speed of 4 knots in Qingdao, China.