1. Introduction
Cooperation between humans and robots plays an important role in many fields. In fact, haptic devices [Reference Kansal, Zubair, Suthar and Mukherjee1, Reference Ellis, Ismaeil and Lipsett2] are developed in order to enable its users to interact with software program or a virtual item by giving a force and torque feedback. They are used to increase the application immersion such as gaming [Reference Park, Kim, Cho and Park3, Reference Kandemir and Kose4], training in virtual environment [Reference Broeren, Rydmark and Sunnerhagen5–Reference Karkoub, Her and Chen7], and augmented reality [Reference Gosselin, Jouan, Brisset and Andriot8]. Minimally invasive surgery (MIS) is one of the practical examples where haptic feedback could be very useful [Reference Zidane, Khattab, Rezeka and El-Habrouk9].
Haptic devices have been widely investigated, and Van den bedem proposed in ref. [Reference Feedback, Van Den Bedem, Hendrix, Rosielle, Steinbuch and Nijmeijer10] a spherical serial master haptic device with 4-DoFs. The serial architecture has a simple kinematic. However, it has major drawbacks such as all actuators must be placed on the joint axes which increase the required torques and the weight of the end-effector that the surgeon is asked to support. Several other authors [Reference Chaker, Mlika, Laribi, Romdhane and Zeghloul11] proposed a spherical parallel manipulator (SPM) with a remote center of rotation (CoR) used as a haptic device for MIS (Fig. 1(a)). Contrary to the serial master haptic device, actuators of the SPM are located at the base which reduces the inertia issue of the system. However, this haptic device with parallel architecture suffers from singularities inside his workspace, which causes the loss of DoF and the amplification of errors in the kinematic transformation [Reference Saafi, Laribi and Zeghloul12]. In order to cope with the singularity problem inside the workspace of a parallel device, Saafi et al. [Reference Saafi, Laribi and Zeghloul13] proposed several solutions. Indeed, the behavior of the manipulator is improved by the use of a redundant actuator, the use of an extra sensor, as well as a specific control scheme. As reported by Saafi [Reference Saafi, Laribi and Zeghloul14], the use of an extra sensor placed in a passive joint improves the calculation of the forward kinematic model even in singular positions. Another solution is described in refs. [Reference Saafi, Vulliez, Zeghloul and Laribi15, Reference Meskini, Saafi, Laribi, Mlika, Arsicault and Zegloul16], which introduce a serial approach for solving the forward kinematic model by placing three sensors on one leg rather than placing them on the actuated joint located at the base. This solution aim to improve the calculation of the forward kinematic model and eliminate the parallel singularity effects in real time application.
Another interesting kinematic of a haptic device was presented by Pérault et al. [Reference Preaúlt, Saafi, Laribi and Zeghloul17]. This architecture is based on Delta robot architecture (Fig. 1(b)). However, the remote CoM of the mechanism is at the bottom of the robot, which increases the gravity compensation and required actuators size.
Hybrid devices as presented in refs. [Reference Tanev18–Reference Carbone and Ceccarelli21] started to take their places in a lot of fields. A new hybrid haptic device (Fig. 1(c)) is presented by Saafi et al. [Reference Saafi, Laribi and Zeghloul22]. This haptic device is the association of a parallel chain and a serial chain. In this latter, the parallel chain is responsible for the tilt motions, and the serial chain handles the self-rotation and the translation. The limitation of this architecture is that the actuator handling the self-rotation should be supported by the serial chain, which increases the weight of the translational part and as consequence the linear actuation torque.
In this paper, a new haptic device with a remote CoR is designed for MIS based on hybrid architecture for laparoscopic surgery. The proposed architecture is based on the association of a parallel part with 3-RRR (R: revolute) parallel planar manipulator, and a serial part connected through universal joint. The self-rotation is supported by the parallel part. The haptic device is optimized in order to guaranty the best kinematic behavior and torque feedback. Simulations are carried out in purpose to validate the manipulator efficiency and handles comparison with other haptic devices.
The paper is organized as follows. In Section 2, the workspace of the desired task will be identified based on the capture of medical expert motions performing MIS. The proposed architecture of the new hybrid haptic (nHH) device is discussed in Section 3. Section 4 is devoted to the dimensional synthesis of the manipulator. In Section 5, a numerical validation and a comparison between the new HH device and the SPM are caried out. Section 6 summarizes this paper.
2. Laparoscopic workspace identification
MIS surgery tools are designed to enter the patient’s body through incisions, requiring less time for recovery and less pain for the patient. In order to identify the workspace swept by the instruments during this surgical operation, motion capture system was used to record the gestures of a skilled surgeon [Reference Laribi, Riviere, Arsicault and Zeghloul24]. An instance of workspaces deduced from the recorded instruments motions, a clamp and a needle holder, is shown in Fig. 2. Each tool works in a space with a conical geometric form defined by a half-vertex angle $\alpha$ that can go up to 26°.
Further, each tool moves along the cone’s axis with a translational motion defined by its bounding limits given by the maximal and minimal distances (Dmax and Dmin) between the incision point and the tool tip, respectively.
Based on the surgical gestures analysis reported in refs. [Reference Laribi, Arsicault, Riviere and Zeghloul25–Reference Nisar, Endo and Matsuno27], the MIS procedure requires four degrees of freedom, namely three rotations and one translation. One can conclude that the tool workspace is described by a cone with a maximum vertex angle of 26° and a translation of 112 mm along the tool axis direction, respectively.
The geometric construction of the tool workspace given in Fig. 3 shows the location of the CoR, at the top of the cone, and the intersections with a set of parallel planes Pi (i ∈ {1, 2…, n}) defined by their common normal vector $\textbf{nP}_{\textbf{n}}$ . Each plane Pi is located at the distance $H_{{p_{i}}}$ , between the plane Pi which design the plane of the parallel chain and the CoR. The intersections are described by a set of circles with radius ri and given by Eq. (1):
The next section will introduce the kinematic of the new haptic device for the MIS, called hybrid haptic device.
3. nHH-device
The new proposed architecture, the novel hybrid haptic (nHH) device offers four possible motions as presented in Fig. 4. One can note three rotations around a defined CoR and one translation. This architecture is composed of a serial and a parallel kinematic chain. Each of these chains operates a part of the device. The parallel chain is composed of a 3-RRR planar manipulator with 3 DoFs, which allows to handle the two tilt motions and the self-rotation. The serial chain is composed of a prismatic and spherical joint, allowing to manipulate the translation around a fixed CoR. The two chains of this device are connected through a universal joint. This association allows to overcome with the drawbacks of the serial architectures where the actuators are placed on the joint axes and increase the moving masses which alters dynamic behavior.
In the section below, the two kinematic chains of the presented architecture will be discussed in detail. The CAD model of the nHH device and its developed prototype are presented in Fig. 5(a) and (b), respectively.
3.1. Serial chain (SC)
A universal joint serving as a CoR, a revolute joint for self-rotation, and a prismatic joint to control the linear displacement defined by T make up the serial chain of the proposed nHH device. As shown in Fig. 6(a), the orientations of the serial chain are specified using cardon angles with three different rotations in three-dimensional space. The bond graph of the serial chain is presented in Fig. 6(b).
The end effector velocity can be expressed using the universal joints $(\beta _{1},\beta _{2},\beta _{3})$ presented in Fig. 6 by Eq. (2):
The orientation of end effector in workspace can be also described by the Euler angles (ψ, θ, φ) with ZXZ convention. In this case the angular velocity of the end effector can be expressed as follows:
Or from Eq. (3) and Eq. (5) we can obtain:
where
with,
Using the identification between the Euler matrix and the cardan matrix, $\beta _{1}$ can be expressed using Euler angles by Eq. (11):
Using this result, the $\textbf{J}s$ matrix is expressed by
The matrix $\textbf{J}\boldsymbol{s}$ of the serial chain is used in the evaluation of the kinematic performance of the serial chain. This evaluation is based on the dexterity criterion, detailed in Section 3.2.2. The dexterity noted $\mu _{s}$ is equal to the inverse of the conditioning number of the matrix $\textbf{J}\boldsymbol{s}$ (Eq. 13).
The dexterity distribution in the plane $(\psi, \theta )$ of the serial chain is presented in Fig. 7. One can conclude suitable kinematic performances of the serial chain since the dexterity is higher than 0.5 over the whole workspace.
3.2. Parallel chain (PC)
3.2.1. Kinematic model
The parallel chain of the nHH device is defined by a 3-RRR parallel planar manipulator. This latter is composed of three identical kinematic chains connecting a mobile platform to a fixed base. Each chain is consisting of an actuated revolute joint attached to the ground followed by two revolute joints to be connected to the platform, as shown in Fig. 8.
The center of the joint connecting the two links of the $i\text{th}$ chain will be referred to as Bi . The length of the links of the $i\text{th}$ chain will be noted $L_{1}$ (for link AiBi ) and $L_{2}$ (for link BiCi ). The active and passive revolute joints are denoted by $\theta _{i}$ and ${\beta }_{i}$ , respectively, with $i=1,2,3$ .
The position of the moving platform is defined by the coordinates of point $P(Px,Py)$ in the fixed reference frame R0 and its orientation is given by the angle ${\unicode[Arial]{x03C6}}$ between one axis of the fixed reference frame and the corresponding frame R1 of the moving frame, as show on Fig. 8.
The inverse geometric model, to obtain the active joints from the position and the orientation of the moving platform, can be expressed as follows [Reference Kucuk28]:
where
The kinematic model of the 3-RRR parallel planar manipulator can be computed by the derivation of the forward kinematic model presented by the following equations [Reference Kucuk28]:
To finally obtain an equation expressed as follows:
where $\textbf{J}_{x}$ and $\textbf{J}_{{\unicode[Arial]{x03B8}} }$ are the parallel part and the serial part of the Jacobian matrix presented by Eqs. (21) and (22), respectively.
where
The Jacobian matrix satisfies Eq. (27):
3.2.2. Dexterity
In order to evaluate the kinematic performance of the parallel chain of the nHH device, the dexterity will be examined. This criterion allows to measure how far the moving platform is far from singularity inside the workspace and one of the most considered criteria in literature [Reference Angeles29]. The dexterity is computed using the inverse of the condition number described by Eq. (28).
where, $K(\textbf{J}_{\textbf{p}})=| | \textbf{J}_{\textbf{P}}| | .| | {\textbf{J}_{\textbf{P}}}^{-1}| |$
In order to evaluate the global dexterity inside a desired workspace, the global conditioning index will be considered and defined as follows [Reference Essomba and Vu30]:
$N$ : discretization parameter of the desired workspace.
In order to identify the coupling between the serial and the parallel chain of the nHH device, the relations between the cartesian coordinates of the center of the moving platform of the parallel chain and the orientation of the serial chain are determined. As shown on Fig. 6, these relations are defined by Eqs. (30) and (31):
For each orientation $\psi$ and $\theta$ leading to a position of the moving platform, the active angles $(\theta _{1},\theta _{2},\theta _{3})$ can be computed using the inverse kinematic model presented in Section 3.2. As consequence, the dexterity distribution of the parallel chain can be obtained by a simple mapping in the $(\psi, \theta )$ plane and given in the Figs. 9, 10 and 11 for different values of the self-rotation.
4. Dimensional synthesis of the nHH device
The aim of this section is to identify the best design parameters of the nHH device leading to the best trajectory tracking accuracy. This latter can be characterized by the kinematic performance of the nHH device. The value of this performance depends on the positioning error, between the articulate coordinates and the operational ones, due to the kinematic transformations.
The optimization process, based on the dimensional synthesis, allows identifying the nHH device that is more suitable for the criteria selected by the user and in our case the kinematic performance. In the literature, several methods and indices can be found [Reference Angeles29, Reference Yoshikawa31, Reference Angeles, Ranjbaran and Patel32] To compute the kinematic performance of a structure, we chose the global dexterity defined by Gosselin [Reference Angeles29] as it characterizes the isotropy of the robot velocity.
4.1. Problem formulation
This section focuses on the development and the results of the multidimensional, nonlinear optimization problem of selecting the geometric design variables for the nHH device having a specified workspace as well as the best dexterity distribution. The aimed application is the minimally invasive surgery due to the experimental recorded path used in the comparison study in Section 5 but can be enlarged to others.
Figure 12 presents the intersection between the cone and the plane crossing the parallel chain. This intersection is bounded by a circle $C$ and discretized in $n$ point $E_{i}$ .
The proposed approach is based on the minimization of the objective function M(L), which reflects the overall performance of the manipulator by associating two separate indexes for the parallel chain and the serial chain with giving more weight to the parallel part, since the serial chain has a good performance even at the edges of the workspace. Indeed, the performance of the whole device is related to each chain and the performance of the device can reach a good level only when the performance of both parts is good. By this association, we manage to have a performance indicator of the whole manipulator. This approach is based on using a genetic algorithm (GA) method [Reference Shorman and Pitchay33–Reference Zeghloul and Rambeaud35]. The optimization problem is stated as follows:
Subject to,
With
where
$\overline{\mu }_{P}\left(\textbf{L}\right)=\frac{1}{N}\sum _{i=1}^{N}\mu _{i}(\textbf{L})$ : global dexterity of the parallel manipulator.
$\overline{\mu }_{S}\left(\textbf{L}\right)=\frac{1}{N}\sum _{i=1}^{N}\mu _{i}(\textbf{L})$ : global dexterity of the serial chain.
$\sigma$ : weighting coefficient ( $0\lt \sigma \lt 1$ ). $\sigma =0.7$ .
$\mathrm{P}_{j}(E_{i})$ : constraint of the existence of the workspace.
$M(\textbf{L})$ : Objective functions defining the criteria, the kinematic performance, to optimize.
$\textbf{V}$ : Design vector of the parallel chain with the length $L_{i}\,$ ; i∈ {1,2,3}, the distance $a$ representing the dimension of the base and the distance H between the PC plane and the CoR.
$\delta$ : the safety margin for singularity avoidance.
4.2. Genetic algorithm method, optimization and results
GAs are heuristic search algorithms based on the mechanism of natural selection and natural genetics initially proposed by Holland [Reference Holland, Selfridge, Rissland and Arbib36]. They have been used in a variety of engineering fields such as in machine design. A real-coded GA [Reference Goldberg37] is used here to solve the optimization problem.
In the present application, each individual is a design vector, $\textbf{L}=[\begin{array}{cccc} L_{1} & L_{2} & L_{3} & a \end{array} H]^{\mathrm{T}}$ . It corresponds to the nHH manipulator, and its characteristics are design parameters. A population of 50 individuals is manipulated through 300 generations.
The algorithm is allowed to select the optimal values of the design parameters in the bounding intervals given in Table I.
The optimal design vector $\textbf{L}_{\textbf{op}}$ obtained using the GA is presented by the following:
The figure below represents the dexterity distribution of the parallel chain within its workspace in the plane $(X,Y)$ with a self-rotation of the moving platform equal to 0°.
The optimization of the serial chain is obtained by optimizing the distance H between plan of the parallel chain and the CoR. In fact, as mentioned in the Section 2, the projection of the cone in the parallel chain plane yields to a circular border defined by $E_{i}$ (Fig. 13) with the radius linked to the distance H. The coordinates of the points $E_{i}$ are given by Eq. (35).
With
Figures 14 and 15 give a visual representation of the task workspace in the PC plane and 3D representation of the workspace with nHH device, respectively.
5. Numerical validation of haptic feedback and comparison
The nHH device represents the master station of a master–slave platform. This device is used to control the slave robot and ensure the force feedback in case of the slave robot interaction with its external environment. The nHH device is designed using a mechanical solution based on a capstan associated with a simplex DC motor. A set of four capstans and four simplex DC motors can be observed on the prototype. The capstan for the revolute joint is with a ratio of 4.1 and the one for the translation is with a ratio of 3.4. Regarding the actuation, the DC motors present a nominal torque of 0.8 [Nm]. The first numerical validation is presented in this section and in future works, the experimental study will be developed and validated. So, in order to validate the kinematic performance of the optimal solution, in this section the model of the nHH device is developed using a SimMechanics model based on rigid-body dynamics according to the scenario presented in Figs. 16 and 17. For different configuration $N(Nx,Ny)$ of the nHH as presented in Fig. 18, we determine the feedback force on the end-effector by applying the torques on the actuated joints. In addition, a comparison study is performed to prove the efficiency of the proposed architecture of nHH device.
The nHH device is assumed to be a rigid body; therefore, deformations are not considered in this study. A function that calculates the actuated joint torques is constructed. The inputs to this function are the references forces $\textbf{F}_{EF}$ and $\textbf{f}$ , which are the force vector applied on the end effector of the mobile parallel platform as presented in Fig. 16, respectively.
The analytic method to compute the actuated joint torques of the parallel chain for a given reference force $\textbf{f}$ is defined by the following relation:
with
$\textbf{f}$ : force applied on the parallel mobile platform, $\textbf{f}=[\begin{array}{ccc} f_{x} & f_{y} & m_{z} \end{array}]^{\mathrm{T}}$ .
$\textbf{J}_{\boldsymbol{P}}^{\boldsymbol{T}}$ : Transpose of the Jacobian matrix of the parallel manipulator.
$\boldsymbol{\tau }$ : Actuated joints torque, $\boldsymbol{\tau }=[\begin{array}{ccc} \tau _{1} & \tau _{2} & \tau _{3} \end{array}]^{\mathrm{T}}$ .
The input are the actuated joints torques calculated using the equation above. The output is the applied force on the end effector.
The relation between the two efforts is denoted by Eq. (37). The joint torque is inserted into the SimMechanics model to compute the force $\textbf{F}_{EF}$ , for different configurations.
with
For $M_{z}=m_{z}=0$ , the relation between the applied effort on the end effector and the mobile platform is given by the equations below:
Table II resume the applied torques, analytic force value, and the simulation force value on the end effector for the four different configurations $N(Nx,Ny)$ at the edges of the workspace as presented in Fig. 18 $N(Nx,Ny)$ . Both the analytic and the simulation forces where calculated using the serial chain and the parallel chain of the nHH device.
As follows from the table shown above, we manage to prove that the proposed HH device has a good force feedback and capable to regenerate the force applied by the surgeon in order to stimulate the real and the virtual environment. Despite the fact that the chosen points where we calculate the force feedback are at the edges of the workspace (with an altered dexterity index), we still manage to have suitable feedback where the error does not exceed 2% for a force applied along the X axis as presented in Fig. 18.
The next a comparison between the nHH and the SPM [Reference Saafi, Laribi and Zeghloul12, Reference Zhang, Xu, Mechefske and Xi38] devices is performed. The SPM, as the nHH device, is meant to be used as a haptic device in robotic system for minimally invasive surgery application. In order to prove the efficiency of the proposed architecture of nHH device, a comparison study is proposed [Reference Saafi and Lamine39].
The comparison of the two manipulators is based on the capability of each device to perform motions around a specific point in its workspace. Dexterity, which represent the amplification of errors as a result of kinematic and static transformation between cartesian and joints spaces, is chosen to evaluate the kinematic for each manipulator. For the SPM, the dexterity has been calculated and determined by Saafi [Reference Saafi, Laribi and Zeghloul13, Reference Saafi, Laribi and Zeghloul23].
Based on results in [Reference Saafi, Laribi and Zeghloul23], the maximum value of the dexterity that can be reached is about $0.4$ at the center of the workspace with a self-rotation $\varphi =0^{\circ}$ .
The comparison is based on choosing a recorded trajectory in the workspace of both manipulators, then calculate the dexterity along this path. The trajectory has been obtained during a recorded surgeon motion in a real mini-invasive surgery task using a motion capture system [Reference Laribi, Riviere, Arsicault and Zeghloul24]. Figure 19 gives a graphical representation of the trajectory in the plane $(\psi, \theta ).$
The same trajectory was implemented on the nHH device. The obtained results for different values of self-rotation, $\varphi =0^{\circ}$ , $\varphi =50^{\circ}$ , and $\varphi =-10^{\circ}$ , are shown in Figs. 20, 21 and 22, respectively.
Table III resumes the maximum, minimum and mean dexterity along the chosen trajectory for both manipulators with a self-rotation φ = 0°.
Table IV resume dexterity values along the chosen trajectory for both manipulators with a self-rotation φ = 50°.
Table V resume dexterity values along the chosen trajectory for both manipulators with a self-rotation φ = −10°.
For a self-rotation φ = 0° and along the chosen trajectory, the SPM’s dexterity goes from 0.38 to 0.12. This is explained by the presence of singularities inside the workspace that alters the kinematic performance and amplifies the errors. Moreover, near singular configurations, the self-rotation is no more controllable. However, the nHH device represents a good dexterity along the same trajectory which can reach 0.55 at it is maximum.
Consider Fig. 21, which plots the SPM’s dexterity against the nHH’s dexterity for a self-rotation φ = 50°. From the resulting plot, we can confirm that the SPM have a bad kinematic performance. The new haptic device presents a maximum dexterity of 0.59. This value is greater than the SPM’s which is limited to 0.3.
According to the results presented above by the three figures and the three tables, the suitability and potential of the novel architecture as a haptic interface for surgical tasks. Since the dexterity of the nHH device is above 0.3412 for the different orientations and along the chosen trajectory, the new hybrid manipulator is adequate for many tasks, especially for minimally invasive surgical ones.
6. Conclusion
In this paper, we proposed a new hybrid haptic (nHH) device with a fixed center of rotation and 4-doF. The nHH is designed to be used as a master device in robotic platform dedicated to laparoscopic surgery. The proposed device is an association of two chains, a serial and a parallel chain. The serial chain (SC) allows to handle the translational motion (1-dof) and the parallel chain (PC) allows to handle the rotational motion (3-dofs), mainly the two tilt motions and the self-rotation.
The geometric parameters of the nHH device were optimized in order to fit the task workspace as well as a best kinematic performance distribution over its workspace. Global dexterity has been chosen as a criterion to characterize this kinematic performance. A safety margin distance is included in the optimization to eliminate singular region from the workspace. A kinematic model of the nHH device has been developed and validated using a SimMechanics model.
A comparison study has been performed between the proposed device and a SPM dedicated to a similar application. A real surgeon gesture is considered for the orientation of the master device. The results obtained prove that the nHH device presents a more interesting behavior then the SPM and still far from singularity. The global dexterity index is over 0.5 and its value is not altered by the self-rotation, which is one of the major limitations of the SPM.
The CAD model and first prototype of the nHH device are presented and will be used in future work which will be focused on the master-slave scheme and haptic control implementation.
Authors’ contributions
M.M., H.S., A.M., M.A., and M.A.L. conceived and designed the study. M.M., M.A., and M.A.L. conducted and analyzed the numerical experiments. M.M., H.S., A.M., M.A., S.Z., and M.A.L. wrote the article.
Financial support
This work was financially supported by the “IRP-RACeS” program IRP: Robotic Assisted System for Safe Cervical Surgery supported by the CNRS in France and European program of international students’ mobility.
Ethical considerations
None.
Competing interests
The authors declare no competing interests.