In this paper, a method for the indirect solution of the optimal control problem (OCP) in the presence of pure state variable inequality constraints (SVICs) and mixed state-control inequality constraints (SCIC), without a need for a close initial guess is presented. In the proposed method, using the finite difference approximation (FDA), the pure SVICs are converted to SCIC. Here, the distance of the constraint function to the feasibility bounds of the constraint is computed in every situation and the control signal is chosen appropriately to facilitate the constraint stays safe. In this method, prior knowledge of the numbers and sequences of activation times is not required. So, it can be simply implemented in continuous boundary value problem (BVP) solvers. The proposed method simply applies the SVICs and since the constraint is directly applied on the control signal, it improves the convergence. On the other hand, because of the convergence problem in the indirect solution of OCP, the simple homotopy continuation method (HCM) is used to overcome the initial guess problem by deploying a secondary OCP for which the initial guess can be zero. The proposed approach is applied on a few comprehensive problems in the presence of different constraints. Simulations are compared with the direct solution of the OCP to confirm the accuracy and with the penalty function method and the sequential constraint-free OCP to confirm the convergence. The results indicate that the FDA method for handling the constraints along with the HCM is easy to apply with acceptable accuracy and convergence, even for highly nonlinear problems in robotic systems such as the constrained time optimal control of a two-link manipulator (TLM) and a three-link common industrial robot.