To reduce the probability of continuous commutation failure in HVDC power transmission system, the occurrence mechanism and influencing factors of continuous commutation failure are analyzed theoretically. A suppressing method of continuous commutation failure based on the limit of maximum short circuit current is proposed, which can be triggered by the signal of first commutation failure, together with voltage dependent current order limiter (VDCOL), and revises the DC current setting value during the faults, so as to mitigate continuous commutation failure. Based on the CIGRE benchmark test model of HVDC, the proposed control method is fulfilled in PSCAD/EMTDC. Simulation results show that the proposed optimal control strategy can mitigate the continuous commutation failure under single-phase grounding and three-phase grounding fault conditions effectively, and realize the smooth recovery of the electrical parameters of the system, and improve the fault recovery performances of system effectively.