Research on the control of inverted pendulum system has been enduring topic in the field of control, inverted pendulum system is a high order and naturally unstable system, it is susceptible to outside interference and some uncertain factors so that it loses its stable equilibrium. It is difficult to achieve the system’s global robust anti-jamming ability using the conventional sliding mode control, at the same time, there is the chattering phenomenon. Therefore, this paper puts forward sliding mode robust state feedback H_∞ control, that is to say a composite controller is designed with sliding surface parameters and the state feedback gain. The problem is converted into the optimization problem with linear matrix inequalities for solving the optimization value, then the state feedback gain and sliding mode surface are optimized, so that the whole closed-loop control system has the characteristics of fast response of the sliding mode control and robustness of robust control, and gets the global robustness, and getting the realization of the chattering weakened. The simulation results show the effectiveness and feasibility of this method, and it has strong robustness and fast response advantages and has a good control effect for high order unstable system.