Object tracking in video sequence is an important work in intelligent video monitoring. Object tracking is finding relationship among objects in different frames of video sequence. The existed methods of object tracking can not use character information sufficiently, so this paper proposes an object tracking method based on character matching. The results verify that the proposed method can realize real-time precise tracking.