A novel approach is proposed to recognizing human actions from different views by view knowledge transfer. A topic model was trained in the source view, the semantic topics were transferred to the target view for learning a new topic model via a semi-latent manner. For a new video in target view, the topics inferenced by the target topic model can be transferred to the source view for action recognition.