Through literature review, theoretical analysis and expert research, the paper firstly summarizes 19 factors that affect the quality of construction projects based on the five-party responsibility unit. What's more, the logical relationship between the 19 factors is revealed by using the improved Interpretative Structural Model (ISM), and then these factors are divided into three levels: superficial factors, middle factors and deep factors. Secondly, with the help of the Matriced Impacts Croises-Multiplication Appliance Classement (MICMAC), the research results are verified. The study found that the autonomy factors, dependent factors and independent factors that affect the quality of construction projects based on the MICMAC, and the superficial factors, middle factors and deep factors gained by the ISM are highly consistent in the impact. The high degree of consistency further proves the scientific nature of the classification and relationship of superficial factors, middle factors and deep factors. Finally, on this basis, the research results are used to puts forward three countermeasures to improve the quality of construction projects.