After decades of development, the textile and garment industry is very important part of the national economy of Zhejiang. However, textile and garment companies of Zhejiang have to face anti-dumping, anti-subsidy duties and safeguards of investigation and asked to follow Social Accountability 8000, when they export their good products to the other countries. They have to going to upgrade. Therefore, firstly, it builds factors affecting in Zhejiang textile and garment industry upgrading of model based on research literatures. Secondly, it is going to empirical analysis by questionnaires and draw conclusions: primary indexes followed in order of importance are technological innovation, internal environment, external environment and organizational management system and weight of secondary indexes. The top five of secondary index weights are R & D investment, new product development, industrialization of achievement of technology research, entrepreneurship and human resource management. Finally, it offers suggestions to help textile and garment enterprises of Zhejiang that are trying upgrading. At the same time, it plays a complementary role in quantitative study on factors affecting of textile and garment industry upgrading also.