Abstract: The concept of equivalent matrix, which expresses equivalent relation, is introduced;the relations between equivalent matrix and equivalent classification are discussed. Proposed algorithm for data cleaning and rule extraction in knowledge system based on matrix computation and its complexity of computation is analyzed. All rules hidden in knowledge system can be obtained efficiently via this algorithm. This algorithm emphasizes the practicability of rule generation and case study indicates that it is valuable.