由神经网络提取规则的一种方法及其应用

A NEW METHOD EXTRACTING RULES FROM ARTIFICIAL NEURAL NETWORK AND ITS APPLICATION

  • 摘要: 提出一种由预处理和规则提取两阶段组成的方法从神经网络中提取规则。预处理阶段包含有动态修正、聚类和删枝3部分。动态修正是自动生成或由初始规则集构造出全联接或非全联接网络初步拓扑结构;聚类和删枝分别删截掉不重要或多余的隐含节点和联接,从而可以得到最简洁和规模小的拓扑结构,成为提取规则的基础。提出了规则提取算法并用于已删截好的网络提取规则。该方法应用于美国AD报告中气象云图的数据,提取出规则集,经过测试数据集的测试表明是正确的和有效的,并且是一种简单、可行的方法.

     

    Abstract: A new method is proposed for extracting general rules from an artificial neural network, which is trained by destructive learning. The method consistes of two phases of preprocessing and rule extracting. The preprocessing phase contains three parts:dynamic modification, cluster and pruning. The dynamic modification generates automatically or constructs a fully connected or non fully connected preliminary topological network having one hidden layer from initial rule set. Redundant and unimportant hidden unites and links are deleted from a trained network respectively in the cluster and pruning phase, and then, the link weights remaining in the network are retrained to obtain the same MSE. Thus, we can obtain a simpler and smaller size network structure and extract a relatively small rule set by using pruned network. The method is applied to meteorologic cloud atlas data from AD reports of USA. Test results using test data set show the correctness and effectiveness of proposed method, and this method is a simple and feasible one.

     

/

返回文章
返回