Ching-Hung Wang, Tzung-Pei Hong* and Shian-Shyong Tseng#
Chunghwa Telecommunication Laboratories
Chungli, 326, Taiwan, R.O.C.
* Department of Information Management
Kaohsiung, 840, Taiwan, R.O.C.
# Institute of Computer and Information Science
National Chiao Tung University
Hsinchu, 300, Taiwan, R.O.C.
In this paper, we propose a new hybrid learning algorithm, ETNC, which incorporates the popular decision-tree learning algorithm ASSISTANT into a modified three-layer back-propagation learning method to construct an entropy-tree net classifier. The new learning algorithm also adopts a tree-pruning mechanism to avoid overfitting problems. The new algorithm decreases both the tree size and error rate, especially for complex classification problems. Furthermore, it is not necessary for users to lay out the structure of a tree net in advance; instead, the structure is automatically constructed in the tree-growing process. Finally, the results of experiments in diagnosing brain tumors and classifying sugar canes are described to compare the proposed algorithm with two other learning methods, the back-propagation learning algorithm and ASSISTANT, in terms of accuracy, knowledge complexity and learning speed. Experimental results show that the proposed learning algorithm can provide a good trade-off between accuracy, knowledge complexity and learning speed.
Keywords: back-propagation learning, classification tree, entropy-tree net, information theory
Received December 15, 1995; revised December 12, 1997.
Communicated by Jieh Hsiang.