Deakin University
Browse

File(s) under permanent embargo

Attribute weighted Naive Bayes classifier using a local optimization

journal contribution
posted on 2014-04-01, 00:00 authored by S Taheri, John YearwoodJohn Yearwood, Musa MammadovMusa Mammadov, S Seifollahi
The Naive Bayes classifier is a popular classification technique for data mining and machine learning. It has been shown to be very effective on a variety of data classification problems. However, the strong assumption that all attributes are conditionally independent given the class is often violated in real-world applications. Numerous methods have been proposed in order to improve the performance of the Naive Bayes classifier by alleviating the attribute independence assumption. However, violation of the independence assumption can increase the expected error. Another alternative is assigning the weights for attributes. In this paper, we propose a novel attribute weighted Naive Bayes classifier by considering weights to the conditional probabilities. An objective function is modeled and taken into account, which is based on the structure of the Naive Bayes classifier and the attribute weights. The optimal weights are determined by a local optimization method using the quasisecant method. In the proposed approach, the Naive Bayes classifier is taken as a starting point. We report the results of numerical experiments on several real-world data sets in binary classification, which show the efficiency of the proposed method.

History

Journal

Neural computing and applications

Volume

24

Pagination

995-1002

Location

Berlin, Germany

ISSN

0941-0643

eISSN

1433-3058

Language

eng

Publication classification

C Journal article, C1.1 Refereed article in a scholarly journal

Copyright notice

2013, Springer-Verlag London

Issue

5

Publisher

Springer Verlag