File(s) under permanent embargo
Comprehensive analysis of network traffic data
journal contribution
posted on 2018-03-01, 00:00 authored by Yuantian Miao, Zichan Ruan, Lei PanLei Pan, Jun Zhang, Yang XiangWith the large volume of network traffic flow, it is necessary to preprocess raw data before classification to gain the accurate results speedily. Feature selection is an essential approach in preprocessing phase. The principal component analysis (PCA) is recognized as an effective and efficient method. In this paper, we classify network traffic flows by using the PCA technique together with 6 machine learning algorithms-Naive Bayes, decision tree, 1-nearest neighbor, random forest, support vector machine, and H 2 O. We analyzed the impact of PCA on the classification results by applying each algorithm with and without PCA onto the data set. Experiments were set out by varying the size of input data sets, and the performances were measured from 2 aspects, including average overall accuracy and F-measure. The computational time was also considered in analyzing the performance. Our results showed that random forest and 1-nearest neighbor were the top 2 algorithms among all the 6 regarding the 2 metrics mentioned above. Then we continued the study of PCA impact on per class level with these 2 algorithms as examples. And the positive correlation between overall impact and the number of class with significant impact was revealed. Lastly, the visualization was used in exploring the reasons of the impacts caused by PCA. Two factors are considered in PCA's impact on per class level: benefit for classes grouped by PCA and mislabeled error interfered by nearby groups.
History
Journal
Concurrency and computation: practice and experienceVolume
30Issue
5Article number
e4181Pagination
1 - 16Publisher
John Wiley & SonsLocation
Chichester, Eng.Publisher DOI
ISSN
1532-0626eISSN
1532-0634Language
engPublication classification
C Journal article; C1 Refereed article in a scholarly journalCopyright notice
2017, John Wiley & Sons, Ltd.Usage metrics
Categories
Keywords
network traffic classificationmachine learningdata analyticsperformanceScience & TechnologyTechnologyComputer Science, Software EngineeringComputer Science, Theory & MethodsComputer ScienceFEATURE-SELECTIONALGORITHMSPCAArtificial Intelligence and Image ProcessingComputer SoftwareDistributed Computing