Journal of Terahertz Science and Electronic Information Technology , Volume. 18, Issue 5, 918(2020)

A network traffic classification method based on Hadoop platform CloudSVM

DENG He*, TANG Yitao, HE Zongmei, and YUAN Aiping
Author Affiliations
  • [in Chinese]
  • show less

    Large-scale net flow training data sets are inevitable requirements for building high-quality, highly stable network traffic classifiers. However, with the increase of the feature dimension of the network stream and the expansion of the data set size, neither the analysis processing of the network stream nor the training of the classifier model based on Support Vector Machin(SVM) can obtain effective processing results in effective time. A distributed and parallel large-scale network flow based on Hadoop cloud computing platform is proposed. Distributed learning and training of SVM network traffic classifier is implemented by MapReduce technology on Hadoop cloud computing platform, and CloudSVM network traffic classifier is constructed. Through the distributed storage and processing of trace files of large-scale network traffic from the campus network export mirror, the sample data sets are classified, and the distributed storage and parallel processing of large-scale network data based on Hadoop platform is experimentally verified. The high efficiency of the set also verifies that the CloudSVM classifier can quickly converge to the best without reducing the accuracy of the classification, and with the increase of large-scale network flow samples, the training time of the SVM classifier is approaching constant.

    Tools

    Get Citation

    Copy Citation Text

    DENG He, TANG Yitao, HE Zongmei, YUAN Aiping. A network traffic classification method based on Hadoop platform CloudSVM[J]. Journal of Terahertz Science and Electronic Information Technology , 2020, 18(5): 918

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Oct. 20, 2019

    Accepted: --

    Published Online: Jan. 22, 2021

    The Author Email: He DENG (57898971@qq.com)

    DOI:10.11805/tkyda2019406

    Topics