IJCCCS
Call For Paper Editorial Board
Home / Archives / Volume 1 Issue 2
RESEARCH ARTICLE

Measuring the Impact of Synthetic Training Data on Cloud Intrusion Detection Under Class Imbalance

Wenke Lee
IJCCCS Journal Cover
CITATION

How to Cite This Article

Wenke Lee, 2026. "Measuring the Impact of Synthetic Training Data on Cloud Intrusion Detection Under Class Imbalance" , IJCCCS , Volume 1, Issue 2, pp. 44-58.
ARTICLE SUMMARY

Abstract

“”

The threat landscape for cloud computing environments continues to evolve and grow more complex. Threats such as unauthorized access, distributed denial-of-service (DDoS) attacks, credential theft, malware activity, and moving laterally through virtualized infrastructure present significant challenges to the security of these systems. Intrusion detection systems (IDSs) provide one means of detecting and preventing these types of malicious actions. However, the performance of IDSs is often limited due to 'class imbalance'issues within the data sets used to train them. Class imbalance refers to situations in which the majority class (e.g., normal or benign network traffic) greatly outnumbers the minority class (e.g., intrusions). When machine learning models are trained with imbalanced data, they tend to predict the majority class and fail to recognize rare, yet highly damaging attacks. One way to address the issue of class imbalance is through the use of synthetic training data. Synthetic training data involves creating additional minority-class examples to assist machine learning models in learning more effectively from the data set. In this research, we investigate the effects of using synthetic training data on cloud intrusion detection under various levels of class imbalance. We have developed an experimental framework that allows us to compare conventional training, random oversampling, and synthetic sampling approaches. Our evaluation metrics include precision, recall, F1-score, area under the receiver operating characteristic curve (AUC-ROC), and area under the precision-recall curve (AUC-PR). Additionally, we evaluate the false-positive rates of each approach, the computational overhead involved in implementation, and the ability of detection models to generalize to previously unseen attack patterns. We place particular emphasis on preventing data leakage, accurately representing real-world traffic, and understanding the limitations of artificially generated attack samples. Rather than assuming that increasing synthetic data will automatically enhance security, we assess whether adding synthetic data results in quantifiable and practical improvements. Our proposed investigation offers a methodical approach to determining which data-balancing strategy best supports reliable, efficient, and robust intrusion detection in dynamic cloud environments.

INDEX TERMS

Keywords

“”

Cloud Security, Intrusion Detection, Synthetic Training Data, Class Imbalance, Machine Learning, Anomaly Detection, Data Augmentation, Cybersecurity, Minority-Class Detection, Model Evaluation.

  1. [1] Alazab, M., Abawajy, J. and Islam, R. (2012) ‘Improving the detection of malicious web requests using cluster-based intrusion detection’, Journal of Network and Computer Applications, 35(6), pp. 1958–1966.
  2. [2] Amachaghi, E., Abdulkareem, S., Foh, C. and Shojafar, M. (2025) ‘Improving intrusion detection in O-RAN with synthetic data generation: A GAN and SMOTE approach’, Telematics and Informatics Reports, 20, article 100269.
  3. [3] Anderson, J.P. (1980) Computer Security Threat Monitoring and Surveillance. Technical report. Fort Washington, PA: James P. Anderson Company.
  4. [4] Breiman, L. (2001) ‘Random forests’, Machine Learning, 45, pp. 5–32.
  5. [5] Chawla, N.V., Bowyer, K.W., Hall, L.O. and Kegelmeyer, W.P. (2002) ‘SMOTE: Synthetic minority over-sampling technique’, Journal of Artificial Intelligence Research, 16, pp. 321–357.
  6. [6] Chen, T. and Guestrin, C. (2016) ‘XGBoost: A scalable tree boosting system’, in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM, pp. 785–794.
  7. [7] Choi, H., Kim, M., Lee, G. and Kim, W. (2019) ‘Unsupervised learning approach for network intrusion detection system using autoencoders’, Journal of Supercomputing, 75, pp. 1635–1660.
  8. [8] Dal Pozzolo, A., Caelen, O., Le Borgne, Y.-A., Waterschoot, S. and Bontempi, G. (2015) ‘Learned lessons in credit card fraud detection from a practitioner perspective’, Expert Systems with Applications, 41(10), pp. 4915–4928.
  9. [9] Dina, A.S., Siddique, A.B. and Manivannan, D. (2022) ‘Effect of balancing data using synthetic data on the performance of machine learning classifiers for intrusion detection in computer networks’, arXiv preprint, arXiv:2204.00144.
  10. [10] Ferrag, M.A., Maglaras, L., Moschoyiannis, S. and Janicke, H. (2020) ‘Deep learning for cyber security intrusion detection: Approaches, datasets, and comparative study’, Journal of Information Security and Applications, 50, article 102419.
  11. [11] Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A. and Bengio, Y. (2014) ‘Generative adversarial nets’, in Advances in Neural Information Processing Systems 27. Red Hook, NY: Curran Associates, pp. 2672–2680.
  12. [12] He, H. and Garcia, E.A. (2009) ‘Learning from imbalanced data’, IEEE Transactions on Knowledge and Data Engineering, 21(9), pp. 1263–1284.
  13. [13] Japkowicz, N. and Stephen, S. (2002) ‘The class imbalance problem: A systematic study’, Intelligent Data Analysis, 6(5), pp. 429–449.
  14. [14] Khraisat, A., Gondal, I., Vamplew, P. and Kamruzzaman, J. (2019) ‘Survey of intrusion detection systems: Techniques, datasets and challenges’, Cybersecurity, 2, article 20.
  15. [15] Krawczyk, B. (2016) ‘Learning from imbalanced data: Open challenges and future directions’, Progress in Artificial Intelligence, 5, pp. 221–232.
  16. [16] Lin, W.-C., Tsai, C.-F., Hu, Y.-H. and Jhang, J.-S. (2017) ‘Clustering-based undersampling in class-imbalanced data’, Information Sciences, 409–410, pp. 17–26.
  17. [17] Mirsky, Y., Doitshman, T., Elovici, Y. and Shabtai, A. (2018) ‘Kitsune: An ensemble of autoencoders for online network intrusion detection’, in Proceedings of the Network and Distributed System Security Symposium. Reston, VA: Internet Society.
  18. [18] Moustafa, N. and Slay, J. (2015) ‘UNSW-NB15: A comprehensive data set for network intrusion detection systems’, in Proceedings of the Military Communications and Information Systems Conference. Canberra: IEEE.
  19. [19] Niyaz, Q., Sun, W. and Javaid, A.Y. (2016) ‘A deep learning based DDoS detection system in software-defined networking’, EAI Endorsed Transactions on Security and Safety, 3(9).
  20. [20] Paszke, A. et al. (2019) ‘PyTorch: An imperative style, high-performance deep learning library’, in Advances in Neural Information Processing Systems 32. Red Hook, NY: Curran Associates, pp. 8024–8035.
  21. [21] Ring, M., Wunderlich, S., Grüdl, D., Landes, D. and Hotho, A. (2019) ‘A survey of network-based intrusion detection data sets’, Computers & Security, 86, pp. 147–167.
  22. [22] Saito, T. and Rehmsmeier, M. (2015) ‘The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets’, PLOS ONE, 10(3), article e0118432.
  23. [23] Salamon, J. and Bello, J.P. (2017) ‘Deep convolutional neural networks and data augmentation for environmental sound classification’, IEEE Signal Processing Letters, 24(3), pp. 279–283.
  24. [24] Sharafaldin, I., Lashkari, A.H. and Ghorbani, A.A. (2018) ‘Toward generating a new intrusion detection dataset and intrusion traffic characterization’, in Proceedings of the International Conference on Information Systems Security and Privacy. Setúbal: SciTePress, pp. 108–116.
  25. [25] Tavallaee, M., Bagheri, E., Lu, W. and Ghorbani, A.A. (2009) ‘A detailed analysis of the KDD CUP 99 data set’, in Proceedings of the Second IEEE Symposium on Computational Intelligence for Security and Defense Applications. Ottawa: IEEE, pp. 1–6.
  26. [26] Van der Maaten, L. and Hinton, G. (2008) ‘Visualizing data using t-SNE’, Journal of Machine Learning Research, 9, pp. 2579–2605.
  27. [27] Van Vlasselaer, V., Bravo, C., Caelen, O., Eliassi-Rad, T., Akoglu, L., Snoeck, M. and Baesens, B. (2015) ‘APATE: A novel approach for automated credit card transaction fraud detection using network-based extensions’, Decision Support Systems, 75, pp. 38–48.
  28. [28] Wang, S., Liu, T. and Wang, L. (2020) ‘An effective convolutional neural network based on SMOTE and Gaussian mixture model for intrusion detection in imbalanced dataset’, Computer Networks, 177, article 107315.
  29. [29] Xu, L., Skoularidou, M., Cuesta-Infante, A. and Veeramachaneni, K. (2019) ‘Modeling tabular data using conditional GAN’, in Advances in Neural Information Processing Systems 32. Red Hook, NY: Curran Associates, pp. 7335–7345.
  30. [30] Zhang, Y., Chen, X., Jin, L., Wang, X. and Guo, D. (2019) ‘Network intrusion detection: Based on deep hierarchical network and original flow data’, IEEE Access, 7, pp. 37004–37016.