Earticle

현재 위치 Home

Human-Machine Interaction Technology (HIT)

An Ensemble-Based Hybrid Data Drift Detection Framework Integrating Principal Component Analysis (PCA) and Variational Autoencoder (VAE)

첫 페이지 보기
  • 발행기관
    국제인공지능학회(구 한국인터넷방송통신학회) 바로가기
  • 간행물
    The International Journal of Advanced Smart Convergence 바로가기
  • 통권
    Volume 14 Number 1 (2025.03)바로가기
  • 페이지
    pp.66-74
  • 저자
    Yeonwoo Lee
  • 언어
    영어(ENG)
  • URL
    https://www.earticle.net/Article/A466028

※ 원문제공기관과의 협약기간이 종료되어 열람이 제한될 수 있습니다.

원문정보

초록

영어
This paper presents a novel hybrid data drift detection framework, the Ensemble Modeling-based Hybrid Drift Score (EM-HDS), that integrates Principal Component Analysis (PCA), Variational Autoencoders (VAEs), and ensemble modeling to effectively detect both global structural shifts and localized non-linear variations in feature space. PCA identifies global changes by monitoring variance alignment and principal component transformations, while VAEs enhance sensitivity to localized anomalies through probabilistic modeling of reconstruction errors. The EM-HDS framework integrates complementary techniques using a Random Forest ensemble model, effectively capturing complex, non-linear relationships between PCA and VAE metrics. Experimental evaluations on synthetic datasets with simulated drift and real-world COCO image features demonstrate the robustness and adaptability of the proposed method. EM-HDS delivers superior drift detection performance, significantly improving detection accuracy, particularly in scenarios involving simultaneous global and local drifts, surpassing standalone PCA and VAE approaches. Although the framework requires careful tuning of hyperparameters to adapt to specific datasets, its ability to dynamically adjust to diverse drift patterns makes it a practical and effective solution for real-time monitoring and adaptation in dynamic environments. This research establishes a strong foundation for enhancing the reliability of machine learning models in complex, real-time applications for future work.

목차

Abstract
1. INTRODUCTION
2. RELATED WORK
3. METHODOLOGY
3.1 PCA-Based Drift Detection
3.2 Autoencoder-Based Drift Detection
3.3 Hybrid Drift Score (HDS)
3.4 Variational Autoencoder for Local Drift Detection
3.5 Ensemble Modeling-based Hybrid Drift Score (EM-HDS)
3.6 Dynamic Weighting of EM-HDS
4. EXPERIMENTAL SETUP AND SIMULATION RESULTS
5. CONCLUSION
6. REFERENCE

키워드

Data Drift Principal Component Analysis Autoencoder Feature Space Ensemble Model

저자

  • Yeonwoo Lee [ Professor, Department of Artificial Intelligence Engineering, Mokpo National University, Chonnam, Korea ] Corresponding Author

참고문헌

자료제공 : 네이버학술정보

간행물 정보

발행기관

  • 발행기관명
    국제인공지능학회(구 한국인터넷방송통신학회) [The International Association for Artificial Intelligence]
  • 설립연도
    2000
  • 분야
    공학>전자/정보통신공학
  • 소개
    인터넷방송, 인터넷 TV , 방송 통신 네트워크 및 관련 분야에 대한 국내는 물론 국제적인 학술, 기술의 진흥발전에 공헌하고 지식 정보화 사회에 기여하고자 한다.

간행물

  • 간행물명
    The International Journal of Advanced Smart Convergence
  • 간기
    계간
  • pISSN
    2288-2847
  • eISSN
    2288-2855
  • 수록기간
    2012~2025
  • 십진분류
    KDC 326 DDC 380

이 권호 내 다른 논문 / The International Journal of Advanced Smart Convergence Volume 14 Number 1

    피인용수 : 0(자료제공 : 네이버학술정보)

    함께 이용한 논문 이 논문을 다운로드한 분들이 이용한 다른 논문입니다.

      페이지 저장