Earticle

현재 위치 Home

On the Generation of Accurate Predictive Model from Highly Imbalanced Data with Heuristics and Replication Techniques

첫 페이지 보기
  • 발행기관
    보안공학연구지원센터(IJBSBT) 바로가기
  • 간행물
    International Journal of Bio-Science and Bio-Technology SCOPUS 바로가기
  • 통권
    Vol.4 No.1 (2012.03)바로가기
  • 페이지
    pp.49-64
  • 저자
    Nittaya Kerdprasop, Kittisak Kerdprasop
  • 언어
    영어(ENG)
  • URL
    https://www.earticle.net/Article/A207028

※ 원문제공기관과의 협약기간이 종료되어 열람이 제한될 수 있습니다.

원문정보

초록

영어
Recent advancement in the field of life science data mining has inspired researchers and healthcare professionals to apply this novel technology to obtain descriptive patterns and predictive models from biomedical and healthcare databases. The discovery of hidden biomedical patterns from large clinical database can uncover potential knowledge to support prognosis and diagnosis decision makings. However, clinical application of data mining algorithms has a severe problem of low predictive accuracy rate that hampers their wide usage in the clinical environment. We thus focus our study on the improvement of predictive accuracy of the models created from the data mining algorithms. Our main research interest concerns the problem of learning a classification model from a multiclass data set with low prevalence rate of some minority classes. With such data characteristics, directly applying classification data mining techniques such as decision tree induction, regression analysis, neural networks, or support vector machines yields a suboptimal model in terms of predictive accuracy rate. To remedy the imbalanced class distribution among data instances, we apply random over-sampling and synthetic minority over-sampling (SMOTE) techniques to increase the predictive performance of the learned model. In our preliminary study, we consider specific kinds of primary tumors occurring at the frequency rate less than one percent as rare and minority classes. From the experimental results, the SMOTE technique gave a high specificity model, whereas the random over-sampling produced a high sensitivity classifier. The precision performance of a classification model obtained from the random over-sampling technique is on average much better than the model learned from the original imbalanced data set. We then extend our study by designing the heuristic based method to cope with the abundance of irrelevant feature that causes the decrease in learning time and sometimes lower the accuracy rate. The over-sampling technique and the heuristic-based feature selection are coupled as a data preparation method to deal with imbalanced data sets with many irrelevant features. The experimental results on arrhythmia and communities-and-crime data sets show significant improvement on the predicting accuracy, specificity, and sensitivity of the induced models.

목차

Abstract
 1. Introduction
 2. Accuracy Measurement Metrics on Classification Models
 3. Preliminary Results on Primary Tumor Prediction
 4. Data replication and heuristic-based feature selection techniques
 5. Experimental Results on Arrhythmia and Communities-and-crime Data
 6. Conclusion
 Acknowledgement
 References

키워드

Classification model Learning from imbalanced data Heuristic-based feature selection Data replication Over-sampling technique Rare case prediction

저자

  • Nittaya Kerdprasop [ Data Engineering Research Unit, School of Computer Engineering, Suranaree University of Technology ]
  • Kittisak Kerdprasop [ Data Engineering Research Unit, School of Computer Engineering, Suranaree University of Technology ]

참고문헌

자료제공 : 네이버학술정보

간행물 정보

발행기관

  • 발행기관명
    보안공학연구지원센터(IJBSBT) [Science & Engineering Research Support Center, Republic of Korea(IJBSBT)]
  • 설립연도
    2006
  • 분야
    공학>컴퓨터학
  • 소개
    1. 보안공학에 대한 각종 조사 및 연구 2. 보안공학에 대한 응용기술 연구 및 발표 3. 보안공학에 관한 각종 학술 발표회 및 전시회 개최 4. 보안공학 기술의 상호 협조 및 정보교환 5. 보안공학에 관한 표준화 사업 및 규격의 제정 6. 보안공학에 관한 산학연 협동의 증진 7. 국제적 학술 교류 및 기술 협력 8. 보안공학에 관한 논문지 발간 9. 기타 본 회 목적 달성에 필요한 사업

간행물

  • 간행물명
    International Journal of Bio-Science and Bio-Technology
  • 간기
    격월간
  • pISSN
    2233-7849
  • 수록기간
    2009~2016
  • 등재여부
    SCOPUS
  • 십진분류
    KDC 505 DDC 605

이 권호 내 다른 논문 / International Journal of Bio-Science and Bio-Technology Vol.4 No.1

    피인용수 : 0(자료제공 : 네이버학술정보)

    함께 이용한 논문 이 논문을 다운로드한 분들이 이용한 다른 논문입니다.

      페이지 저장