Support vector machine (SVM) is a kind of machine learning method, but the selection of parameters has important effects on the generalization ability of SVMs. In this study, the relation between the error penalty parameter C, kernel parameter σ and the generalization ability of SVMs is discussed. Parameter C adjusts the similarity among within-class members, while parameter σ adjusts the similarity between classes. Moreover, C and σ balances each other mutually within a certain range, which forms a fan-shaped optional parameter distribution region. The optimal parameter area should be located near the center of the sector where both C and σ are small. According to this, a method is suggested to first search a suitable area with coarse grids, and then determine the optimal parameter within the area with a fine bilinear grid. Experimental results show that the new parameter selection method can not only avoid local optima, and thus excluding the cases in which C and σ are big and unstable, but also can be extremely fast in searching process. Compared with other parameter selection methods, the performance of SVMs cannot be influenced, or even better in some cases.
목차
Abstract 1. Introduction 2. The Relation between the Performance of SVMs with Gaussian Kernels and Parameter C and σ 2.1. The Relation between Error Penalty Parameter C and Generalization Ability of SVMs 2.2. The Relation between the Kernel Parameter σ and the Generalization Ability of SVMs 2.3. Rethinking of the Relation between (C, σ) and the Generalization Ability of SVMs 2.4. The Optimal Ranges of (C, σ) 3. The Improvements of Parameter Selection Method for SVMs with Gaussian Kernel 4. The Relation between the Distribution Characters of 2(,)Cσ and Sample Dimensionality 5.Conclusion Acknowledgements References
Zhigang Yan [ School of Environmental Science and Spatial Informatics, China University of Mining and Technology, Jiangsu Key Laboratory of Resource and Environmental Information Engineering, China University of Mining and Technology, Xuzhou City, Jiangsu Province, 221116, P.R.China ]
Corresponding author
Yuanxuan Yang [ School of Environmental Science and Spatial Informatics, China University of Mining and Technology, Jiangsu Key Laboratory of Resource and Environmental Information Engineering, China University of Mining and Technology, Xuzhou City, Jiangsu Province, 221116, P.R.China ]
Yunjing Ding [ School of Environmental Science and Spatial Informatics, China University of Mining and Technology, Jiangsu Key Laboratory of Resource and Environmental Information Engineering, China University of Mining and Technology, Xuzhou City, Jiangsu Province, 221116, P.R.China ]
보안공학연구지원센터(IJSIP) [Science & Engineering Research Support Center, Republic of Korea(IJSIP)]
설립연도
2006
분야
공학>컴퓨터학
소개
1. 보안공학에 대한 각종 조사 및 연구
2. 보안공학에 대한 응용기술 연구 및 발표
3. 보안공학에 관한 각종 학술 발표회 및 전시회 개최
4. 보안공학 기술의 상호 협조 및 정보교환
5. 보안공학에 관한 표준화 사업 및 규격의 제정
6. 보안공학에 관한 산학연 협동의 증진
7. 국제적 학술 교류 및 기술 협력
8. 보안공학에 관한 논문지 발간
9. 기타 본 회 목적 달성에 필요한 사업
간행물
간행물명
International Journal of Signal Processing, Image Processing and Pattern Recognition
간기
격월간
pISSN
2005-4254
수록기간
2008~2016
십진분류
KDC 505DDC 605
이 권호 내 다른 논문 / International Journal of Signal Processing, Image Processing and Pattern Recognition Vol.6 No.5