Xiaowei Yang, South China University of Technology, China; University of Technology Sydney, Australia
Wen Wen, South China University of Technology, China
Zhifeng Hao, South China University of Technology, China
How to assign weights on samples is an important subject in weighted least squares support vector machine (WLS-SVM) for regression problems, which largely influences the robustness of the WLS-SVM. Based on the local outlier factor (LOF), a useful factor for detecting outlier in knowledge discovery, we propose a local-density-ratio (LDR) based weightsetting algorithm for WLS-SVR in this paper. In the proposed algorithm, weights are assigned to the samples according to their neighborhood density ratios. In order to simplify the parameter selection, a single parameter strategy is introduced, which avoids choosing two thresholds in other heuristic weightsetting strategies. Numerical experiments show that the proposed algorithm is able to distinguish most of the noises and produces robust estimator.
Citation:
Zhuangfeng Shao, Xiaowei Yang, Wen Wen, Zhifeng Hao, "A Local-Density-Ratio Based Algorithm for Setting Weight in Weighted Least Squares Support Vector Machine," isda, vol. 1, pp.167-171, Sixth International Conference on Intelligent Systems Design and Applications (ISDA'06) Volume 1, 2006