Knowledge Evaluation: Statistical Evaluations

D. Jensen (2002). "Knowledge Evaluation: Statistical Evaluations." Handbook of Data Mining and Knowledge Discovery. Kloesgen, W. and J. Zytkow (Eds.). 475-489, 2002. Oxford: Oxford University Press

Abstract
This section discusses basic features of error estimators, including bias, variance, and loss functions. It outlines the logic behind classical hypothesis testing and explains the special challenges faced by knowledge discovery algorithms that search large model spaces. It discusses the statistical effects of multiple comparison procedures (MCPs), and several methods to adjust for those effects, including mathematical adjustments, cross-validation, and randomization tests. Finally, it outlines the basic concepts behind overfitting reduction and pruning.
Text
A PDF version of this paper is available.

Feedback Back to main page Fineprint