Hostname: page-component-78c5997874-j824f Total loading time: 0 Render date: 2024-11-05T14:50:58.011Z Has data issue: false hasContentIssue false

Ensemble modelling or selecting the best model: Many could be better than one

Published online by Cambridge University Press:  01 November 1999

S.V. BARAI
Affiliation:
Department of Civil Engineering, Indian Institute of Technology, Kharagpur-721 302, West Bengal, India
YORAM REICH
Affiliation:
Department of Solid Mechanics, Materials and Structures, Faculty of Engineering, Tel Aviv University, Ramat Aviv 69978, Israel

Abstract

In the course of data modelling, many models could be created. Much work has been done on formulating guidelines for model selection. However, by and large, these guidelines are conservative or too specific. Instead of using general guidelines, models could be selected for a particular task based on statistical tests. When selecting one model, others are discarded. Instead of losing potential sources of information, models could be combined to yield better performance. We review the basics of model selection and combination and discuss their differences. Two examples of opportunistic and principled combinations are presented. The first demonstrates that mediocre quality models could be combined to yield significantly better performance. The latter is the main contribution of the paper; it describes and illustrates a novel heuristic approach called the SG(k-NN) ensemble for the generation of good-quality and diverse models that can even improve excellent quality models.

Type
Research Article
Copyright
© 1999 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)