Practical Regression: Building Your Model: What Variables to Include
This is the third in a series of lecture notes which, if tied together into a textbook, might be entitled “Practical Regression.” The purpose of the notes is to supplement the theoretical content of most statistics texts with practical advice based on nearly three decades of experience of the author, combined with over one hundred years of experience of colleagues who have offered guidance. As the title “Practical Regression” suggests, these notes are a guide to performing regression in practice.
This technical note explains how to choose predictor variables to include in regression. The note begins by explaining the many virtues of parsimony. Sometimes analysts include predictors simply because they are in the available data. Including such "junk" predictors increases the chances of obtaining confusing or misleading results. The note also explores multicollinearity, a favorite topic in some statistics classes that is rarely a problem in real world empirical work. The note concludes by explaining how to work with groups of related variables and describes how to implement the partial F test for joint significance.
Dranove, David. Practical Regression: Building Your Model: What Variables to Include. Case 7-112-003 (KEL637).