Sign up
ContentsHideShow

Quant glossary · Research & validation

Selection bias

Selection bias occurs when inclusion of observations, assets, studies or results is related to the quantity being measured.

Definition

Selection bias occurs when the process that determines which observations, assets, studies or results are included is related to the quantity being measured. The selected sample can then differ systematically from the target population. Correcting it requires understanding the selection mechanism, not merely increasing the selected sample size.

How it is calculated

E[Y∣S=1]≠E[Y]\mathbb{E}[Y\mid S=1]\ne\mathbb{E}[Y]

Selection bias is illustrated when the expected outcome among selected cases S=1 differs from the target-population expectation.

Symbol Meaning Unit
E expectation outcome units
Y outcome outcome units
S selection indicator binary

Interpretation

Studying only survivors, winners or published results is like measuring a race after discarding the runners who dropped out. The remaining average may be real for the selected group but not for the population you meant to describe. Selection is part of the data-generating story.

Assumptions and conventions

  • The target population and selection rule are defined.

  • The selection mechanism can be examined or modeled for a correction.

The compared expectations have Y units; S is dimensionless.

Variants

  • The target population and selection rule are defined.

Limitations and common misreadings

  • A large selected sample can still be biased.

  • Selection bias is broader than survivorship bias.

References

  1. James J. Heckman. (1979). Sample Selection Bias as a Specification Error. Econometrica. Sections 1–2. doi:10.2307/1912352. Source

Selection bias FAQ

What is Selection bias?

Selection bias occurs when inclusion of observations, assets, studies or results is related to the quantity being measured.

How is Selection bias calculated?

Selection bias is illustrated when the expected outcome among selected cases S=1 differs from the target-population expectation.

What does Selection bias not tell you or assume?

A large selected sample can still be biased.

Browse all glossary termsResearch and validation termsQuant research library

Definitions are educational and descriptive, not investment advice. Worked examples use labelled sample data.