Sign up
ContentsHideShow

Quant glossary · Research & validation

Replication versus illustration

A replication attempts to reproduce a study's data, sample construction, method and reported result closely enough to test reproducibility.

Definition

A replication attempts to reproduce a study's data, sample construction, method and reported result closely enough to test reproducibility. An illustration uses selected or synthetic inputs to explain a method and does not test the study's claim. The two should be labeled separately because a correct illustration is not evidence that a paper was replicated.

How it is calculated

Replication tests a specified study using its evidence and method; illustration explains a method with labeled example inputs and makes no replication claim.

Interpretation

Replication asks whether a particular result can be rebuilt from the study's ingredients. Illustration asks whether a reader can follow the recipe on a toy input. Confusing them turns a teaching calculation into an unsupported empirical claim.

Assumptions and conventions

  • A replication has access to the required permitted data, code or exact method details.

  • An illustration states its inputs and does not imply paper-specific evidence.

No inherent unit; any reproduced or illustrative statistic retains its stated units.

Limitations and common misreadings

  • A hand calculation of a formula is not a paper replication.

  • A replication can fail because evidence or method details are unavailable, not only because arithmetic is wrong.

References

  1. Committee on Reproducibility and Replicability in Science, Board on Behavioral, Cognitive, and Sensory Sciences, Committee on National Statistics, Division of Behavioral and Social Sciences and Education, Nuclear and Radiation Studies Board, Division on Earth and Life Studies, Board on Mathematical Sciences and Analytics, Committee on Applied and Theoretical Statistics, Division on Engineering and Physical Sciences, Board on Research Data and Information, Committee on Science, Engineering, Medicine, and Public Policy, Policy and Global Affairs, National Academies of Sciences, Engineering, and Medicine. (2019). Reproducibility and Replicability in Science. National Academies Press. Chapter 3, Reproducibility and Replicability in Science. doi:10.17226/25303. Source

Replication versus illustration FAQ

What is Replication versus illustration?

A replication attempts to reproduce a study's data, sample construction, method and reported result closely enough to test reproducibility.

How is Replication versus illustration calculated?

Replication tests a specified study using its evidence and method; illustration explains a method with labeled example inputs and makes no replication claim.

What does Replication versus illustration not tell you or assume?

A hand calculation of a formula is not a paper replication.

Browse all glossary termsResearch and validation termsQuant research library

Definitions are educational and descriptive, not investment advice. Worked examples use labelled sample data.