Definition
A replication attempts to reproduce a study's data, sample construction, method and reported result closely enough to test reproducibility. An illustration uses selected or synthetic inputs to explain a method and does not test the study's claim. The two should be labeled separately because a correct illustration is not evidence that a paper was replicated.
How it is calculated
Replication tests a specified study using its evidence and method; illustration explains a method with labeled example inputs and makes no replication claim.
Interpretation
Replication asks whether a particular result can be rebuilt from the study's ingredients. Illustration asks whether a reader can follow the recipe on a toy input. Confusing them turns a teaching calculation into an unsupported empirical claim.
Assumptions and conventions
-
A replication has access to the required permitted data, code or exact method details.
-
An illustration states its inputs and does not imply paper-specific evidence.
No inherent unit; any reproduced or illustrative statistic retains its stated units.
Limitations and common misreadings
-
A hand calculation of a formula is not a paper replication.
-
A replication can fail because evidence or method details are unavailable, not only because arithmetic is wrong.
References
- Committee on Reproducibility and Replicability in Science, Board on Behavioral, Cognitive, and Sensory Sciences, Committee on National Statistics, Division of Behavioral and Social Sciences and Education, Nuclear and Radiation Studies Board, Division on Earth and Life Studies, Board on Mathematical Sciences and Analytics, Committee on Applied and Theoretical Statistics, Division on Engineering and Physical Sciences, Board on Research Data and Information, Committee on Science, Engineering, Medicine, and Public Policy, Policy and Global Affairs, National Academies of Sciences, Engineering, and Medicine. (2019). Reproducibility and Replicability in Science. National Academies Press. Chapter 3, Reproducibility and Replicability in Science. doi:10.17226/25303. Source

