Prediction versus accommodation and the risk of overfitting

British Journal for the Philosophy of Science 55 (1):1-34 (2004)
  Copy   BIBTEX

Abstract

an observation to formulate a theory, it is no surprise that the resulting theory accurately captures that observation. However, when the theory makes a novel prediction—when it predicts an observation that was not used in its formulation—this seems to provide more substantial confirmation of the theory. This paper presents a new approach to the vexed problem of understanding the epistemic difference between prediction and accommodation. In fact, there are several problems that need to be disentangled; in all of them, the key is the concept of overfitting. We float the hypothesis that accommodation is a defective methodology only when the methods used to accommodate the data fail to guard against the risk of overfitting. We connect our analysis with the proposals that other philosophers have made. We also discuss its bearing on the conflict between instrumentalism and scientific realism. Introduction Predictivisms—a taxonomy Observations Formulating the problem What might Annie be doing wrong? Solutions Observations explained Mayo on severe tests The miracle argument and scientific realism Concluding comments.

Other Versions

No versions found

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 100,607

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Hitchcock and Sober on Weak Predictivism.Wang-Yen Lee - 2012 - Philosophia 40 (3):553-562.
The Epistemic Role of Prediction in Science.Pekka Syrjänen - 2022 - Dissertation, University of Helsinki
Prediction, Accommodation, and the Logic of Discovery.Patrick Maher - 1988 - PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association 1988:273 - 285.
Accommodation and prediction: The case of the persistent head.David Harker - 2006 - British Journal for the Philosophy of Science 57 (2):309-321.
Prediction versus accommodation in economics.Robert Northcott - 2019 - Journal of Economic Methodology 26 (1):59-69.
Accommodation, Prediction and Bayesian Confirmation Theory.Colin Howson - 1988 - PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association 1988:381 - 392.

Analytics

Added to PP
2009-01-28

Downloads
347 (#79,999)

6 months
21 (#136,957)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Elliott Sober
University of Wisconsin, Madison
Christopher Hitchcock
California Institute of Technology

Citations of this work

Bayesian Philosophy of Science.Jan Sprenger & Stephan Hartmann - 2019 - Oxford and New York: Oxford University Press.
The No Alternatives Argument.Richard Dawid, Stephan Hartmann & Jan Sprenger - 2015 - British Journal for the Philosophy of Science 66 (1):213-234.
Type I error rates are not usually inflated.Mark Rubin - 2024 - Journal of Trial and Error 4 (2):46-71.
Scientific Realism.Anjan Chakravartty - 2011 - Stanford Encyclopedia of Philosophy.
The Value of Surprise in Science.Steven French & Alice Murphy - 2023 - Erkenntnis 88 (4):1447-1466.

View all 93 citations / Add more citations

References found in this work

A System of Logic.John Stuart Mill - 1829/2002 - Longman.
Inference to the Best Explanation.Peter Lipton - 1991 - London and New York: Routledge.
The Logic of Scientific Discovery.Karl Popper - 1959 - Studia Logica 9:262-265.
Conjectures and Refutations.K. Popper - 1962 - Les Etudes Philosophiques 21 (3):431-434.

View all 45 references / Add more references