skip to main content
Show Results with:

A Quantitative Method for Substantive Robustness Assessment

Esarey, Justin; Danneman, Nathan

Political science research and methods -- Cambridge University Press -- Volume: 3 1; (pages 95-111) -- 2015

Online access

  • Title:
    A Quantitative Method for Substantive Robustness Assessment
  • Author: Esarey, Justin;
    Danneman, Nathan
  • Found In: Political science research and methods. Volume 3:Issue 1(2015); 2015; 95-111
  • Journal Title: Political science research and methods
  • Subjects: Political science; LCSH: Political science; Dewey: 320
  • Rights: legaldeposit
  • Publication Details: Cambridge University Press
  • Abstract: <x>Abstract</x>

    Empirical political science is not simply about reporting evidence; it is also about coming to conclusions on the basis of that evidence and acting on those conclusions. But whether a result is substantively significant––strong and certain enough to justify acting upon the belief that the null hypothesis is false––is difficult to objectively pin down, in part because different researchers have different standards for interpreting evidence. Instead, this article advocates judging results according to their “substantive robustness,” the degree to which a community with heterogeneous standards for interpreting evidence would agree that the result is substantively significant. This study illustrates how this can be done using Bayesian statistical decision techniques. Judging results in this way yields a tangible benefit: false positives are reduced without decreasing the power of the test, thus decreasing the error rate in published results.


  • Identifier: Journal ISSN: 2049-8470
  • Publication Date: 2015
  • Physical Description: Electronic
  • Shelfmark(s): ELD Digital store
  • UIN: ETOCvdc_100040690227.0x000001

Searching Remote Databases, Please Wait