<story><title>Laypeople can predict which social-science studies will replicate successfully</title><url>https://journals.sagepub.com/doi/full/10.1177/2515245920919667</url></story><parent_chain><item><author>science4sail</author><text>According to the &amp;quot;method&amp;quot; section, 138 out of 257 candidate (233 final) participants in the study were first-year psychology students - I can&amp;#x27;t help but wonder if this might have biased the study&amp;#x27;s results. The investigators also classified graduate students as laypeople, which doesn&amp;#x27;t quite feel right to me.</text></item></parent_chain><comment><author>losvedir</author><text>Not exactly the same, but there&amp;#x27;s this interesting quiz that presents a number of studies that appeared in Science and Nature and asks you to guess which failed to replicate: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;80000hours.org&amp;#x2F;psychology-replication-quiz&amp;#x2F;&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;80000hours.org&amp;#x2F;psychology-replication-quiz&amp;#x2F;&lt;/a&gt; .&lt;p&gt;After taking that the result in this paper doesn&amp;#x27;t surprise me. I&amp;#x27;m educated, but not in Psychology, and I think most people can tell which studies are more likely to fail to replicate.</text></comment>
<story><title>Laypeople can predict which social-science studies will replicate successfully</title><url>https://journals.sagepub.com/doi/full/10.1177/2515245920919667</url></story><parent_chain><item><author>science4sail</author><text>According to the &amp;quot;method&amp;quot; section, 138 out of 257 candidate (233 final) participants in the study were first-year psychology students - I can&amp;#x27;t help but wonder if this might have biased the study&amp;#x27;s results. The investigators also classified graduate students as laypeople, which doesn&amp;#x27;t quite feel right to me.</text></item></parent_chain><comment><author>Xelbair</author><text>Well most social science studies are conducted over the same sample - it just proves that all their results are biased.</text></comment>