I’m excited to announce the launch of No-Spin Evidence Review - a new online publication of the Coalition for Evidence-Based Policy. We summarize recent program evaluations & explain what the evidence really shows. See example below & check out No-Spin at https://t.co/TqolOtZgUY.
New: Our No-Spin report on a Science-published RCT of a "Social Belonging" writing exercise to promote student persistence in college. Despite the abstract's positive portrayal of results, the study found null effects on 1 prespecified hypothesis & doesn't report the other 2.🧵
6/ Such post-hoc findings may provide useful hypotheses for future research but are only preliminary – not reliable – under established standards (FDA, IES), as they could be chance results stemming from the study’s examination of multiple subgroups and analyses.
Check out Gov. Wes Moore's compelling remarks on the Maryland Partnership for Proven Programs—a $40M collaboration between @GovWesMoore, @Arnold_Ventures, & Coalition for Evidence-Based Policy to expand programs with strong evidence of meaningful improvements in people's lives.
5/ Such post-hoc findings are considered exploratory - i.e., suggestive but not yet reliable - under established standards (IES, FDA). Here's our No-Spin report: https://t.co/g4begooRyL. Here's the published paper: https://t.co/SJn03K8wds
New: Our No-Spin report on an RCT of Bernie's Book Bank, published in PNAS. The study reports positive impacts on reading, but these results are based on a post-hoc subgroup analysis. The primary findings aren't reported, preventing reliable conclusions about program impact.🧵
4/ The study instead reports positive results of a post-hoc (not prespecified) analysis, that focused on the subgroup of students in grades 1 & 2 at study entry & made other key departures from the prespecified analysis.
8/ Disclosure: Arnold Ventures, which funds No-Spin Evidence Review, helped fund the CEO program as part of this study. Here's our No-Spin report: https://t.co/koF8WXsEsL. Here's the full study report from Mike Puma Associates: https://t.co/rqUTeUQ1iO
New: Our No-Spin report on an RCT of Center for Employment Opportunities (CEO)'s Transitional Jobs Program for High-Risk Male Parolees. In brief: This well-conducted RCT found no effects on reincarceration over ~22 months or employment at the 1 year mark.🧵
7/ Although the study report was finalized in 2017 and briefly summarized and cited in a 2020 publication of the U.S. Department of Labor (DOL), we only recently obtained the full unpublished report from the study author, enabling us to review it for No-Spin.