FromTheSideline

[FromTheSideline @GrayBeard_49]

@michpsm

[FromTheSideline @GrayBeard_49]

@aapor

[FromTheSideline @GrayBeard_49]

@AAPOR @michpsm

[FromTheSideline @GrayBeard_49]

@jamesheathers @JustinTPickett @socprobsjournal @ASCRM41 @law_soc @jeremyfreese Pickett, Chiricos, Lavin, & Gertz, 50 Criminology 145-186. Included 2005 Research Network RDD sample of 1,575, reported response rate = 39.0%

[FromTheSideline @GrayBeard_49]

@AAPOR @michpsm

[FromTheSideline @GrayBeard_49]

@jamesheathers @JustinTPickett @socprobsjournal @ASCRM41 @law_soc @jeremyfreese Baker, Metcalfe, Berenblum, Aviv, & Gertz, 26 Criminal Justice Policy Review 448-462 (2015). 2009 RDD survey, N=400, response rate = 36.3% (not clear if Research Network survey).

[FromTheSideline @GrayBeard_49]

@AAPOR @michpsm

[FromTheSideline @GrayBeard_49]

@jamesheathers @JustinTPickett @socprobsjournal @ASCRM41 @law_soc @jeremyfreese Mears, Mancini, Beaver, & Gertz, 59 Crime and Delinquency 587-615 (2013). Research Network 2006 telephone survey, random Florida sample, N=1,308, reported response rate = 48.6%.

[FromTheSideline @GrayBeard_49]

@AAPOR @michpsm

[FromTheSideline @GrayBeard_49]

@jamesheathers @JustinTPickett @socprobsjournal @ASCRM41 @law_soc @jeremyfreese Gajos, Beaver, Gertz, & Bratton, 25 Journal of Criminal Justice Education 368-385 (2014). Research Network 2009 RDD sample, N=420, reported response rate 32.8%.

[FromTheSideline @GrayBeard_49]

@aapor

[FromTheSideline @GrayBeard_49]

@JustinTPickett @socprobsjournal @ASCRM41 @law_soc You note ... response rates reported are surprising, that greatly exceed "typical rate of less than 10 percent obtained by professional polling organizations". Absolutely! How would you assess the other FSU papers using Research Network data? @jamesheathers @jeremyfreese

[FromTheSideline @GrayBeard_49]

@AAPOR states RR6 is "only appropriate when it is valid to assume that none of the unknown cases are eligible ones,". It is misleading (at best) to use RR6, then imply a high rate by comparing to reports based on RR3 rates. @jeremyfreese @jamesheathers @JustinTPickett

[Justin T. Pickett @JustinTPickett]

@GrayBeard_49 AAPOR lists six response rate formulas for RDD, and four cooperation rates. Most of the papers you cite use RR5 or RR6, which often results in about 30% since late 2000s. In earlier years, it was higher.

[FromTheSideline @GrayBeard_49]

@RetractionWatch

[FromTheSideline @GrayBeard_49]

@jamesheathers @JustinTPickett @socprobsjournal @ASCRM41 @law_soc @jeremyfreese There are more, but the pattern is evident. It is clear that the Stewart papers reported cooperation rates as response rates (given the definitions). It is also clear that the multiple years of FSU papers with Research Network RDD surveys report questionable response rates.

[FromTheSideline @GrayBeard_49]

@RetractionWatch

[FromTheSideline @GrayBeard_49]

An impressive investigation by @JustinTPickett. Now look at research using RDD samples conducted by The Research Network for FSU? 10+ years of unverifiable surveys, inconsistent sample sizes, questionable response rates, unreported COI? @AAPOR @ascrm41 https://t.co/Zg9ca6b3NY

[FromTheSideline @GrayBeard_49]

The Pickett investigation also shows communications indicating that not all of the RDD surveys were actually conducted by TRN staff, but rather by student volunteers using the TRN facility. How many surveys were conducted this way where articles claim surveys conducted by TRN?

[FromTheSideline @GrayBeard_49]

An impressive investigation by @JustinTPickett. Now look at research using RDD samples conducted by The Research Network for FSU? 10+ years of unverifiable surveys, inconsistent sample sizes, questionable response rates, unreported COI? @AAPOR @ascrm41 https://t.co/Zg9ca6b3NY

[FromTheSideline @GrayBeard_49]

Based on the Pickett investigation, it appears that Gertz was owner of The Research Network (TRN) and Bratton was research director. No conflict of interest disclosures were reported in the publications where Gertz or Bratton were co-authors (nearly all).

[FromTheSideline @GrayBeard_49]

@cjprofman

[FromTheSideline @GrayBeard_49]

An impressive investigation by @JustinTPickett. Now look at research using RDD samples conducted by The Research Network for FSU? 10+ years of unverifiable surveys, inconsistent sample sizes, questionable response rates, unreported COI? @AAPOR @ascrm41 https://t.co/Zg9ca6b3NY

[Justin T. Pickett @JustinTPickett]

We can trust journal editors. April fools. Pages 177‒81 expose what the editors of three flagship journals (@socprobsjournal @ASCRM41 @law_soc) did behind closed doors (FOIA’d emails) with fraud accusations. Pages 172‒76 cover the coauthors. (1/3)

https://t.co/RMpYLkC0Ry

[FromTheSideline @GrayBeard_49]

@JustinTPickett @ASCRM41 @jeremyfreese @jamesheathers And, many would argue that the appropriate standard for assessing RDD coverage would be AAPOR RR3, that accounts for cases of unknown eligibility.

[FromTheSideline @GrayBeard_49]

@JustinTPickett Yes, the 10% or less is more representative of the AAPOR RR3 rates. Just suggesting using the same standard in making a critique to what you use in your own research. The Stewart articles clearly were reporting a cooperation rate. @ASCRM41 @jeremyfreese @jamesheathers

[FromTheSideline @GrayBeard_49]

@JustinTPickett @socprobsjournal @ASCRM41 @law_soc You argue that "It is also surprising that none of the articles listed a funding source". Agreed. Neither do the numerous articles FSU faculty have published using Research Network surveys over recent years. Fair to ask the same question of them? @jamesheathers @jeremyfreese

[FromTheSideline @GrayBeard_49]

@jamesheathers @JustinTPickett @socprobsjournal @ASCRM41 @law_soc @jeremyfreese There are more, but the pattern is evident. It is clear that the Stewart papers reported cooperation rates as response rates (given the definitions). It is also clear that the multiple years of FSU papers with Research Network RDD surveys report questionable response rates.

[FromTheSideline @GrayBeard_49]

@jamesheathers @JustinTPickett @socprobsjournal @ASCRM41 @law_soc @jeremyfreese Holtfreder, Van Slyke, Gertz, & Bratton.
2008 , Journal of Criminal Justice 36:50-60. 2005 RDD survey (volunteers in commercial space - Research Network?), N=402, reported response rate = 57.0%.