now out in @CompBrainBeh : Lilburn and colleagues suggest that problems in reproducibility in cognitive modeling do not require just technical solutions alone but also consider cultural context https://t.co/Khw24JndzE
@JPdeRuiter@BrianNosek@DBsamuel_phd@djnavarro no doubt; I hope nothing I've said is against that proposition. my point of invoking psychophysics was that the measurement structure was explicit, logically prior to the data, and the theory reflected tight coupling. that coupling can be tight even when inspired more broadly.
@JPdeRuiter@BrianNosek@DBsamuel_phd not they didn't know to look at data, rather it was a new field and one largely prior to modern statistics. the theory of sensory limens/jnds provided the foothold of scaling and informed the experimental design (essentially the point of @djnavarro)
@BrianNosek@djnavarro@DBsamuel_phd Shepard's base of empirical evidence, e.g., was accrued after first developing MDS techniques, which were based on Thurstone's theory of measurement, which generalised psychophysics away from physical quantities. these are theories of measurement preceding the empirical work.
@BrianNosek@DBsamuel_phd in as far as separating evidence from measurement actually makes sense, the psychophysical methods of Fechner, Weber, Wundt, and Helmholtz constitute a theory of measurement prior to the experiments themselves. not a stretch to say they augured the beginning of modern psychology.
@DanFeuerriegel@mr_corcorana this seems true to me. largely I wonder whether the discussion is an acute expression and negotiation of the latent question "do we need to, as a field, rethink what constitutes an explanation".
an absolutely fantastic paper. preregistration can't fix the substantive issue of the misalignment between theory, models, and practice. https://t.co/flPMIt1IWu
@mr_corcorana I hear you. my inclination was the title seemed appropriate for the argument of the paper; the standard of "this is a logically complete proposition outside of the argument of the paper" is a standard I haven't seen many papers reach