Ever had trouble trying to figure out how to "define" what you're trying to measure or how the idea of that measurable property came to be? @AndyEMaul, @MelissaGWolf, and I have an @improvingpsych session for you! Come brainstorm with us about definitions and data generation.
@imdg @mikeroecklein Absolutely. For now at least, being on a boring island that's not that easy to get to seems like a great place to be during a pandemic
@BD_Zumbo @MelissaGWolf@JkayFlake@MeasurementGal@guilfordpress Twitter scares me, so I'm bad at it. Thanks! As of late, I've been interested with the potential for program eval to help imbue meaning "into" ed/psych measurement efforts. A shame that psychometrics and program eval remain so separate when the philosophies are so complementary
@BD_Zumbo @MelissaGWolf@JkayFlake@MeasurementGal Nice! I keep wondering about what psychometrics can learn from discussions in program evaluation (utilization, democratic, locally focused approaches from the likes of Greene, House, and case based approaches of Stake). It seems like this is in that same vein!
@MelissaGWolf And to see thinking about the level of inference that we think is reasonable - is it reasonable to think at levels of individuals or more in terms of (non linear) emergent properties of crowds and networks?
planning a very informal philosophy of stat book club:
- read a chapter a week then discuss on twitter / zoom / maybe slack
- starting the week of august 17th
book: simulation & similarity by @weisbergm
https://t.co/7UyCv5I6n0
potentially of interest to #statswitter
I think we're running out of excuses for justifying statistical models by pointing to various standard cutoff values without connecting features of your data and model to the way those cutoff values came to be.
You know those CFA cutoff values you have memorized (RMSEA <.06, CFI > .9, SRMR <.08)? It turns out they're only accurate for one model (and it prob isn't yours). Learn more about why: https://t.co/H1hEnk1PAW (cc: @dmcneish18) & easily calculate your own: https://t.co/evgwppSfiO
@MelissaGWolf Sometimes I think, "this 'question standard social science measurement practices' stuff we do is just an ivory tower' residing mental exercise." Then standard measurement practice leads to a very problematic decision.
Here are my 3 core takeaways from our #SIPS2020 hackathon on "Modernizing the Instruction of Psychological Measurement", led by @wes_bonifay, @AndyEMaul & me. I also link to the resource lists we generated below.
Attending #SIPS2020? If you're interested in the relationship between measurement and language, we'll be working through the problems at 2PM PST tomorrow. @MelissaGWolf's session at 10AM could be a great place to start - @improvingpsych put together a day of measurement
Noted that you have many great choices on the first day of #SIPS2020 today, but it looks like there's a session on validity evidence (with Lindsay J. Alley & Rachel T Fouladi) right between these two sessions, 12:00-2PM PST. Seems like a great way to focus on measurement today.