@hlanthorn@economeager So the more info the better. Representativeness is good to have. I have another paper (https://t.co/qNn3pHVOZp) thinking about representativeness in outcomes and characteristics. But we always wonder about unobserved reasons for site selection and their correlation with the TE
@hlanthorn@economeager Great question @hlanthorn . In this paper, we don't know exactly how sites were selected, which is why we need an instrument. If we knew exactly how sites were selected, we could control for those characteristics (think selection on observables).
@sadish_@economeager Interesting idea! We picked JPAL/IPA because many of their services are specifically targeted towards RCT studies. Whereas other survey firms may work on a mix of RCTs and observational studies. So they differentially change the cost of RCTs vs. observational.
@sadish_@economeager A challenge I can see with survey firms in general is finding a systematic way of cataloging their number over time because I would imagine the cross sectional number is correlated with growth which likely influences treatment effects. Maybe industry associations would help.
@DavidRhysBern@economeager Nice to hear from you, David! The observational studies are selected in their own way since they will be done when its too expensive to experiment. So if costs are correlated with, this will have an impact.
@rglenner@economeager @anthlittle @soashworth @TomPepinsky Interesting! So there are treated and untreated people in the surrounding area, and the RCT encourages people to take the treatment?
@besttrousers@economeager Depending on your objective (most precise inference on the experimental TE for a given observational study, most precise inference on the mean experimental TE across studies...) you could fit our model to get at the question, just not something we've looked at.
@besttrousers@economeager We're after something a bit different. Some studies are observational, some experimental. We want to draw aggregate conclusions. At our most ambitious, we want to predict the experimental TE in an observational study using the RCTs.
I appreciated the chance to read these articles by @bNeethipudi, a student in my economic development source: https://t.co/HGIqfPtQQm https://t.co/fqA8xqaxBJ . Making the social sector inclusive is so important