Mturk Data

Mturk Data is your HIT publishing resource for all things Mechanical Turk. [email protected]

[Mturk Data @mturkdata]

@wagieeacc @codethazine @fareesh It is almost like they want to fail mturk so they can close it and be done with it. Billing is a nightmare now and getting setup is a horror script.

[Mturk Data @mturkdata]

@morungos @squig @MachineCirce @ShuhBillSkee @gpaolacci Thanks Stuart!

[Mturk Data @mturkdata]

@opinonhaver It is all self report through questions amazon asks participants. IMO it is not worth it. I do a short prescreen survey and then invite back participants who meet the demographic. It usually works out to be less expensive than using the premium qualifications.

[Mturk Data @mturkdata]

@bmwiernik @mjskay @syardi Part of the problem was they were trying to push new AWS on mturk when a majority of users wanted a simple clean interface that was easy to use. I honestly think they have just given up because it is easier than listening to users.

[Mturk Data @mturkdata]

@jimmyroybloom Good video on the basics. This guide should be used in conjunction with it https://t.co/N4Rf3VyMvW Just publishing a survey without understanding the platform can lead to poor quality results.

[Mturk Data @mturkdata]

@MirzayevEmil You have to do it with the mturk API. There was a cool tool using R but mturk decided to recode and broke it. I think someone reconfigured it MTurkR if you want to try that.
Otherwise one at a time :)

[Mturk Data @mturkdata]

@RyanKennedy7 We have been used as a middleman because we are not Amazon. It might help. But you would be paying us for something that you can do yourself.

[Mturk Data @mturkdata]

@DrChrisWiese Could not have said it better myself.

[Mturk Data @mturkdata]

@BBCNews @PayPal raised fees on the entire site. It is not a UK/Europe thing, it is a major cash grab worldwide. You can only raise fees so much before your customers leave. Wire transfers are less convenient but much cheaper.

[Mturk Data @mturkdata]

@farid_anvari I agree, we have done daily diary studies with set time frames in the past using 3-4 hour windows for completion using emails. As long as participants know the schedule on the initial screen, they work fairly well.

[Mturk Data @mturkdata]

@farid_anvari Why would phone numbers be needed? Emails on mturk are anonymous when using the API and prolific sends messages through the platform so email addresses are not needed. Longitudinal studies can be run on both.

[Mturk Data @mturkdata]

@SheRambl @theKareemWillis @Prof_JJohnson Cloud Research uses mturk for participant sourcing. You could also use Prolific Academic for a different participant pool.

[Mturk Data @mturkdata]

@tarariggs On the first wave make your qualifications as high as possible. 10k submitted, greater than or equal to 99% approval. Have increasing payments for each wave and a bonus for completion of all parts.

[Mturk Data @mturkdata]

@richpage @peeplaja Screening is critical. Although self reported about 15% on mturk make over 100k https://t.co/AdvCOuy6hZ

[Mturk Data @mturkdata]

@QuinettaPhD Yes, and different variations. Successful completion of entire study receives bonus which was described in briefing as passing ACQs. Another was comprehension failure/ACQ failure disqualifies bonus.

[Mturk Data @mturkdata]

@AnitaBlanchard What were your HIT qualifications? Did you prescreen?

[Mturk Data @mturkdata]

@thuyvytnguyen @dilipsoman When you are doing 1000 or 10000 studies, the service they offer on the payment and recruitment side is worth it.

[Mturk Data @mturkdata]

@uma_karma @ZhihaoGZhang Completely agree, they are effective and increase data quality.

[Mturk Data @mturkdata]

@mark_riedl @MichaelDoronII I would not say that it is unreliable, but it has changed and requires better screening and additional security to ensure you are getting the participants you are looking for. It is disappointing the premium @amazonmturk is charging for the quality of service though.

[Mturk Data @mturkdata]

@ResearchEthics2 @LSEImpactBlog A lot of sound practices in that blog along with the additional link https://t.co/wACHPmP8NK