Why masters only?

Discussion in 'General' started by prakashkl, Nov 9, 2012.

  1. prakashkl

    prakashkl User

    Recent times, there are flood of hits where masters are permitted to work. The number of hits are increasing day by day. Visible decrease in the number of hits, normal turkers are allowed to work. I think it will increase as time passes. Lot of changes are happening in Mturk.
     
    Last edited by a moderator: Nov 9, 2012
  2. iceblink

    iceblink User

    Well, they added a 3rd masters qual entitled simply "Masters" and a lot of the new requesters seem to be using that.

    The annoying thing is, I checked and over 20,000 people have this new qual and I still don't :(
     
  3. prakashkl

    prakashkl User

    What may be the criteria?. I am sure number of hits submitted is not the one.
     
  4. gingery

    gingery Member

    If you look at the requester part of the mturk site you can find (slightly) more information:

    I'm guessing "demonstrated accuracy" is part of it?
     
  5. ewd76

    ewd76 User

  6. sunny4691

    sunny4691 Active Member

  7. Khalinov

    Khalinov User

    That is an interesting read. I hadn’t realized that Masters was the combination of Categorization and Photo; I thought it was an entirely new qualification.

    Hmmm:

    Code:
    Categorization Masters       Qualified Users:      2405
    Masters	                     Qualified Users:     20686
    Photo Moderation Masters:    Qualified Users:      3160
    
    Now I am not so sure it is.

    It must be a very small part of it; I passed 90,000 approved recently with a 99.6% approval rate. :p
     
    Last edited by a moderator: Nov 12, 2012
  8. That was an awesome blog, too. Great find, ewd76.

    Amazon gets their cut from the requesters for each HIT they post. For a special qual as the Masters, I think Amazon is charging them more. I see no other reason why they are endorsing the Masters qual to such an extent that they're assigning it, BY DEFAULT for every HIT!!!
     
    Last edited by a moderator: Nov 12, 2012
  9. mturkconsultant

    mturkconsultant Verified Requester / HIT Consultant

    I wrote that blog post.

    @Khalinov: You're wrong. I actually asked a lot of Master workers if they had the qualification and every single one with Cat or Photo did. None who had lost it had it, and no new workers reported getting it in droves. That means the counter is broken.

    Amazon makes 10% off of every HIT. They charge 20% more for Masters, and you can find more information about this here: https://requester.mturk.com/help/faq#how_fees_cost_computed

    This means that for a regular $1 HIT, without the Masters qual Amazon makes 10¢ and the Requester pays 10¢, or $1.10.

    With the Masters qual, the Requester pays 30¢ more or $1.30.
     
  10. ewd76

    ewd76 User

    I wonder if the counter is deliberately "broken". Making masters the qualification to do your hit seems like a much better deal if there are 20,000 workers, than if there are 5000.
     
  11. "Masters" qualification seems to be quite popular among dead people btw.
    There are 15 qualifications named "Masters" and for 14 of them the author is dead (according to google).

    Looks like some scammer has tried to grant masters qualification for himself.
    Or somebody is selling masters "Masters" qualifications?
     
  12. ewd76

    ewd76 User

    Seems like most of the hits which might eventually get you the photo moderation master qualification are by requesters who reject half the submissions.
     
  13. j0sh

    j0sh User

    On a side note since you posted the link, I love that Amazon explains in such vivid detail what happens when a Requester decides to go on a rejection bender. A. I don't have to pay for that, and B. It's no biggie to reject.

    It's no wonder as of late we are seeing Requester's who are apologizing after they realize the consequences of their actions.

     
  14. Khalinov

    Khalinov User

    I’ll keep an eye on those counters, but I’ll put more faith in Amazon’s counters than in informal surveys of “a lot” of people by word-of-mouth. No offense intended.

    https://www.mturk.com/mturk/searchb...Amazon+Mechanical+Turk&minReward=0.00&x=0&y=0
     
  15. I wrote a requester who uses masters qualification only for a pretty strait forward hit. I just had to ask why he felt the need to use masters and I even gave him one of his answers for free since I couldn't actually do the hit. This masters qualification is making me angry, especially since I have a 99.9% rating out of 50,000 hits and don't have it.

    Requesters like Medcrowd and Geoffery Falk have it right. Do a small qualification back and go from there. That way you don't exclude valuable workers who work just as hard as a "master" turker does.

    I guess like the poster of this thread, I'm nervous that all the new requesters will start to go that route and those of us who haven't been granted this qualification will be left in the dust.
     
  16. mturkconsultant

    mturkconsultant Verified Requester / HIT Consultant

    If you think that 15,000 people could have been granted Masters who never had it before with that change but not one of them posted about it, I guess I can't argue against that.

    https://www.youtube.com/watch?v=CEIeb85DkCs
     
  17. Joelsfood

    Joelsfood User

    I'm a little curious why some requesters are using masters now in addition to their own qualification which they already had. It seems they're just blocking out people they originally considered qualified, when they could just revoke their qualification they had granted, no?
     
  18. mturkconsultant

    mturkconsultant Verified Requester / HIT Consultant

    Because they don't understand the Requester UI or mTurk in general. It's very common among requesters. :( One of them told me they assumed that since all of their workers were good, they had Masters already.
     
  19. prakashkl

    prakashkl User

    How many masters are there? Can any one tell. Approximate. In these forums also there are not many who reveals that they are masters. Is there ny breach of conduct in revealing that I am a master.
     
  20. mtnsurf

    mtnsurf User

    If you all are not a fan of people asking for masters only email them, explain to them that's its better to just set up a qual and not use masters. Why do you think Matt Rubin dropped the masters? Because I sent Nick at Matt Rubin messages for 2 weeks none stop.
     

Share This Page