Amazon Mechanical Turk (Mturk) Guide to Qualifying Your Workforce

Discussion in 'General' started by nobody, Sep 9, 2012.

  1. nobody

    nobody User

    Joined:
    May 23, 2012
    Messages:
    317
    Likes Received:
    0
    Using an actual qualification test specific to a requester's particular HIT would only show them whether workers could do their HITs or not. It makes more sense for requesters to qualify their workforce by requiring X number of approved HITs. By using total approved HITs, a requester knows that a worker could maybe do their HITs, but the worker has definitely done a lot of other HITs.

    A requester could also throw in some "gold standard" HITs now and again (those are ones a requester already knows the answer to) to check their workers' results, and they could change them up whenever they wanted. Again, that only shows a requester whether someone can do their HITs, not whether a worker can do a bunch of different kinds of HITs, which won't really help a requester.

    I just had to put that out there. I'm so tired of all these requesters who put up qualifications that make you prove whether you can actually do their HITs or not. That just makes no sense! Quantity over quality, baby.

     
  2. bootybitch

    bootybitch Banned

    Joined:
    Jul 14, 2012
    Messages:
    514
    Likes Received:
    0
    Are you serious? Would you hire people that you didn't know could do your work or not? You would rather them accept the general population and reject everybody? This is the most ridiculous thing I've seen all day.
     
  3. Maggiemw

    Maggiemw User

    Joined:
    Aug 3, 2012
    Messages:
    139
    Likes Received:
    0
    Sorry, nobody, but I agree 176% with Booty.

    Think about the dangers of 'majority rules'. Do you really want to have your work approved or rejected on the basis of whether or not it agrees with a bunch of press-any-button-submit pirates? That bunch of idiots, who cause hassle, low pay and unjustified rejections, needs to be stopped. A qualification test hit would do that.

    It would be better for us as workers in many ways. Location would be less important than accuracy; pay might well be better because the requestor would have less wastage of time/money on stupid stuff; we wouldn't be the victims of "mindless majority rules". Qualifications would let little newbies get some real experience instead of having to chalk up hundreds of mind-numbing, life-wasting Oscar hits...

    No, it isn't quantity before quality. That's the WHOLE problem.
     
  4. 2muchTurkin

    Joined:
    Jul 19, 2012
    Messages:
    1,281
    Likes Received:
    0
    Quantity over quality? I am sorry but did you suffer a head injury some point prior to this posting? You really should have someone keeping an eye on you. Head injuries can be very serious.
     
  5. mamakayy

    mamakayy User

    Joined:
    Aug 30, 2012
    Messages:
    136
    Likes Received:
    0
    I'm totally confused.

    If I wanted people to do a specific task, I would want to know they could do THAT specific task, not a random assortment of specific tasks which may or may not be similar to mine.
     
  6. nobody

    nobody User

    Joined:
    May 23, 2012
    Messages:
    317
    Likes Received:
    0
    Lol.

    So you guys think it's bad for requesters to prefer quantity over quality? You think the fact that someone with hundreds of rejections is qualified to do a HIT because they've completed 20,000 HITs, whereas someone with no rejections isn't qualified to do the same HIT because they've only completed a few thousand HITs, is...backwards? Ya think????
     
    #6 nobody, Sep 10, 2012
    Last edited by a moderator: Sep 10, 2012
  7. Turkalicious

    Joined:
    Jun 4, 2012
    Messages:
    1,642
    Likes Received:
    0
    This makes absolutely no sense. Are you honestly even reading what you're saying??

    If you owned a business would you want your workers doing quality work or would you not care how shitty their work was as long as they had the 'experience' to do said work?

    I'm sorry this just makes no sense. I don't think rejections has anything to do with it. Either you are QUALIFIED to do a HIT.... or you're not. It doesn't get much simpler than that. You're basically saying someone with rejections is incapable of doing a HIT.. whether they actually KNOW how to do it or not.
     
  8. clogan98

    clogan98 User

    Joined:
    Sep 5, 2012
    Messages:
    157
    Likes Received:
    0
    It's opposite day at school! Really. As a small business owner, I'm at a loss for a response.
     
  9. Whimsy

    Whimsy User

    Joined:
    Apr 22, 2012
    Messages:
    805
    Likes Received:
    0
    I'm sure nobody's banging her head against a wall somewhere.

    Nobody's stats = quality
    Nobody's stats = unqualified because of low number of hits

    There's irony in here, why am I the only one that sees it?
     

Share This Page