Classify AdImages - Unfair Hit Rejection

Discussion in 'Classify AdImages' started by gabriel, Apr 25, 2012.

  1. gabriel

    gabriel Active Member

    Joined:
    Apr 25, 2012
    Messages:
    37
    Likes Received:
    0
    Hi everyone,
    I want to warn here all the Workers that this Requester rejects hits in a discretionary manner. What is sad is that he neither cares to respond to your messages in which kindly ask him to check more carefully the rejected hits.
    We spend a lot of time to submit their hits and it seems that we are treated as slaves on plantation. I talk here about the Classify AdImages hit Find the Product Name
    I attach as prove just three screenshots with my answers (but there are many) to hits that was rejected.
    Who have done the same hits please post here if I was wrong with them. We the workers should hold together, because, as you well know, Amazon Mechanical Turk will not be involved in resolving any disputes between participants related to or arising out of the Services or any transaction.
    So be aware!
     

    Attached Files:

    #1 gabriel, Apr 25, 2012
    Last edited by a moderator: Apr 25, 2012
  2. iceblink

    iceblink User

    Joined:
    Apr 3, 2012
    Messages:
    550
    Likes Received:
    0
    This requester is one of the worst on MTurk, he seems to reject at least 25% of all completed hits no matter what you put as an answer.

    All you can do is stay away from him in future, I did around 250 of these hits when I was a new turker and 83 were rejected, so then I spent like a week getting my approval back above 95%.. To me this guy and ProductRnR are the worst.
     
  3. gabriel

    gabriel Active Member

    Joined:
    Apr 25, 2012
    Messages:
    37
    Likes Received:
    0
    Yeap, I'm newbie and I've found out that just now.
    I'm also completely agree with you, ProductRnR is the second on my list of shame. First big bunch of hits was ok ( Flag 50 pictures...bla bla), I was very glad. Then I received a kick in my tooth - a lot of hits rejected in series with no sense, my approval rate collapsed!
    So guys, don't waste your time for them.
     
  4. emmy

    emmy User

    Joined:
    Mar 29, 2012
    Messages:
    75
    Likes Received:
    0
    see my signature there is a link to a website which workers review requesters, you should register and make use of that site
    I just checked for Classify AdImages and they have too many bad reviews register and see it for your self
    http://turkopticon.differenceengines.com/A8KS2AK5LE3YO


    In the future, before you do any hits I advise you to go there and check for the requester reputation
     
  5. gabriel

    gabriel Active Member

    Joined:
    Apr 25, 2012
    Messages:
    37
    Likes Received:
    0
    Thanks a lot for your helpful advice.
     
  6. Playa_hamm420

    Joined:
    Apr 21, 2012
    Messages:
    930
    Likes Received:
    0
    turkopticon <---- Who can turk without it?!?!?!
     
  7. suriya01

    suriya01 Active Member

    Joined:
    Apr 12, 2012
    Messages:
    31
    Likes Received:
    0
    hello he never rejects but he will block us
     
  8. hardino

    hardino New Member

    Joined:
    Jan 4, 2013
    Messages:
    4
    Likes Received:
    0
    classifyadimages

    Hello,

    I too got the same response.When i submit 80 hits out of that 20 hits got rejected automatically without even reviewing them eventhough it is correct.Is it computerised to get rejected half of the hits from the particular requester classifyadimages.And my accuracy rate dropped from 96.7% to 95.6%I had sent a complaint regarding this particular requester to the amazon team members.They said they will investigate about this.
     
  9. abrahamrohithroy

    Joined:
    May 24, 2012
    Messages:
    886
    Likes Received:
    0
    Yes. The rejection is computerized. They use majority rules algorithm for evaluating your answers. It compares your answers with 3 other workers and assigns an overall score after you complete each HIT. If your score falls below a threshold, they will reject all your later HITs even though it may be correct. There are a few other requesters that use this algorithm to reject your answers. Always look out for those requesters and approach them with caution.
     
  10. hardino

    hardino New Member

    Joined:
    Jan 4, 2013
    Messages:
    4
    Likes Received:
    0
    Thank you very much for your reply.Have you got any rejections abrahamrohitroy.How much hits have you completed and out of that how many got approved.
     
  11. hardino

    hardino New Member

    Joined:
    Jan 4, 2013
    Messages:
    4
    Likes Received:
    0
    Have you contacted this requester regarding this unfair rejections.How did you come to know of this requesters rules and regulations.
     
  12. prakashkl

    prakashkl User

    Joined:
    Aug 3, 2012
    Messages:
    194
    Likes Received:
    0
    I stopped working on h is hits when I first came to know abt his great computer algorithm, after receiving around 10 rejections. Around 9 months back. Either the requester has to got his algorithm right or we have to stop working for him. These hits will help to improve your rejection rate.
     
  13. hardino

    hardino New Member

    Joined:
    Jan 4, 2013
    Messages:
    4
    Likes Received:
    0
    Any other hits which can be done daily like this to earn more cash.Any requesters you are familiar with and a good reward(like 0.08$)
     
  14. prakashkl

    prakashkl User

    Joined:
    Aug 3, 2012
    Messages:
    194
    Likes Received:
    0
    Just wait and refresh the mturk site as many times as possible. That is only way to make money for a non master now. When a hit comes, do it fast, at the same time making sure that the answer is correct.
     
  15. alagu

    alagu New Member

    Joined:
    Jun 3, 2013
    Messages:
    1
    Likes Received:
    0
    I also got affected by this requester. I was well above 95% accuracy. Then, I started doing this classify adimages work. The range of rejections were used to be 8 to 10%. I thought it is okay, because, this requester is regularly providing work. But then, in recent past, the rejections are irrationally higher, to the tune of 50%. When I sent mail to requester regarding this, instead of looking into the details, he prevented me from doing his HITs. Unfair treatment!
     
  16. subbuj

    subbuj Member

    Joined:
    Jul 25, 2012
    Messages:
    6
    Likes Received:
    0
    hi guys..... I found some thing in classify adimage....

    In addition to worker qualifications, plurality is another mechanism to help developers maintain high quality levels. This functionality enables multiple workers to submit answers to the same HIT. When a specific number of workers reply back with the same answer, the HIT is automatically approved.

    did any one getit ?!!!!
     
  17. bobbie01

    bobbie01 User

    Joined:
    Jan 29, 2013
    Messages:
    11,348
    Likes Received:
    62
    This is called "majority rules" and I stay away from any requester who uses it. You are dependent on other people thinking the same way you do and that will always result in some rejections.
     
  18. subbuj

    subbuj Member

    Joined:
    Jul 25, 2012
    Messages:
    6
    Likes Received:
    0
    that's true bobbie01 !!!
     

Share This Page