Speech Technology Research - watch out!

Discussion in 'Requesters' started by Hi. It's me, Oct 19, 2012.

  1. Hi. It's me

    Joined:
    Aug 11, 2012
    Messages:
    248
    Likes Received:
    0
    Anyone work with them today? Anyone get their work rejected?

    I've never had problems with them before, but so far, have gotten my work I did this morning rejected with no explanation. (Still more pending :( )

    Hopefully, this is a system fluke or something on their part. (They have not replied to me yet)

    I updated in TO to warn, and will change my review accordingly when/if I hear from them.


    P.S. All of my work was accurate, with no doubt. Writing is my thing. All rules were followed. I'm familiar with this requester.
     
  2. Hi. It's me

    Joined:
    Aug 11, 2012
    Messages:
    248
    Likes Received:
    0
    Update - heard back from them. They encountered a system error and see that I was not at fault.
    However, they say they will give me credit, but are unable to reverse the rejections.

    So - just a warning - if you did work for them today, you are likely to get several rejections. Email them and let them know. They are very responsive. (Although I'm not satisfied with the inability to reverse my rejections since I was 13,000 HITs w / 99.8% approval before this)
     
  3. mischa

    mischa User

    Joined:
    Feb 1, 2009
    Messages:
    176
    Likes Received:
    0
    I had a scattering of rejections yesterday out of 200+ submitted -- never happened to me before either with this requester. I emailed and assured them I was conscientious to make each rewrite unique. They replied that the cause was their auto reject for duplicate submissions. I guess tread carefully with these henceforth...
     
  4. naturegirl

    naturegirl User

    Joined:
    Aug 30, 2012
    Messages:
    701
    Likes Received:
    0
    Thanks for letting us know, Hi. I did my first dozen for them over a couple of days this week; I like playing with words! There are a few still pending, so hopefully they'll wait to run them through until they have their algorithm fixed.

    Mischa, that's interesting detail. I remember that once I noticed they were doing the same sentences over and over, I would skip until I got to one I hadn't seen before. Not because I thought, "wow, what if they have a system glitch and I get rejected for dupes!" :) but only because, well, I was just playing, and it was more fun to do different ones.

    My biggest concern about them is this claim that they are unable to reverse rejections. That is not a good sign. There's that old saying, right...it's what people do when things go wrong that tells you the most about them.

    I'm sorry that happened to you both!
     
  5. Hi. It's me

    Joined:
    Aug 11, 2012
    Messages:
    248
    Likes Received:
    0
    I am both a requester and worker on MTurk, so I told them they are able to reverse rejections & gave them advice on the quickest way of getting it done.
    (I dont deal with batch requests on Mturk, but some of my colleagues do, and it's kind of a confusing nightmare).

    She said she was going to look into the rejection reversal and log error.


    So, to you who have had (or will have) rejections from this week's work, remember, it is due to their system and you need to email them and let them know. Also, request a rejection reversal!

    They were very good about communicating and working with me, which I appreciate, but there was no sentiment of apology or even an "oopsie!" in any of their emails, so I think they may not understand how rejections impact us. So, make sure you ask them to reverse :)
     

Share This Page