Exclusive Assignment Offered By Mturk Forum: $20 Reward - Email firstname.lastname@example.org
I am sure you have seen this around.
Basically, he/she names a music artist and asks that you write a 100 word review about them. Pay is well at 76 cents.
My concern is the approval process for the above completed HITs.
They are done by us Turkers which would be fine if there were not those out there abusing the system.
You get paid 3 cents to check if the review is copied, is about 100 words - basically if the author followed the rules. When I turn these HITs in I do them the right way of course. There are several people however that are just copying and pasting the same review for every artist and I am wondering if they are getting paid to do no work while I am taking the time to actually write original content for each HIT I work on. It is very frustrating to say the least when yesterday, two of the ones I completed were rejected for this reason:
Sorry, a panel of fellow mechanical turkers has recommended against acceptance based on the requirements specified in the HIT.
Now who is to say that did not happen because of the cheaters just marking reviews as bad or what not?
Anyone else notice this? Any suggestions, should I contact the requester about it?
I look forward to reading what you all have to say!
I have done the review HITs and have been disgusted with the content submitted by turkers. About 90% of the opinions have been plagiarized and only 5% of the remaining 10 were sensible.
I had emailed the requester as I wanted his feedback on some doubts I had about these HITs. Earlier there were HITs where opinions on football and cricket players were to be reviewed. I have seen too many submissions where instead of a 200-300 word article I had to check content which had 1700 words. These articles included bio's of players and scores and I wouldn't mind it if they did in proper language. Instead they wrote Height: 170, Weight: 75, etc.... It is obvious from their work they are copy pasting from 10 different sources to beat Plagium.
All in all I will say there is bad work being submitted and I don't blame the requester here. If you feel your work is rejected without any reason, go ahead and contact the requester.
BTW, his new guidelines for reviews favors the writers as he asks reviewers to let it pass if the article has only 89 words instead of the required 100, but if the work is really good. I don't see any other changes in the guidelines.
Yes, I got a rejection too, and sent them a little message in the contact the requester box. I told them I'd like to dispute it. I have skimmed through several of the reviews and I know what you're saying. 'So and so is of course one of the greatest, blah blah...and of the box office'?!? The ones I did were correct, at least the minimum amount of words, and I am kind of fuming and also scared about the fact that they aren't getting approved.
Are you getting rejections on the writes or the reviews?
I haven't been regular at MTurk recently, so don't know if things have gone bad on these HITs.
Sorry, I was kind of rushed when I wrote that. I got a rejection on a review and the same message as Lipglossedify : Sorry, a panel of fellow mechanical turkers has recommended against acceptance based on the requirements specified in the HIT.
A "panel"? I wonder if that is true, as in more than one person rejected it/them? I can't believe that. I did 10 between yesterday and today and none have been approved yet.
I just tried one of the review HITs and had to point out some spelling mistakes. Let me see what happens, I will post here.
I don't know what is wrong now, but earlier twice I had accidentally hit 'enter' before I could mark the word as good, ok, bad or plagiarized. I was waiting for rejections and to my surprise all the HITs had been approved.
I submitted a lot of HITs reviewing the reviews and probably came across some of yours mysconnie. lol But don't worry, I only rejected these sorts:
...blah blah is "the greatest artist in the world, I like to sit on the beach with my Ipod"...and who knows what else... same script over and over. Reject.
What about the ones that just said all facts without even a space after the sentence, reject!
and the one that only said, "nice review". Reject!
Hopefully I helped in the rejection of the above crap submissions but again, it is not fair that those who actually do the work get rejected too. Did you ever receive a response when you sent the requester a message?
Any response from the requester mysconnie?
Sonica, that is odd that they went through ok, a few times I either pressed enter too fast without marking my choice or writing something in that box and I received a red error message, it would not submit until I filled out what I was missing. Did you ever receive a response when you sent the requester a message as mentioned in your first response?
Last edited by Lipglossedify; 10-02-2009 at 10:23 AM.
Reason: adding some stuff.
No, I didn't hear anything from them. I just wonder if more than one person voted (?) to reject, since it says a "panel". To be honest, I was thrilled when I saw all those HITs for 76 cents, then when I started looking through them it was a whole other story-What? Who? I think they made some of those UP! But, that would be a good way to weed out the cheaters.
Did anybody do any of these from yesterday (Friday)? I did two, and one got rejected by the so-called 'panel' which is odd, since I was grading some of them and happened across both of mine and, of course, did not mark them bad, since they met all the requirements. I contested this one too, we'll see what happens. Probably nothing.
Last edited by mysconnie; 10-03-2009 at 11:07 AM.
Reason: Automerged Doublepost
I have never heard about any rejections on review HITs before, don't know what is happening. But like I said earlier I haven't done much work recently, so maybe things have changed.
Lipglossedify, the requester replied and answered my queries. I sent him a portion of an article which had crazy signs like ampersand, dollar etc and now I see new instructions which asks writers to avoid those signs. Obviously, he responds and improves things.
I too got the red box warning when I did not put any remarks in the box and tried to submit. You have to write something, even if it is just - ok, good work or bad, even though you have ticked those options.
I still don't understand how I auto submitted those HITs. I think I was copy pasting the URL and instead of pressing ctrl-V, I must have hit some other key by mistake.
I too have seen some HITs which had just 2-5 words and did not have to check it. It was like - accept and submit, within 5 seconds.
But since the requester put in that qualifier, good work is being submitted. At least no more 1700-2100 word articles to be checked when be only asked for 200-300 words.
I am talking about rejections on the Review this artist, not on reviewing the review. Not the 3 centers. I have yet to hear anything, but I have mine saved if he would like to show me why they were rejected. I'd like to know what the qualification percentage is for the graders/reviewers of the reviews, because I know you can have a really low % approval and still be able to write the Review this Artist HITs.
Originally Posted by sonica
As far as the punctuation it always had something stated about just using basic punctuation, at least for the reviews.