This is mind boggling With all of the shitty work out there for shit pay, there are actually people admitting to cutting corners on a great hit and then getting pissed off over rejections? WTF is wrong with people???
I got a rejection with the same reason, but to be honest I wasn't confident I was rating the video properly. I was willing to take the risk, though, so oh well.
Requester Introduction Hi everyone, this is Lee, the requester for this group of HITs. First a few numbers: I posted about 1500 HITs in this group. I did reject some (about 5%) based on missing those first two questions. The reason is that my study protocol dictates I discard that data and so I was trying to get 30 clean responses for each HIT. It was in no way a ruse to steal your work. I am going to keep this short and not get into all that I have learned and thought about in this process. Suffice it to say, I will be improving these HITs, the instructions and my practices as we go. (Big thank you to every turker who provided constructive feedback and advice). Anyway, I think I have responded to every email I have received and I am open to further inquiries. I will be posting another smaller set of tasks tomorrow morning. You can find them by searching for my requester ID: A3FKNKE7AX7F90 Here is the URL: https://www.mturk.com/mturk/searchbar?selectedSearchType=hitgroups&requesterId=A3FKNKE7AX7F90
What makes me crazy & why I spoke up about this hit is because of people being rude saying 'how about trying to pay attention' or 'quit trying to get money for not doing the work' comments to that effect. I paid 'too much' attention & actually counted the times the surgeon hit the pegs in the videos & I was rejected, whether you think it was obvious or not doesn't matter, the rejection was not for lack of attention or trying to do as little work as possible, I probably put more time into this task than most. I have over 100,00 hits done at 99.7 approval, I'm not a turking idiot. Rejections still don't feel any better after being a veteran & I don't understand why people have to make such comments. I'm sure they would not appreciate it people talked down to them when they get rejected.
I've actually read responses like this from academic researchers before. In particular, I frequently see them applying this sort of rule to timed studies, where they will rank the time spent on each HIT before submission, and then reject all HITs that fall in the lowest (that is, fastest) ten percentile. Because very few researchers are or have been full-time mturk workers, they can't really understand just how much havoc this causes. There are any number of legitimate reasons why someone might submit at HIT more quickly (or more slowly or less accurately or whatever) than other workers, and to simply summarily reject all work that falls past a certain threshold is unjust, unfair, and contrary to worker expectations of fair treatments. On the other hand...As a full-timer mturk worker, I realize that this sort of academic precaution is entirely correct in the context of their research, and more justified than these requesters could possibly imagine. I will happily submit that not every turker is an earnest and diligent lab rat working for the betterment of science. An unexamined problem is that experienced turkers already know about these sort of academic precautions and therefore take steps to compensate for them. I have read of more than few workers who will fly with maximum through a lengthy, involved HIT only to deliberately leave the clock on the active HIT running in another window until it falls within the expected time frame that the researcher has specified before submission. Could this lead to feedback distortion mayhem in the data? I don't know, but it can't be good.
Yes. I have also faced the same experience. Lee white rejected my hits without any reason. + strongly believe that my hit is correct.
I am just now seeing this thread and your post. I for one would like to thank-you for your HIT. I really enjoyed working on them and look forward to your future ones!