Hi, I'm preparing to submit a HIT request and I have a basic problem: the task requires the close reading of a paragraph of text, followed by a series of answers which are subjective enough that I cannot verify whether the text was read or not (10 VERY short questions). My solution to this is to ask a simple reading comprehension question and to deny payment for HITs which do not answer correctly. Do you think this is fair? It's a simple enough question that if you read the paragraph you would get it right. Also, has anyone else run into the problem of needing to require the careful reading of a passage? Any suggestions about how to deal with it? Thanks in advance.
I'm guessing you're a requester. Most requesters use a "check" question to weed out scammers. Completely fair, totally expected, and will get you more accurate results. There are other ways to weed out scammers as well. Feel free to PM me if you'd like more info.
I think it is fair. For someone to even answer 10 questions on a paragraph that is subjective, they need to read it. All I ask is set it to 93% so I can do it? I am grinding my way back to 95%+