A simple short task for crowd correction - would like to have your feedback

Discussion in 'Do My HIT!' started by DanD, Feb 9, 2014.

  1. DanD

    DanD New Member

    Joined:
    Feb 9, 2014
    Messages:
    2
    Likes Received:
    0
    Hi,
    I'm new to this mTurk and would like to get your feedback.
    I've published a few hits over the last 2-days and haven't got much attention.
    my hits are very simple in my opinion (like verifying OCR results / correcting).

    what do you think? (update -> the original link was removed as the task has been deleted.)

    however, the same task got re-created in different variations, so simply look for hit with the words 'Index' or 'Extract' (all from the last couple of hours) .

    Thank you all!

    Dan
     
    #1 DanD, Feb 9, 2014
    Last edited by a moderator: Feb 9, 2014
  2. swiftkick

    swiftkick User

    Joined:
    Jan 29, 2012
    Messages:
    355
    Likes Received:
    0
    Hi Dan, thanks for posting. Unfortunately, I can't work on your task as you have it restricted to workers who hold the Masters qualification.

    By using the Masters qualification, you severely limit the number of workers who can access your HITs. You would have to offer substantial compensation to attract Masters workers, and you also pay a 30% premium to Amazon for using that qualification. Finally, you are missing out on a lot of great workers. Personally, I have 120,000+ approved HITs and a 99.9% approval rate, but do not hold the Masters qual.

    I think you would have a better response by removing the Masters qualification and using qualifications requiring 5000 approved HITs and an Approval Rate of not less than 99%. This way you would get serious, dedicated workers, and exclude scammers.

    Your task itself is straightforward and clear. Having the source text side-by-side with the data entry fields is excellent, as it negates the need for excessive scrolling. I would work on your task if I were qualified.

    Good luck with your project!

    EDIT: I took a closer look, and it looks like it would be useful to be able to add or remove fields as well. I see and instance where the page number appears in the left column. When that page number is removed, it will either leave a blank field, or require moving the remaining text up by one field.
     
    #2 swiftkick, Feb 9, 2014
    Last edited by a moderator: Feb 9, 2014
  3. DanD

    DanD New Member

    Joined:
    Feb 9, 2014
    Messages:
    2
    Likes Received:
    0
    Hi 'Swiftkick'
    your feedback was super valuable. I used mTurk couple of years ago, but wasn't aware that Amazon changed the default-setting rules to require master as of 2012. I wish they would have made it clear when you publish the hit.

    I also so that there are some slight differences between the preview mode of the hit and the and the way it looks later. I hope we will be able to correct for our indexing purposes.

    I wasn't aware for the change of the default setting, so the incentive has been increased from 4c to 10, 15 and finally 30. In none of them I got any answer for such a short task during the past 24h.

    Obviously it's because the restricted group issue.

    I'm about to re-post it again, with a lower compensation as we initially planned and with different requirements.

    Once again, thank you for your productive and honest reply.
    (I'm going to edit the initial post and remove the link for that task that was deleted.)
    Dan
     
  4. justcolleen

    Joined:
    Jan 6, 2013
    Messages:
    5,831
    Likes Received:
    4
    Masters or not, the amount of work required and the time commitment was very high for the compensation. I looked at it each time it was posted and took a pass.
     

Share This Page