Receipt hits from mosaic

Discussion in 'Do My HIT!' started by mosaic, Sep 15, 2015.

  1. mosaic

    mosaic Member

    Joined:
    Sep 14, 2015
    Messages:
    21
    Likes Received:
    0
  2. mosaic

    mosaic Member

    Joined:
    Sep 14, 2015
    Messages:
    21
    Likes Received:
    0
    Hi everyone! We're doing another batch at 3:00pm EST (~30 minutes from now). It'll be 2,400 receipts x 4 labels (business, date, total, currency).

    Since we're still in "testing/development" mode, you won't be able to do the task for an extended period of time, but we're working hard to get to that point.

    Also, we'll have a qualification task tomorrow (Thursday), with details to follow soon.
     
  3. mosaic

    mosaic Member

    Joined:
    Sep 14, 2015
    Messages:
    21
    Likes Received:
    0
    Live with a new batch of 2,400 receipts: https://www.mturk.com/mturk/preview?groupId=32A76CCALKN60AIZ4FUML4WK8BVT4E. As before, please send any feedback. This is "testing/development" stage, so all is very helpful.

    Pricing this time is slightly linked to speed:
    • $0.09/receipt if <30 seconds
    • $0.07/receipt if <60 seconds
    • $0.05/receipt otherwise

    Would welcome feedback on that model as well.
     
  4. iceblink

    iceblink User

    Joined:
    Apr 3, 2012
    Messages:
    550
    Likes Received:
    0
    Only managed to get one in and then I got a "All the other hits are reserved for other workers" message. This is when they were down to >100 in the batch though, so I guess I got to them late. They looked like decent hits, nonetheless.

    I will keep an eye out on this thread for more :)
     
  5. mosaic

    mosaic Member

    Joined:
    Sep 14, 2015
    Messages:
    21
    Likes Received:
    0
    Hi everyone,

    1. We had a bonus payment issue during our last run (extra decimal place in our code for a LARGE bonus). We fixed it and have talked to people one-on-one. If anyone has any issues, please reach out and we'll get back to you promptly.
    2. Based on feedback we got on the last run, we're bumping up our pricing slightly.
    3. We're doing a QUAL hit tomorrow (Thursday) at 6:00pm EST. Please spread the word!
     
  6. mosaic

    mosaic Member

    Joined:
    Sep 14, 2015
    Messages:
    21
    Likes Received:
    0
    Hi everyone,

    T - 1 hour until the qual hit. 6:00pm Eastern. I know I'm excited -- hope you are as well!
     
  7. mosaic

    mosaic Member

    Joined:
    Sep 14, 2015
    Messages:
    21
    Likes Received:
    0
  8. Pontiac

    Pontiac User

    Joined:
    Mar 29, 2015
    Messages:
    4,355
    Likes Received:
    4
  9. zartonis

    zartonis User

    Joined:
    Sep 25, 2012
    Messages:
    1,555
    Likes Received:
    0
    I loved the qual HIT and prompt bonus. I'm excited to (hopefully, if I get the qual) do more Mosaic HITs in the future. :)
     
    #9 zartonis, Sep 18, 2015
    Last edited by a moderator: Sep 18, 2015
  10. mosaic

    mosaic Member

    Joined:
    Sep 14, 2015
    Messages:
    21
    Likes Received:
    0
    Hi everyone,

    We're going live with another qual hit tomorrow (Tuesday) at 12:00 noon Eastern. The purpose of this is to catch the workers outside of the US who did not have a chance to perform the qual hit last time (our last was at 3:30am India time).

    This is designed for those who were not able to participate during last week's qual hit, but if you were sick, etc. on last week's, feel free to do this one as well.

    We'll put out the qual hit results in a couple of days once we have both batches analyzed.
     
  11. mosaic

    mosaic Member

    Joined:
    Sep 14, 2015
    Messages:
    21
    Likes Received:
    0
  12. bobbie01

    bobbie01 User

    Joined:
    Jan 29, 2013
    Messages:
    11,348
    Likes Received:
    62
  13. cynicwolf

    cynicwolf User

    Joined:
    Sep 18, 2014
    Messages:
    218
    Likes Received:
    0
    same here, I think people are taking em that have alrdy done them
     
  14. Monica

    Monica User

    Joined:
    Jan 9, 2014
    Messages:
    9,568
    Likes Received:
    0
    I've noticed that it seems like it doesn't cut you off once you're in the hit. How many receipts are you hoping for each person to do in order to get a proper gauge of their abilities?
     
  15. Tjololo

    Tjololo Pony
    Staff Member

    Joined:
    Jun 14, 2013
    Messages:
    13,720
    Likes Received:
    105
    A few things that might make this hit a little nicer:

    Keyboard shortcuts for the image manipulation. Something like arrow keys for up down left right, shift+up zoom in, shift+down zoom out, shift+right rotate clockwise, shift+left rotate counterclockwise.

    The image manipulation controls were counter-intuitive, they seemed backwards. Why can we not just click and drag? Something like this with the 2d zoom would be GREAT for this.

    Some of the images were VERY small, such that zooming in could not get a clear view of the data necessary. This might be a problem with the source issue, or it might be a compression issue. If possible, using a .tif or a .png might be better (non-lossy compression with a png).

    Finally, the only other concern I would have is with expiration. If a hit expires, will people still be paid for their bonus amount? Would it be possible to auto-submit at 57 or 58 minutes or something to be sure, or a way to pop up an alert box saying "60 seconds remaining" just to be sure nobody misses out.

    Other than that, they looked like great hits! I hate transcriptions, but these would be really great for things to fill in some extra time between things. If they're up consistently, this could be a great batch.
     
  16. Monica

    Monica User

    Joined:
    Jan 9, 2014
    Messages:
    9,568
    Likes Received:
    0
    To piggy back off of TJ's suggestions, perhaps even a longer timer, maybe the same length as the batch expiry date? That way there's no rush for someone to submit it as long as there's still tasks to be completed?
     
  17. bobbie01

    bobbie01 User

    Joined:
    Jan 29, 2013
    Messages:
    11,348
    Likes Received:
    62
    I don't think he wants to do that. He told me that when they go live they are going to have to get thousands of hits done PER HOUR so speed is a huge factor for the qualification
     
  18. Monica

    Monica User

    Joined:
    Jan 9, 2014
    Messages:
    9,568
    Likes Received:
    0
    I wonder how his hits are set up. If he gets the information as soon as it's completed, or does it not transfer until the HIT has been submitted? If he needs information done quickly, wouldn't the batch expiration be short? I'm not sure the intricacies of it all, but I don't see how the hit expiring at the same time as the batch expiring would be any different if he's receiving the data immediately. I guess it really depends on how he has it set up on the back end.
     
  19. bobbie01

    bobbie01 User

    Joined:
    Jan 29, 2013
    Messages:
    11,348
    Likes Received:
    62
    I guess! I have no clue either.
     
  20. Lori1985

    Lori1985 User

    Joined:
    Nov 6, 2012
    Messages:
    14,058
    Likes Received:
    0
    I was able to snatch 1 qual hit from the batch on Thursday. I was in the middle of doing a task, and did not want to stop prior obligations. It was only a minute or two till I was finished, and when I went to my hits to do your receipt, it said they were all reserved. There was no information in here or in the hit that said they had an expiration date beyond the one that mturk gives. I feel like the lack of instructions caused a lot of confusion and caused us to miss out on doing your work.
     

Share This Page