Was Mass Rejected, My Percentage went from 99.4 to 97.1%. How Do I Bring It Up Fast?

Discussion in 'General' started by Ryberg, Aug 31, 2012.

  1. shariqueahmer

    shariqueahmer Banned

    Joined:
    Jul 15, 2012
    Messages:
    223
    Likes Received:
    0
    Do crowdflower, they never reject or block, since they already know they are getting a lot from their pennys.
     
  2. Ryberg

    Ryberg User

    Joined:
    Mar 2, 2012
    Messages:
    4,903
    Likes Received:
    0
    For those wondering, it actually takes 100-150 approved HITs to go up .1%. I'm up to 97.6% now. At this rate, I might be at 98% by this week :D.
     
  3. Crap I Did It Again

    Joined:
    Sep 4, 2012
    Messages:
    126
    Likes Received:
    0
    It depends on your Total HITs on how many it takes to go up. It's a percentage.
     
  4. RWStein

    RWStein User

    Joined:
    Aug 17, 2012
    Messages:
    1,815
    Likes Received:
    0
    Ice blink is correct...

    But you might want to recheck the numbers you reported because with 541 rejections, even with 16,999 HITs approved (best case scenario considering you said 16k+) it would be a 96.8% approval rate and NOT a 97.2% approval that you mentioned... At 16,500 approvals, 541 rejections would give you a 96.7% approval and with 16,000 approvals, 541 rejections would have you at a 96.6% approval. You either misreported your HITs approved (16k+) or the number of rejections (541).

    Hope this helps.

    Get back with some new numbers and I'll recalculate. In any event, it will take about 27,000 HITs approved with 541 rejections and with no new rejections to make it back to 98% approval.
     
  5. RWStein

    RWStein User

    Joined:
    Aug 17, 2012
    Messages:
    1,815
    Likes Received:
    0
    The number of approvals it takes to correct for 1 rejection will vary depending on the total number of approvals. The more approvals you have the more it takes to reverse the affect of a percentage point reduction in approval rate.

    For example... Some one with 100 HITs would be impacted by 1% with 1 rejection. Someone with 1000 HITs approved would be affected by 0.1%. Some one with 10,000 HITs approved is only impacted 0.01% per reject.

    It works to the same scale to work the numbers back up. some one with only 100 HITs approved can compensate for a 95% approval rate with far fewer additional HITs approved than some one with 10,000 approvals. Of course the person with 10,000 approvals must already have FAR MORE rejections to be at 95% approval rate than the one with 100 approvals. So as you can see the more approvals you have the more risky you can be with unknown or Majority Rules requesters as each reject impacts you less and less the more submitted HITs you have approved.

    Hope this helps.
     
  6. naturegirl

    naturegirl User

    Joined:
    Aug 30, 2012
    Messages:
    701
    Likes Received:
    0
    I know I'm not the original poster, RWStein, but I just wanted to say thank you for always seeming to be right there with the support and the stats and the lists of requesters that do this or that...et cetera. Really helps this forum be the great source of info that it is.

    F.A.M.E., good luck with getting your stats back up. I see this isn't going to be a quick fix, and I hope it manages to feel as painless as possible for you.
     
  7. footballchick29

    Joined:
    Aug 6, 2012
    Messages:
    2,150
    Likes Received:
    0
    RW can you help me figure out what I need? I am at 1400 approved hits and 97.8% approval rate.. how many approved hits do I need to get to 98% and how many to get to 99%? Also, is there a formula to figure it out, I stink at math lol
     
  8. RWStein

    RWStein User

    Joined:
    Aug 17, 2012
    Messages:
    1,815
    Likes Received:
    0
    Well Thank You!

    Always nice to be appreciated! Really!

    "Gotta Make That Money!"

    :cool:
     
  9. RWStein

    RWStein User

    Joined:
    Aug 17, 2012
    Messages:
    1,815
    Likes Received:
    0
    I need to know the exact number of approvals and rejections you have to do the exact math.. Feel free to PM me the information or email is fine too if you want to keep it private. From the numbers you list I can only assume you have about 31 rejections at exactly 1,400 approved HITs. Let me know if I can work with those numbers or if yours are different.
     
  10. Maggiemw

    Maggiemw User

    Joined:
    Aug 3, 2012
    Messages:
    139
    Likes Received:
    0
    There is a script called "worst case scenario" (I think) for Mturk that will figure out what would happen to your score if there was a mass rejection. Version 2 also gives the number of hit rejections needed to go down to 99% and to 95%. It's very cool and useful.

    You can find it over in the scripts section.
     

Share This Page