Yet, another crowdsurf issue or at least I think so.

Discussion in 'Requesters' started by mamaquilts, Sep 21, 2014.

  1. mamaquilts

    mamaquilts User

    Joined:
    Feb 17, 2014
    Messages:
    458
    Likes Received:
    0
    Ok, I've read the other post but I still don't get how the rating system works.

    For every hit there seems to be a problem with I get dinged 20 points and every one I get right I get 10 points?

    On Friday, mine shot up to 1006, as I had not worked any hits for them since back in July.

    Right now, it's sitting at 900 and a fear doing any more hits as I might drop below the 900.

    I really wish they would send at least some info as to what I'm doing wrong so I can correct it instead of me freaking out about the numbers.

    I double check before I send it, google has spelling correction so I know it can't be spelling. I'm really at a loss as to what I'm doing wrong to keep getting dinged so much.

    Ideas?
     
  2. lunarobverse

    Joined:
    Mar 22, 2013
    Messages:
    13,055
    Likes Received:
    0
    My apologies if this is a dumb question, but just to make sure: you're following the guidelines specific for Crowdsurf, right (which are found here)? Not just spelling, but how they prefer punctuation, how they prefer numbers to be formatted, how to handle multiple speakers and extraneous sounds, etc?

    A specific example is in HITs where you're transcribing a video tutorial on computer software; make sure you're spelling and capitalizing the programming terms just as they appear in the video. If the presentation spells something InterCaps, your transcription should spell it exactly the same.

    Any one of those can ding you points when the HIT is reviewed, assuming the reviewer is also following the guidelines.
     
  3. DeniseH

    DeniseH Member

    Joined:
    Jun 29, 2014
    Messages:
    24
    Likes Received:
    0
    Mamaquilts, if you are sitting right at the 900 line I suggest that you request to look at some of your transcripts before doing anymore and just wait for their response. Sometimes it takes a while. Or just sticking to the very, very, easy ones that are with just one speaker that talks very, very clearly to try to get back up and get away from the edge. Lunarobverse hits some of the biggies and issues with the technical stuff. Sometimes I even steer away from it, especially if it's late at night, as not all reviewers know what they are doing sometimes either, and it seems to go better during the most active hours such as the day time during weekdays. There are more decent reviewers than bad apples, or at least that is my viewpoint, so it's best to be transcribing when there are more reviewers to contribute to damage control if there is one that doesn't know what they are doing. Maybe even steer away from the math and technical lingo all together for a while?

    Also, make sure that you transcribe every um, uh, you know, and spell the word "alright" as "all right". Alright is not correct. Also, try to find a balance when transcribing to punctuate so it makes sense while reflecting how the person speaks. Verbatim is not suppose to be as grammatically correct as formal writing. Make sure that you are inserting when the speaker changes. Also, my brain, (I'm not in my twenties anymore!) , sometimes likes to fill in the blank of what I anticipate hearing. There's less of a chance of switching up common words if you don't let the audio get too ahead of where you are at while typing. It also helps to be your own reviewer. Even when you feel pretty confident, just give it one more play and follow along with your own transcription. I've surprised myself before with finding errors when I felt pretty confident I was doing well and paying attention.
     
    #3 DeniseH, Sep 21, 2014
    Last edited by a moderator: Sep 22, 2014
  4. mamaquilts

    mamaquilts User

    Joined:
    Feb 17, 2014
    Messages:
    458
    Likes Received:
    0
    Thanks for the response.

    I've read them many times over.

    I'm beginning to think it might be the use of commas.

    I'm at 910 and fearful to do any more.

    Question on the video tutorials. Typing out whats on the screen as well as what is being said? I thought it was only the verbal words and not what was on the screen? I've never had one that only had a tutorial without someone talking.
     
  5. mamaquilts

    mamaquilts User

    Joined:
    Feb 17, 2014
    Messages:
    458
    Likes Received:
    0
    Thank you.

    I make sure I add in the um's and such.

    I always listen and make sure I caught everything before sending it in. Like, you, I've done a few "fill in what I think it's gonna be" moments but have caught them as I type or when I relisten before sending in.

    I did ask for an update on my transcripts from their website so hopefully I hear soon.
     
  6. zartonis

    zartonis User

    Joined:
    Sep 25, 2012
    Messages:
    1,555
    Likes Received:
    0
    I've been doing transcriptions for Crowdsurf for a long time, and I am a level 6 reviewer on Crowd Virtualizer and even my transcription qual score has been bouncing around lately. This has also been affecting a lot of other people, so don't feel alone. My theory is that some of the new reviewers don't know what they're doing, as they are now automatically promoted after attaining a certain qual score. I hope Crowdsurf gets a handle on this situation, or at least replies to one of the emails I sent.

    Edit: Here's the Crowdsurf subreddit. You can sometimes communicate with Crowdsurf there as well: http://www.reddit.com/r/CrowdSurf/
     
    #6 zartonis, Sep 22, 2014
    Last edited by a moderator: Sep 22, 2014
  7. lunarobverse

    Joined:
    Mar 22, 2013
    Messages:
    13,055
    Likes Received:
    0
    Whoops, was in the wrong thread. My apologies!
     
    #7 lunarobverse, Sep 22, 2014
    Last edited by a moderator: Sep 22, 2014
  8. lunarobverse

    Joined:
    Mar 22, 2013
    Messages:
    13,055
    Likes Received:
    0
    I just meant to spell and capitalize the spoken words in the same way they appear in the video and in the presentation, not to transcribe all the text that appears in the video.
     
  9. mamaquilts

    mamaquilts User

    Joined:
    Feb 17, 2014
    Messages:
    458
    Likes Received:
    0
    Ok, just wanted to clarify. I'm always happy when those scientific words show up in the videos.
     
  10. BloodRayen

    BloodRayen User

    Joined:
    Oct 23, 2013
    Messages:
    2,187
    Likes Received:
    0
    some major mistakes made are computer commands. many transcribers do not stick to the (new) rules. since there have been unclear solutions for this and many versions of computer command the guidelines got updated properly 2 weeks (?) ago. i see many people not sticking to this and have to downgrade their work.
    side note: update for music in the guide
     
  11. mamaquilts

    mamaquilts User

    Joined:
    Feb 17, 2014
    Messages:
    458
    Likes Received:
    0
    I've been re reading the guidelines a lot in the last couple of days.
     
  12. MrMattyMatt

    Joined:
    Sep 27, 2014
    Messages:
    65
    Likes Received:
    0
    New turker with a dumb question. I have been doing crowdsource transcription hits, and I get emails as to what my score is after I do them, it goes up and down but has always been in the high 900s or just over 1000. Is there a place where you can see how you were reviewed for a HIT so I know what I may have done wrong so I can improve?
     
  13. ssamcd

    ssamcd User

    Joined:
    Aug 10, 2012
    Messages:
    108
    Likes Received:
    0
    Don't worry Mr. Matty not a dumb question. Each transcript you type for Crowdsurf is scored, and your score goes up and down accordingly. If you are in the high 900s, you are doing well. If you would like to know your errors, email Katie at www.support@crowdsurfwork.com
     
    #13 ssamcd, Sep 28, 2014
    Last edited by a moderator: Sep 28, 2014
  14. transgal

    transgal Member

    Joined:
    Nov 17, 2013
    Messages:
    9
    Likes Received:
    0
    I agree with Zartonis. I am a reviewer and also review for Crowd Virtualizer. I was at 1006 daily and then BOOM. Dropped in one hour. There must be an issue with commas given that I research every name and term that comes up. On the other hand, when they get to Crowd Virtualizer with a lot of errors I can't help but think that there are some poor reviewers. There are some HITS that I wish I could return with corrections because they really need to go back and review guidelines. Whatever the situation is, I don't understand the scores jumping around either.
     
  15. BloodRayen

    BloodRayen User

    Joined:
    Oct 23, 2013
    Messages:
    2,187
    Likes Received:
    0
    My hopes are on their new reviewer training. In my min many reviewers have no plan what they are doing. My qual is constantly at 1002 and I loose it drops down to 982 once a week.
    I totally agree with you on the CV stuff. Sometimes the transcripts are plain bs.
     

Share This Page