Hiya, posting about CrowdSurf's ratings. I know they're a new-ish requester, pretty much similar to Claritrans guideline wise, (Ty, transcriptiontress.com!) but in the past few days I've been spammed with email from them every time my rating increases or decreases. A few minutes ago, my rating jumped from 181 to 90... is this something they're just still working on getting the kinks out of, or wtf? If anyone has any clue as to what their qualification standards are, could you let me know? Thanks!
Claritrans and Crowd Surf are the same company. link to sourcehttp://transcriptress.com/tag/crowdsurf/ I don't know what you mean about score jumping or spam emails though
You're welcome, buttaflypixie (transcriptress.com is my site). Someone made a relevant comment about CrowdSurf scoring on that same post on my blog today, the one that Neona cites (thanks, Neona, for crediting your source!). The commenter said that 90 seems to be the bottom rating you can have and still work for CrowdSurf, so if that is true (I have no verification of it yet), then maybe CS is warning you. But if so, they probably needed to make that more clear! Otherwise, it's sorta funny that they're spamming you about your rating. I'm figuring that might be their misguided attempt at getting you to be more invested in it! Sorry, though, if they're making PITAs of themselves. Though if any Turk transcribing companies would do that, it'd be these folks; Claritrans has a history of being a little clueless about how to be Turker-friendly. And because CrowdSurf is their baby, well...
So I did five 25-second transcription jobs for them yesterday, three have been approved, two are pending, and received an email: Message from CrowdSurf (support@crowdsurfwork.com) --------------------------------- Your qualification score has been changed from 100 to 101 for qualification Qualified to work on Transcription Tasks. Thanks for your work. --------------------------------- Two more were also received, stating the score changed from 101 to 102, and then 102 to 103. Does this mean the transcriptions were great, good, or poor?
I'm really not sure HOW I could be more invested in it, given that I've completed over 500 hits for CrowdSurf in the past week. And I'm not sure what they'd be warning me of. My question was if anyone else had seen their extremely high rating (mine was 182) drop back to the 90 minimum, which yes, I believe is a minimum because that's the required rating to be able to accept their HITs. This extremely drastic drop in my rating, with only 1 rejected hit out of over 500, would lead me to believe they are still working out the kinks of their rating system. I was simply wondering if anyone else knew of another reason why that would happen.
Well, I do, but you aren't going to like it, either. Claritrans is highly unpredictable and has been willing to burn Turkers with no warning in the past. I notice that a number of things they did in creating the CrowdSurf interface look like they are making an effort to be more Turker-friendly. I would guess that this also is an attempt to seem more reasonable and not reject...yet. Let me be clear: in the past, Claritrans has shown themselves to be plenty willing to reject for no good reason. There's plenty of evidence in old posts from this forum alone. I don't think putting a new name on some of the work will have changed that. Be careful, and good luck. ETA: Why not write them and ask? If it's a mistake, I would hope they'd be happy to fix it. I hope that's all it is.
Naturegirl, I appreciate your informed opinions and take all of your advice to heart, as well I'm an active reader of your blog, so thanks so much for letting me know what you think about the situation. I've contacted Crowdsurf, asking them about their rating system.... lol. Hopefully it doesn't come back to bite me in the ass, but it bothers me that I worked so hard to get that rating to 182 and then it was just stripped from me. If they reply with anything, I'll post it here to let people know.
Contacted and they replied right away. In a nutshell, they're sorting through their rejection criteria and stated that a rating of 100 was perfect in their mind. Anything above 100, they said, was a glitch in the MT system that they're working on. Just wanted to clarify for anyone who might have gone through something similar with their Crowdsurf rating.
Woohoo! Great info. Thank you for relaying. Sorry they knocked you all the way down like that, though. Hope they find a less demoralizing way to do it---sounds like you deserve more credit than to be pushed down to 90 again. Perhaps they'll fix that. Sounds like this sort of answers adaaam's question, too, in that he's already "perfect" and can expect a reduction.
Hi buttaflypixie, I think it is a clerical, computer error, or glitch. I doubt they are trying to warn you. How could they if you've done 500 hits and only 1 rejection. I had 2 rejections from them yesterday and I sent them feedback requesting the reason for the rejections. Here is there response... Hi, Thanks very much for your question and feedback. We are in the process of completing a reviewer feedback loop so that you know exactly why a HIT was given a certain score. You're score may drop temporarily but you will NOT be excluded from working our HITs. We apologize for not delivering this information today and understand that you need this information to continue to improve quality. Thanks again, CrowdSurf Support Hope this helps you buttaflypixie. Let us know if you receive a response.
Heya, ssamcd. Thanks for that info. It sure will be nice when we can see the reasons why our CrowdSurf ratings go up or down, so that we can improve the work that we do for them in the future.
CrowdSurf replies to questions about email issue Hi all, this is Ryan from CrowdSurf. The emails you have been receiving are not intended to be spam or a means of encouraging you to work more HITs. Based on your collective feedback, we're going to reduce the amount of emails in the near future. As some of you have pointed out, this is a relatively new configuration (new player, HIT types etc.) and we're still exploring ways to make the work experience as good as possible. Thanks for your feedback, Ryan
Thanks so much for taking our comments into consideration and clearing up my confusion, Ryan. Personally, I look forward to the up and coming changes being made to CrowdSurf, and appreciate the attention to detail that has gone into making these HITs worker friendly.
Reasonable companies wouldn't. Welcome to the forums, Ryan. It's always great when a requester has a consistent presence here, and I know it goes a long way with the members. I hope you'll stick around to answer more questions and concerns anyone may have.
I don't know if this is the right thread but it's been few days, almost a week I guess, since I stopped working on crowdsurf hits. Everytime I open their hits it says webpage is not available. Is anyone experiencing the same thing? I can see the hits are decreasing so I guess some other turkers can load the video. I love doing their hits. My score already reached 220 but then suddenly this happened.
I actually kind of like getting the CrowdSurf qualification E-mails. I like the pat-on-the-back element whenever I get a bump in my score (it's 264 right now). I will be kind of sad if they go back to a 0-100 scale for scoring.
I just figured out a rule from Crowsurf that's DIFFERENT from the Clartirtans hits. Luckily I noticed it. I've done a bunch for then and gotten it wrong. I've been approved anyway, so hopefully this will lessen my chances of a rejection in the future.
Nice to see you, Chuck. I'm interested that they still haven't chosen to move to that 0-100 scale, since they did make a point of saying before that any scores higher than 100 were just a glitch on the way back to it. It is nice that they do send out that little email, though! And ewd76, right, someone pointed out a style difference between the two in another thread; that one has to do with the ends of sentences. Did you find another?