We are asking workers to segment videos. In the videos you will see subjects performing actions. We would like you to tell us where each action occurs (both its start and end timing) as well as a brief description you would give to that action. We will always provide ample feedback BEFORE we start rejecting any submissions. So please be creative! I have decided to bypass an initial Qualification and instead will promote workers who submit quality work to access higher-paying HITs (which will pay 4-5x more). We are doing an initial pilot-phase right now, so our batch is small. Once we are satisfied with the results, will upload larger batches. My Requester name is: CMU-Mlab I am still new to all this. Would appreciate any feedback. Cheers!
Also, a bit of background on who I am and why this research is exciting. I am a research associate at the Robotics Institute of Carnegie Mellon University. We are interested in programming robots to help humans in their day-to-day lives. The videos we are asking Turkers to annotate are of humans performing actions that we might want to program a robot to do! As an example, how exactly do we make a salad? Then given this knowledge, how can we program a robot to make a salad? The initial payout is regretfully but necessarily low to filter out scammers. We will strive, however to reward all genuine effort, whether that is through bonuses or invitations to higher-paying HITs. Thanks for reading! And happy Turking.
I'm trying to work on this hit, but i seem to be having problems with the play speed of the video... It is very slow when i go through and try to go frame by frame to help annotate the videos. Also- can you clarify what you would consider a step for each action? Thanks!
Sorry to hear that you are have troubles. Please correct me, but I believe the speed of frame-by-frame scrubbing is limited by the browser and how frequently it processes a keypress. The only way to move faster would be to play the video or use the seekbar to navigate. Sorry about that! To answer your second question - we would actually prefer to keep definitions of actions to a minimum since part of the research is about what you think to be the correct way of segmenting the video. As I mentioned feel free to be creative! We will NEVER reject work without giving you notice well in advance and will strive to provide as much feedback as possible before we do. Appreciate your help in this important stage of our project!
CMU has been nothing but helpful with their research and I can say with 100 Percent certainty that RFI mturk is in NO WAY associated with CMU. Apparently his name although sounding uncommon is shared with someone else who is NOT affiliated with CMU. I applaud their IRB for taking the time to research the matter and come to a satisfactory conclusion. I wish them and their university nothing but the best moving forward.
Special qualifications? Hi. Must you have special qualification to perform this hit? It's not showing up on my Hit list...
Special qualifications? Hi. Must you have special qualification to perform this hit? It's not showing up on my Hit list... I'm new to this... Thanks!
Hi there! No, these are open to the public. Please search for HITs containing CMU-Mlab. There is however a standard qualification that you have at least 1000 accepted HITs and an acceptance rate of at least 90%.
CMU has been nothing but helpful with their research and I can say with 100 Percent certainty that RFI mturk is in NO WAY associated with CMU. Apparently his name although sounding uncommon is shared with someone else who is NOT affiliated with CMU. I applaud their IRB for taking the time to research the matter and come to a satisfactory conclusion. I wish them and their university nothing but the best moving forward.
Huge thank you to everyone who participated in the qualification round. Those who submitted the highest quality work have been promoted and granted access to my $0.25 HITs. There is a small batch up now, with more to follow this week. I will keep the qual hits up until we reach our target worker-pool size. For those still wishing to participate, please submit a few of my $0.05 HITs and I will coach you on quality WITHOUT rejecting your submissions. If you feel you should have been promoted but have not. Please reach out to me and I can explain what precisely needs to be improved. Best, Daniel