CrowdFlower

The crowd sourcing aspect is accurate, but I think the turk half is used more generically past the actual Amazon browser GUI experience tool to whatever annotation tool one has available or has invested development in. Stuff like https://www.crowdflower.com/ One other thing worth pointing out is why you can't always lean on the Amazon Turk per se because some of the tasks you need to train from require specialist knowledge that takes years to hone. It is not a task for the common layperson who can spot a cat in an image or anything else that exploits "common knowledge". In the case of the company I'm at we had to pay contract work for these specialists to come in house and operate our annotation tools to build up our ground truth data.

San Francisco (Mission) CrowdFlower http://crowdflower.com intern, remote, h1b all welcome. We are the worlds leading microtask company. We send literally millions of small jobs to people around the world every day. Our technology platform helps our customers design great tasks and ensure that people working on the tasks do good work. Someone said it's like map reduce but with people :). We are hiring all types of technical people from operations to front end to machine learning experts. You can check out our exact engineering job descriptions here https://crowdflower.com/about/jobs but if you are smart and technical and want to tangibly change the world every day then we want to talk to you. email resumes at crowdflower.com or email me directly at lukas at crowdflower.com.

San Francisco, CA - Full Time - http://www.crowdflower.com CrowdFlower is changing the way work gets done, and we want you to help. Our technology platform takes large, data-heavy projects and breaks them into small tasks that are distributed to a multi-million-person, on-demand workforce around the world. Our technology then aggregates the results while performing continuous quality control, allowing us to deliver best-in-class results in record time. This week we're hosting CrowdConf, the largest conference on crowdsourcing and distributed work, and we have previously published papers about our work with the crowd. Hiring for: - CrowdSourcing Solutions Engineer - Development Operations Lead / Manager / Director http://crowdflower.com/about/jobs Feel free to contact me (matt.gordonATcrowdflower.com) with questions or for more information.

San Francisco, CA - Client Services Engineer (70% Ruby, 30% JavaScript/HTML/CSS) CrowdFlower is the hottest thing since disco pants. We're building an entire new industry (really) and solving new problems on a daily basis (really). Read all about us at http://crowdflower.com Email me at [email protected] if you have any questions — I'm happy to answer any questions you might have. Or, heck, drop by our hot new office in the heart of the Mission district (2111 Mission Street, Suite 302). Let us know if you want to drop by. Here's the official job posting: http://crowdflower.jobscore.com/jobs/crowdflower/client-services-engin… We're using all kinds of hot buzzwords: Redis, Mongo, Ruote, CoffeeScript, Sass, HTML5, ExtJs, etc. Experience with them is a big plus. We have the usual host of engineer benefits: Shiny new MacBook Pro, 30" monitors, tight-knit engineering team, comfy chairs, health benefits, a million office plants, and a well-stocked kitchen. We're also surrounded by amazing food. This is the Mission, after all.

This appears to be inspired by Amazon's MTurk, which data people typically use for manual data labelling; as a result, you may want to change the name. CrowdFlower (https://www.crowdflower.com) is also a very large company in this space already.

Looks really good. How is this different from Crowdflower? https://www.crowdflower.com

Hey Jorge, Looks like Lukas might have missed your response but I can jump in. We definitely love to work with the little guys, too. Nothing is more interesting than the use cases that academics and startups come up with. You should reach out to Lukas via e-mail (he shared it elsewhere in this thread) or our sales team (http://www.crowdflower.com/platform-plans) to talk specifics. We've also got a trial that will let you process 5,000 rows of data without having to worry about a paid plan. It's not time limited, either, so you can take as long as you need to go through those first 5,000 photos of yours. You might want to check out a recent blog post up about a photo keyword gen job run by one of the guys at CF: http://www.crowdflower.com/blog/how-i-got-the-crowd-to-generate-metada…

I think Crowdflower (http://crowdflower.com/ ) would be useful in this situation. I've used them before because I'm UK based and MTurk wouldn't let me create HITS (not sure if that's still true?) but they also add some stuff to MTurk like a HIT designer (a form designer) and, more interestingly here, an interface to have people complete your HITS outside of MTurk.

Here are a few of my favorite crowdsourcing links. They're not all directly related to Mechanical Turk, but you may find them interesting. Research on crowdsourcing complex tasks, such as writing articles (open source): http://smus.com/crowdforge A company that adds an automated quality layer and/or automated peer review layer: http://www.crowdflower.com Crowdsourced translation: http://www.mygengo.com Audio transcription through MTurk: http://www.castingwords.com Crowdsourcing scientific research: http://www.hypios.com/

I successfully used http://www.crowdflower.com to submit jobs to MT from outside the US.

Hi zumda, I have used http://crowdflower.com before. You get an account manager to help you which is neccessary as there is no supporting documentation and the interface is a little confusing / unhelpful when things don't work out.

I'm not familiar with AMT, but you might check out http://crowdflower.com and see if they might be a good fit for your needs.

Direct link: http://crowdflower.com/ Their quality control could eliminate the quasi-quality control that I now perform with MTurk. I set up a task like "get bio from webpage" and send it to 3 unique workers. I then run the results through a script to check whether they agree. If they do, accept all (pick random one). If they don't agree hand check (!) and possibly reject one of the jobs.

Seconded. http://www.crowdflower.com/

Link: http://crowdflower.com/

Have a look at https://www.scaleapi.com/ and https://www.crowdflower.com/use-cases/

Sites like CrowdFlower have point-and-click interfaces that allow you to just upload a CSV and drag and drop its columns as fields in your task template. What I used to do was host the images on a server, publicly, then upload the URL of the images and use it to display the images within the task. It's OK for one-offs. You get a thousand free rows with the CrowdFlower trial [1] and that's probably the most painless way to go for a classification problem. In our case though, everything will be written in-house. Automation is how we keep headcount low. [1] https://www.crowdflower.com/plans/

CrowdFlower | San Francisco | ONSITE Full Stack Engineer (Rails, React) Job posting: http://careers.jobscore.com/jobs2/crowdflower/full-stack-engineer/all9… Short video explaining our system: https://www.youtube.com/watch?v=oj0xKuIQwss Engineering Culture @ CrowdFlower: http://www.crowdflower.com/careers/engineering One of our channel partners (IMerit): https://www.youtube.com/watch?v=ryeLQOxXt00

Not sure how useful this would be, but the first thing that came to mind is CrowdFlower[0]. [0] https://www.crowdflower.com/type-content-moderation

Just a heads up... If you think D3, crowdsourcing, distributed systems, or the color "baby poop green" is cool; CrowdFlower is hiring engineers: http://crowdflower.com/about/jobs

I could use this service, but I can't seem to find the pricing for image moderation. The blog post in the link says "clear pricing" but the products page is undefined for image moderation: http://crowdflower.com/products

Considering that Google had to train 10,000 computers to identify cats in pictures, Porn detection is damn near impossible to do. [http://www.wired.co.uk/news/archive/2012-06/26/google-brain-recognises… So i tried this API: A picture of an african lady with her legs spread wide open. result: "score": 0, "resultcode": 0, "porn": false second pic was 2 white couples fornicating: "score": 92, "resultcode": 1, "porn": true third pic - african lady with breasts exposed: "score": 0, "resultcode": 0, "porn": false Maybe it only works on light colored people. I won't even bother with a picture where there may be some fellatio. I used Face.com's API prior to it being shutdown to try and detect porn by measuring the % area taken up by a persons face. This sounded slightly feasible since a head shot should not be porn? But a close up of a BJ or a facial... The only solutions for now is to manually moderate or use crowdsourced solution like http://crowdflower.com/rtfm Side note: There is a free 25 API calls per day option, but you have to enter a credit card. Suck