Behind the Enemy Lines
behind-the-enemy-lines.blogspot.com · Personal blog · on HN since 2008
A computer scientist at a business school writes about Mechanical Turk, crowdsourcing, worker pay and online labor markets.
What HN saysCommenters link it for Mechanical Turk demographics and pay, and one calls it an interesting blog with a unique perspective.
33HN people shared it
13linked it in comments
39stories submitted
1.7Kstory points
15 years agolast shared
2008people per year2026
Most-shared posts
- 1Mechanical turk demographics5 people · first shared 2009
- 2An ingenious application of crowdsourcing: Fix reviews grammar, improve sales4 people · 11 points · first shared 2011 · discussion on HN
- 3New Demographics for Mechanical Turk4 people · 2 points · first shared 2010 · 1 comments on HN
- 4Mechanical Turk, Low Wages, and the Market for Lemons3 people · 6 points · first shared 2010 · discussion on HN
- 5Pay Enough or Don't Pay at All2 people · 129 points · first shared 2011 · 20 comments on HN
- 6Uncovering an advertising fraud scheme2 people · 113 points · first shared 2011 · 26 comments on HN
- 7A Plea to Amazon: Fix Mechanical Turk2 people · 64 points · first shared 2010 · 21 comments on HN
- 8Can Crowdsourcing Scale? - A Computer Scientist in a Business School2 people · 6 points · first shared 2010 · discussion on HN
- 9Why People Participate on Mechanical Turk?2 people · 5 points · first shared 2008 · discussion on HN
- 10Wisdom of the Crowds: When do we need Independence?2 people · 5 points · first shared 2010 · discussion on HN
- 11What was the main factor for Watson's success? Hardware, software, or data?2 people · 2 points · first shared 2011 · discussion on HN
- 12Why I will never pursue cheating again1 people · 691 points · first shared 2011 · 482 comments on HN
- 13Web page assignment leads to cease and desist letter.1 people · 192 points · first shared 2010 · 18 comments on HN
- 14Mechanical Turk: Now with 40.92% Spam.1 people · 162 points · first shared 2010 · 27 comments on HN
- 15Panos Ipeirotis: A tale about parking1 people · 74 points · first shared 2011 · 39 comments on HN
What HN people wrote when they linked it
Panos · 2011-07-23
No, I could not really think of that. I do not filter my blog posts through any PR department, and I have written plenty of stories that received wide attention. And going through a PR department typically means that the resulting document lacks any punch and originality. (Been there, done that, for other types of communication.)
If I could think that people could leverage the post to post their negative preconceptions about business schools, NYU, Turnitin, academic, US, or whatever else they hate, I would have not posted the blog post to start with.
In most of my blog posts I try to propose and describe solutions, even when I "whine". (See, for example, http://behind-the-enemy-lines.blogspot.com/2010/10/plea-to-amazon-fix-… and http://behind-the-enemy-lines.blogspot.com/2010/12/mechanical-turk-now… The blog post about cheating was not an exception.
The reason that it was in my draft folder was because I did not want to put it out just to talk about cheating. The post felt incomplete. Yes, I could complain. But after that, what?
It took me a while to realize that people did not cheat in some of the assignments, but tried in others, was because some assignments were designed to withstand cheating. And that was a point worth talking about.
frobozz · 2011-08-11
$1 seems like a frightfully trivial amount of money to receive for a well-considered answer.
See: "Pay enough, or don't pay at all."
http://behind-the-enemy-lines.blogspot.com/2011/05/pay-enough-or-dont-…
thematt · 2011-08-01
Since Dan mentioned that Amazon Mechanical Turk is being used to do the reviews, as a founder it may be useful to know what the demographics of such users are:
http://behind-the-enemy-lines.blogspot.com/2010/03/new-demographics-of…
jcr · 2011-04-27
There's some more information (another write-up) here:
http://behind-the-enemy-lines.blogspot.com/2011/04/want-to-improve-sal…
charlief · 2010-10-28
You have an interesting blog there with a unique perspective (http://behind-the-enemy-lines.blogspot.com/2010/10/can-crowdsourcing-s… as an example). Given that this is your first (visible) submission since you registered 553 days ago, I'm sure it would be the pleasure of many here if we saw your posts being submitted more often.
pirot · 2010-10-22
Take a look at this article: http://behind-the-enemy-lines.blogspot.com/2010/07/mechanical-turk-low…
You will see that the low wages are a direct result of a lack of a good reputation system
ck2 · 2010-09-07
Thanks for that - this set is from Feb 2010
http://behind-the-enemy-lines.blogspot.com/2010/03/new-demographics-of…
* United States: 46.80% (65% female)
* India: 34.00% (70% male)
* Miscellaneous: 19.20%
mrtron · 2010-09-07
When we were creating http://markiter.com
We did a blog post referencing a study:
http://blog.markiter.com/#turk
http://behind-the-enemy-lines.blogspot.com/2008/03/mechanical-turk-dem…
Which has been updated recently. Some high quality data presented in a clear way.
http://behind-the-enemy-lines.blogspot.com/2010/03/new-demographics-of…
khaless · 2010-01-23
Hmm, from what I remember, Reproducibility became a big issue in SIGMOD. In 2008 they introduced some new requirements when submitting a paper.
http://behind-the-enemy-lines.blogspot.com/2007/08/experimental-repeat…
raffi · 2010-01-05
Here's my reference: http://behind-the-enemy-lines.blogspot.com/2008/03/mechanical-turk-dem…
menloparkbum · 2009-06-04
survey the MTurk population itself
a few people have done this already
http://behind-the-enemy-lines.blogspot.com/2008/03/mechanical-turk-dem…
http://waxy.org/2008/11/the_faces_of_mechanical_turk/
zackattack · 2009-06-03
It's the same as Mechanical Turk's:
http://behind-the-enemy-lines.blogspot.com/2008/03/mechanical-turk-dem…
shalmanese · 2009-04-23
There’s a common perception that Mechanical Turk thrives on exploiting 3rd world labor. This doesn’t appear to be the case.
From:
http://behind-the-enemy-lines.blogspot.com/2008/03/mechanical-turk-dem… and
http://asc-parc.blogspot.com/2008/07/mechanical-turk-demographics.html
82% of turkers are from the US, Canada or the UK and over 75% have a Bachelor’s degree or higher.