R
Royans Tharakan
royans.net · Personal blog · on HN since 2007
Royans Tharakan writes about scalable web architecture, covering NoSQL, Google's Pregel and Spanner, and migration stories such as Wordnik and Reddit.
What HN saysHN links it for summaries of large-scale systems, including Google's Pregel and Wordnik's move from MySQL to MongoDB, and Reddit's scaling troubles.
15HN people shared it
4linked it in comments
14stories submitted
93story points
2 years agolast shared
2007people per year2026
Most-shared posts
- 1Pregel: Google’s other data-processing infrastructure3 people · 3 points · first shared 2010 · 1 comments on HN
- 2Spanner: Google’s next Massive Storage and Computation infrastructure1 people · 49 points · first shared 2010 · 4 comments on HN
- 3The Reddit problem: Learning from mistakes1 people · 12 points · first shared 2010 · 2 comments on HN
- 4MongoDB: Migration from Mysql at Wordnik1 people · 8 points · first shared 2010 · 2 comments on HN
- 5You don’t have to be Google to use NoSQL1 people · 8 points · first shared 2010 · discussion on HN
- 6Scalable Web Architectures1 people · 3 points · first shared 2008 · 1 comments on HN
- 7Velocity 2010 Conference Slides/Videos1 people · 2 points · first shared 2010 · discussion on HN
- 8Smarter Honeypots: Using GenAI to Customize1 people · 2 points · first shared 2025 · discussion on HN
- 9How did Google, Youtube, digg, twitter build scalable web sites: List of articles, videos1 people · 1 points · first shared 2007 · discussion on HN
- 10Hive at Facebook1 people · 1 points · first shared 2010 · discussion on HN
- 11Continuous deployments may not be for everyone: Culture1 people · 1 points · first shared 2010 · discussion on HN
- 12Scaling Early1 people · 1 points · first shared 2008 · discussion on HN
- 13Scaling Smugmug from startup to profitability1 people · 1 points · first shared 2007 · discussion on HN
- 14Kafka : A high-throughput distributed messaging system1 people · 1 points · first shared 2010 · discussion on HN
- 15Comment page 11 people · first shared 2010
What HN people wrote when they linked it
pjscott · 2010-12-09
Google has published a very short paper about a program, called Pregel, which expresses graph algorithms using message passing between vertices. Apparently its scaling doesn't suck:
http://www.royans.net/arch/pregel-googles-other-data-processing-infras…
They do try to group related vertices as much as possible, but if edges span computers, that's okay too. I assume that it works best when the interconnect between computers is low-latency, though.
meghan · 2010-07-12
Video of this talk is available here: http://blip.tv/file/3621377
This article also has some details: http://www.royans.net/arch/mongodb-migration-from-mysql-at-wordnik/
rkt · 2010-03-08
I think Reddit will be doing something like that. Jereny from Reddit responded to the thread and mentioned they might be moving to cassandra. Its however not a trivial task for a site with that kind of load and data to cutover :) http://www.royans.net/arch/reddit-learning-from-mistakes/comment-page-…
helwr · 2010-05-07
http://www.royans.net/arch/pregel-googles-other-data-processing-infras…
http://blog.udanax.org/2009/08/inference-anatomy-of-google-pregel.html
http://portal.acm.org/citation.cfm?id=1073981
also check out PIs publications and his thesis http://research.google.com/pubs/author145.html
The lead author will also be giving a presentation on Pregel at SIGMOD 2010: http://www.sigmod2010.org/research_list.shtml