eBay Tech Blog
ebaytechblog.com · Company blog · on HN since 2010
eBay's engineering team writes about its data infrastructure, search performance, web server management tooling, and open-source projects such as Pulsar and REST Commander.
What HN saysHN commenters link it for technical details such as REST Commander's actor-based concurrency, Cassandra data modeling, seekable gzip, and archived posts by an engineer.
51HN people shared it
9linked it in comments
81stories submitted
635story points
9 years agolast shared
2010people per year2026
Most-shared posts
- 1Pulsar: Real-Time Analytics at Scale4 people · 59 points · first shared 2015 · 14 comments on HN
- 2REST Commander: Scalable Web Server Management and Monitoring3 people · 26 points · first shared 2014 · 2 comments on HN
- 3Using Spark to Ignite Data Analytics3 people · 10 points · first shared 2014 · discussion on HN
- 4EBay on Cassandra Data Modeling Best Practices3 people · 3 points · first shared 2012 · discussion on HN
- 5Site Speed for eBay Search Results3 people · 1 points · first shared 2010 · discussion on HN
- 6Fast Approximate Logarithms, Part I: The Basics2 people · 70 points · first shared 2015 · 46 comments on HN
- 7Statistical Anomaly Detection2 people · 56 points · first shared 2015 · 15 comments on HN
- 8Mesos, Marathon, Docker and Jenkins at EBay2 people · 30 points · first shared 2014 · discussion on HN
- 9High-Throughput, Thread-Safe, LRU Caching (2011)2 people · 12 points · first shared 2011 · discussion on HN
- 10Ebay: recent success with clojure2 people · 4 points · first shared 2016 · 1 comments on HN
- 11Caching HTTP POST Requests and Responses2 people · 4 points · first shared 2012 · discussion on HN
- 12EBay’s Font Loading Strategy2 people · 4 points · first shared 2017 · discussion on HN
- 13Pulsar Reporting: Near-Real-Time Metrics Reporting Framework2 people · 3 points · first shared 2015 · discussion on HN
- 14EBay tech blog on one time code authentication using FSM2 people · 3 points · first shared 2016 · discussion on HN
- 15Dissect Helps Engineers Visualize and Debug Distributed Applications2 people · 2 points · first shared 2017 · discussion on HN
What HN people wrote when they linked it
wprapido · 2016-02-26
https://www.toptal.com/blog/
https://www.paypal-engineering.com/
https://www.ebaytechblog.com/
bumbledraven · 2015-05-10
Great find. There's an archive of his posts on the eBay Tech Blog. Looks like interesting reading.
http://www.ebaytechblog.com/author/dgoldberg/
michaelmior · 2016-10-19
The idea is that there are a number of complicated tradeoffs that must be made when designing a schema. See [0] for an example; note that every rule comes with an immediate caveat. The result is that you have to be an expert to come up with a great design for a particular system. Even then, if your workload is complex, you might miss a non-obvious choice which will outperform your manual selection.
The goal of NoSE is to automate the process by estimating the cost of executing a workload against a wide range of schema designs. We can then select the one which is likely to perform the best. As far as data migration, moving from a relational database is a reasonable use case. Some of the work I'm doing right now is looking at how you can transition between different schemas in a denormalized database. However, our initial use case was to build something that would allow a non-expert user to design a good schema.
[0] http://www.ebaytechblog.com/2012/07/16/cassandra-data-modeling-best-pr…
jeffpeiyt · 2016-04-05
The core of REST Commander is the actor based concurrency control described at http://www.ebaytechblog.com/2014/03/11/rest-commander-scalable-web-ser… We recently open sourced the http://www.parallec.io/ to support more protocols and I suppose it is not hard to add new protocols if needed.
dmit · 2015-12-12
Agreed on usefulness of random access. Here's a couple more links on seekable gzip compression:
http://lh3.github.io/2014/07/05/random-access-to-zlib-compressed-files…
http://www.ebaytechblog.com/2015/10/09/gzinga-seekable-and-splittable-…
jason_s · 2015-06-27
in [part I](http://www.ebaytechblog.com/2015/05/01/fast-approximate-logarithms-par… the author argues against using [1,2) because it causes large relative error near x=1 (since log x = 0 there). I would disagree (why would you ever care about relative error in a logarithm -- IMHO absolute error makes much more sense... unless for some crazy reason you're dividing by log x near x=1) but that's his argument.
SEJeff · 2014-07-31
This is kind of the wrong question. You can trivially run openstack ontop of mesos and vice versa.
Mesos is bigger on services, openstack is bigger on virtual machines. They are different solutions for overlapping, but fundamentally different problems.
Here is an example of Ebay running mesos ontop of openstack:
http://www.ebaytechblog.com/2014/04/04/delivering-ebays-ci-solution-wi…
espeed · 2014-05-31
eBay posted this two days ago...
Using Spark to Ignite Data Analytics (
http://www.ebaytechblog.com/2014/05/28/using-spark-to-ignite-data-anal…
pdevr · 2015-05-19
These are some of the top sites' engineering blogs which I collected over a period of time - I removed those which have already been posted:
Google: http://googledevelopers.blogspot.com/ http://google-engtools.blogspot.com/ http://googleresearch.blogspot.com/
YouTube: http://youtube-eng.blogspot.com/
Baidu: http://usa.baidu.com/category/baidutechblog/
Yahoo: http://yahooeng.tumblr.com/ http://yahoodevelopers.tumblr.com/
Wikipedia (closest I could find): https://blog.wikimedia.org/c/technology/
Amazon: https://aws.amazon.com/blogs/aws/
Twitter: https://engineering.twitter.com/
eBay: http://www.ebaytechblog.com/
Microsoft: http://microsoftengineering.com
FourSquare: http://engineering.foursquare.com/
Apple (closest): https://developer.apple.com/
Paypal: https://www.paypal-engineering.com/ https://devblog.paypal.com/
Dropbox: https://blogs.dropbox.com/tech/
Edit: More (collected from this link: http://www.quora.com/What-are-the-top-startup-engineering-blogs):
Yelp: http://engineeringblog.yelp.com/
Quora: http://engineering.quora.com/
Yammer: http://eng.yammer.com/blog/
AirBnB: http://nerds.airbnb.com/
Square: https://corner.squareup.com/
Flickr: http://code.flickr.net/
Soundcloud: https://developers.soundcloud.com/blog/
Cloudera: http://blog.cloudera.com/blog/
Slideshare: http://engineering.slideshare.net/
Heroku: http://engineering.heroku.com/
Pinterest: http://engineering.pinterest.com/