Distributed Systems blogs

Martin Fowler writes about software architecture, refactoring, microservices, and agile practice, with long-lived reference articles.

Top post: Microservices

Twitter's official engineering and corporate blog, covering infrastructure, product changes, and moderation decisions.

Top post: Permanent Suspension of RealDonaldTrump (2021)

A site documenting the architectures of large websites and the lessons from scaling them.

Top post: PlentyOfFish Architecture

Discord's engineering and company blog covers its infrastructure, including Rust, Elixir, and message storage, along with policy and privacy updates.

Top post: Why Discord is switching from Go to Rust (2020)

Meta's engineering blog, where its engineers describe infrastructure, messaging, open-source releases, and large-scale systems work.

Top post: Fighting spam with Haskell at Meta (2015)

Adrian Colyer wrote daily summaries of computer science research papers, mostly on systems, databases, and software engineering.

Top post: To type or not to type: quantifying detectable bugs in JavaScript

Google Research's blog and publications site, covering ML, systems, and applied research such as camera technology and tabular models.

Top post: Zanzibar: Google’s Consistent, Global Authorization System (2019)

Fly.io's company blog, with technical posts on hosting, networking, SQLite, distributed systems, and opinions on AI.

Top post: Pricing

Kyle Kingsbury writes on distributed systems correctness, including Jepsen database tests, and satirical technical interview pieces.

Top post: Typing the technical interview

Uber's engineering team writes about its infrastructure, datastores, spatial indexing, and machine learning systems.

Top post: Why Uber Engineering Switched from Postgres to MySQL

LinkedIn's engineering team writes about the company's infrastructure, data systems, and web and mobile development.

Top post: The Log: Real-time data's unifying abstraction

Netflix engineers write about architecture, performance debugging, video encoding, and resilience on the company's engineering blog.

Top post: The Netflix Cosmos Platform: Orchestrated Functions as a Microservice

Netflix engineers write about cloud infrastructure, resilience testing, performance analysis, and recommendations, with early posts on Chaos Monkey and AWS.

Top post: Chaos Monkey released into the wild

Google's cloud team announces products and explains infrastructure such as Spanner, TPUs, and security hardening.

Top post: Google supercharges machine learning tasks with TPU custom chip

Werner Vogels, Amazon's CTO, writes about distributed systems, AWS services, the Dynamo paper and engineering leadership.

Top post: Dynamo: Amazon’s Highly Available Key-Value Store (2007) [pdf]

Hillel Wayne writes about formal methods, TLA+, software engineering practice and programming language history.

Top post: Are We Really Engineers? (2021)

Slack's engineering blog covers its infrastructure, including PHP and Hacklang, Vitess datastores, Electron and memory use.

Top post: Taking PHP Seriously

Confluent's blog covers Apache Kafka, event streaming, and data infrastructure, including posts by Kafka creators and Martin Kleppmann on stream processing.

Top post: Turning the database inside-out with Apache Samza (2015)

Airbnb Engineering is the company's Medium blog on its software systems, covering mobile, GraphQL, metrics, authorization, and workflow tools.

Top post: Airbnb is 'sunsetting' React Native, reinvesting all efforts back into native

Segment's company blog on customer data infrastructure, event delivery, architecture decisions, and engineering costs.

Top post: A million-dollar engineering problem

Vitalik Buterin, co-founder of Ethereum, writes about blockchain design, proof of stake, rollups, governance, and public goods funding.

Top post: Why Proof of Stake?

Citus Data's blog on PostgreSQL, covering pagination, count performance, JSON types, connection scalability, and distributed Postgres.

Top post: Ways to paginate in Postgres (2016)

Ink & Switch is an independent research lab exploring local-first software, collaboration tools, and tools for thought.

Top post: Cambria: Translate your data with lenses (2020)

Coda Hale is a software engineer who writes on password storage, cryptographic timing attacks, distributed systems theory, and how organizations work.

Top post: How To Safely Store A Password

Kyle Kingsbury (Aphyr) publishes Jepsen's tests of distributed databases and explanations of consistency models.

Top post: Jepsen: MongoDB 4.2.6

Martin Kleppmann, author of Designing Data-Intensive Applications, writes on distributed systems, databases, local-first software, and formal verification.

Top post: Accounting for Computer Scientists

Marc Brooker, an AWS distinguished engineer, writes about distributed systems, databases, load balancing, and reliability.

Top post: The power of two random choices

Ethereum Foundation's official blog with protocol updates, research posts by Vitalik Buterin, and security notices.

Top post: Proof of Stake: How I Learned to Love Weak Subjectivity

Netflix engineers write about the company's infrastructure, including containers, content delivery, data caching, notebooks, and security.

Top post: Beyond Interactive: Notebook Innovation at Netflix

Amazon Web Services distinguished engineer who writes about data center design, AWS infrastructure, networking, and large-scale systems.

Top post: AWS Nitro System

Cornell computer scientists, including Emin Gün Sirer, write on distributed systems, Bitcoin, Ethereum, and database fault tolerance.

Top post: Broken by Design: MongoDB Fault Tolerance

Fred Hébert writes about Erlang, system reliability, overload handling, and the human side of automation.

Top post: The Zen of Erlang

Reddit's engineering and company blog covers site features, infrastructure, and the algorithms behind comment ranking and r/Place.

Top post: Reddit’s New Comment Sorting System (2009)

LinkedIn's company blog posts product announcements, open-source releases like Kafka and Voldemort, diversity data, and security breach disclosures.

Top post: LinkedIn admits passwords were stored unsalted

Murat Demirbas, a computer science professor, writes summaries of distributed systems papers and posts on consensus, transactions, and clocks.

Top post: Distributed Transactions at Scale in Amazon DynamoDB (2023)

Mesosphere's company blog covered Apache Mesos, Marathon, and its Datacenter Operating System, with news on container and cluster tooling.

Top post: Apple details J.A.R.V.I.S., the Apache Mesos framework that runs Siri

Yelp's engineers write about infrastructure and open-source tools, including HAProxy, Docker init, data pipelines, and image compression.

Top post: True Zero-Downtime HAProxy Reloads

Martin Sústrik, the main author of ZeroMQ, writes about C versus C++, structured concurrency, networking, and software culture.

Top post: Why should I have written ZeroMQ in C, not C++

Joe Armstrong, co-creator of Erlang, writes about programming, concurrency, Elixir, and small programs on his GitHub-hosted blog.

Top post: A Week with Elixir

PingCAP engineers write about TiDB, their distributed SQL database, plus Rust and Go, performance work, and chaos testing.

Top post: Early Impressions of Go from a Rust Programmer

The engineering and company blog of PagerDuty, the incident response and on-call alerting service, covering reliability and engineering practices.

Top post: Jobs

DataStax, the company behind a commercial Apache Cassandra distribution, writes about Cassandra internals, testing, and data modeling.

Top post: Why Cassandra Doesn't Need Vector Clocks

Basho, maker of the Riak database, wrote about distributed systems, Erlang, vector clocks, and CRDTs.

Top post: RICON 2012: Distributed systems conference for developers

Twitter's engineering team posts about the company's infrastructure, open-source releases, search, and deployment tools.

Top post: Twitter Rolls Twitter.com Back to a Server-Side Architecture

Spotify Engineering is the company's engineering blog, covering topics from shuffle algorithms and DNS to search libraries and coding agents.

Top post: Building the Future of Our Desktop Apps

Lyft Engineering is the ride-sharing company's engineering blog, covering microservices, data pipelines, infrastructure tooling and performance tuning.

Top post: How Lyft Is Migrating 100 Front End Microservices to Next.js

Materialize's company blog covers its streaming SQL database, incremental view maintenance, and engineering write-ups such as a Rust concurrency bug.

Top post: Diagnosing a Double-Free Concurrency Bug in Rust's Unbounded Channels

DockYard, a software consultancy, writes about Elixir, Phoenix, LiveView, and Erlang-style reliability.

Top post: Phoenix Channels vs. Rails Action Cable

Flickr's engineering team writes about infrastructure, image processing, search, and data projects behind the photo-sharing service.

Top post: Show HN: Using computer vision to detect birds in parks

Joseph Gentle, a software engineer, writes about CRDTs, collaborative editing, programming culture, Rust, and the problems of Electron apps.

Top post: Three Tribes of Programming (2017)

The company blog of ArangoDB, a multi-model database, with product posts, benchmarks, and articles on graph databases and C++.

Top post: Performance Benchmark 2018 – MongoDB, PostgreSQL, OrientDB, Neo4j and ArangoDB

Pinterest's engineering team writes about its infrastructure, open-source releases, and front-end and backend migrations.

Top post: Introducing new open-source tools for the Elixir community

Blog of Plataformatec, the Brazilian consultancy behind much early Elixir work, covering Elixir, Erlang, Rails and web architecture.

Top post: Kubernetes and the Erlang VM: orchestration on the large and the small

Official MongoDB company blog covering database features, durability, distributed consistency, and customer deployments.

Top post: Why MongoDB thinks single server durability is overvalued

eBay's corporate site hosts its engineering blog and news, covering search, WebAssembly, knowledge graphs, and security announcements.

Top post: WebAssembly at eBay: A Real-World Use Case

The Kubernetes project's official blog covers releases, design decisions, performance and scaling work, and user case studies.

Top post: Container Runtime Interface (CRI) in Kubernetes

Erlang Solutions, a consultancy for Erlang and Elixir, publishes posts on the BEAM, XMPP messaging, case studies, and industry trends.

Top post: Erlang 19.0 Garbage Collector

Nathan Marz, creator of Apache Storm and Specter, writes about programming, distributed systems, and software work practices.

Top post: How to beat the CAP theorem

Dgraph's company blog covers its distributed graph database and Go libraries like Badger and Ristretto, written by its engineers.

Top post: Manual Memory Management in Go using jemalloc

Cloudera's company blog covers Hadoop, Impala, Kudu and data science techniques, written by its engineers.

Top post: Cloudera Impala: Real-Time Queries in Apache Hadoop