StreamNative Blog

Seems like a great day for Pulsar / StreamNative and Redpanda who are going to get a lot of new customers in the coming years. When looking for alternatives to Kafka these are the most promising options I found, not counting RabbitMQ which needs no introduction. Pulsar seems to be 'kafka done better'. The version of Kafka that Confluent used internally (Kora) seems closer to Pular as well. Pulsar has a lot of features that Kafka doesn't have, like per-message acknowledgement, similar to RabbitMQ. And it has protocol support for RabbitMQ and Kafka, so can be a drop-in replacement. Redpanda seems like a great re-implementation of Kafka. I'm hoping this boosts Pulsar's status and helps get some traction for StreamNative. It seems like the best technical solution for events and messaging. It just needs a bit more market adoption to make an easier choice for enterprise, in my opinion. This might be that moment. https://streamnative.io/ *(yes I know about NATS)

StreamNative | Full Time | Engineering, Product | SF, LA, SLC, Remote | https://streamnative.io StreamNative is the company founded by the original developers of Apache Pulsar. We build a fully managed version of Pulsar and are helping companies build high scale mission critical apps with our robust messaging and streaming API. We are seeing accelerating adoption of Pulsar and strong revenue growth. I am the Chief Architect/ Head of Product and joined the company 2 years ago after getting involved in the community and being an early Pulsar adopter. We are hiring across product and engineering, with the following roles: * Director of Product Management (lead our product management team across all open source and commercial, looking for team builder with technical background and data infrastructure experience) * Product Manager, both open-source and cloud (prefer engineer background and/or experience in data infrastructure) * Cloud Architect (work on our k8s based cloud and integrating Puls of stateful distributed systems) * Platform Engineer (working on open source Pulsar) * Senior Full-stack cloud engineer (working on the apps and service that front our cluster management API) You can find more info at https://StreamNative.io/careers or you can ping me at addison at streamnative.io.

StreamNative | Platform Engineer | Remote (US, EU) | Full-time | https://streamnative.io/ StreamNative is enabling organizations to build the next generation of messaging and event streaming applications. Leveraging Apache Pulsar and Bookkeeper, we optimize for scalability and resiliency while reducing the overhead management and complexity required by incumbent technologies. This position is for developing the core technologies around Apache Pulsar - the cloud-native event streaming system. To learn more about the project, checkout its website: https://pulsar.apache.org Potential Projects - Develop core technologies around Apache Pulsar and Apache BookKeeper - Build ecosystems around Apache Pulsar and Apache BookKeeper - Build developer communities of Apache Pulsar and Apache BookKeeper and publish technical posts - Develop commercial products on Apache Pulsar and Apache BookKeeper Ideal Background - Excellent problem-solving skills, good communication skills, and teamwork spirit; - Familiar with at least one language of Java/Python/Go/C++, with good programming skills; - Familiar with the principles and key technologies of distributed systems. Knowledge and practice in distributed message middleware systems (such as Kafka/RabbitMQ) is preferred; - Experience with big data systems (Hadoop, HDFS, Hive, Spark, Flink, etc.) is preferred; - Experience with Docker, Kubernetes, Ansible/Terraform, etc. is preferred. Apply at:…

> anyone have an idea on how streamnative is doing? we keep pushing Pulsar and moving things - https://streamnative.io/blog/ursa-wins-vldb-2025-best-industry-paper-t…

The bulk of the cost savings comes from the use of object storage rather than attached disks. This eliminates the inter-AZ networking costs associated with Kafka replication mechanism. I break all of the costs down in the following e-book. https://streamnative.io/ebooks/reducing-kafka-costs-with-leaderless-ar…

Congrats on the launch! This is Zhenni from PuppyGraph. Shameless plug - We recently supported Ursa and here is the joint blog to showcase how to integrate Ursa engine with PuppyGraph to enable real-time graph analytics for a financial service use case with data stored in a lake house (not graphDB): https://streamnative.io/blog/integrating-streamnatives-ursa-engine-wit…

Coincidentally, as someone who worked on this blog, I was surprised (and pleased!) to see that we are not the only ones who felt the need to build a Zookeeper alternative. Looks like folks at StreamNative did as well, with their Oxia project: https://github.com/streamnative/oxia. They were just talking about this yesterday at Confluent Current ("Introducing Oxia: A Scalable Zookeeper Alternative" was the title of their talk). https://streamnative.io/blog/introducing-oxia-scalable-metadata-and-co… Seems to be a trend :)

For Pulsar vs. Kafka: https://streamnative.io/blog/apache-pulsar-vs-apache-kafka-2022-benchm…

Take a look at Apache pulsar which is a messaging and streaming platform https://streamnative.io/blog/comparison-of-messaging-platforms-apache-…

It looks like the website has some problems. See this link: https://www.streamnative.io/blog/handling-100k-consumers-with-one-puls…

Also there's one related article: <Benchmarking Pulsar and Kafka - A More Accurate Perspective on Pulsar’s Performance>: https://streamnative.io/blog/tech/2020-11-09-benchmark-pulsar-kafka-pe…

More details about KoP: https://streamnative.io/blog/tech/2020-03-24-bring-native-kafka-protoc…

Apache Pulsar: https://streamnative.io/blog/tech/2019-10-22-powering-tencent-billing-… Or BookKeeper directly.

Just share a blog post published before, which compares the costs of running a 5 GB/s Kafka workload using Ursa, Warpstream, MSK, and Redpanda: https://streamnative.io/blog/how-we-run-a-5-gb-s-kafka-workload-for-ju… And the test result was verified by Databricks: https://www.linkedin.com/posts/kramasamy_incredible-streamnatives-blog… The analysis in the blog is based on two key assumptions: - Multi-zone deployment on AWS - Tiered storage is not enabled If you’re looking to estimate costs with tiered storage, you can ignore the differences in storage costs mentioned in the post. One important point not covered in the blog is that Ursa compacts data directly into a Lakehouse (This is also the major differentiator from WarpStream). This means you maintain only a single copy of data, shared between both streaming reads and table queries. This significantly reduces costs related to: - Managing and maintaining connectors - Duplicated data across streaming and Lakehouse systems

What If We Could Rebuild Kafka From Scratch? - Gunnar Morling (https://news.ycombinator.com/item?id=43790420) 1. Five Advantages of Log-Based Change Data Capture (https://debezium.io/blog/2018/07/19/advantages-of-log-based-change-dat… 2. Why Data Architecture Should Guide Your Query Engine Decision (https://www.onehouse.ai/blog/why-data-architecture-should-guide-your-q… 3. Reimagine Apache Kafka (https://streamnative.io/blog/ursa-reimagine-apache-kafka-for-the-cost-… 4. Book Review: Designing Data-Intensive Applications | Henrik Warne's blog (https://henrikwarne.com/2019/07/27/book-review-designing-data-intensiv… 5. Of Streams and Tables in Kafka and Stream Processing, Part 1 (https://www.michael-noll.com/blog/2018/04/05/of-stream-and-tables-in-k…