W
Wallaroo Labs Blog
blog.wallaroolabs.com · Company blog · on HN since 2017
Wallaroo Labs is a company that built Wallaroo, a stateful stream processing framework, and its blog covers Pony, Python, and distributed state.
What HN saysHN links it for engineering posts like why they chose Pony, and one commenter recommends its articles, including ones with latency figures.
20HN people shared it
9linked it in comments
63stories submitted
1.9Kstory points
6 years agolast shared
2017people per year2026
Most-shared posts
- 1Why we used Pony to write Wallaroo5 people · 162 points · first shared 2017 · 84 comments on HN
- 2Wallaroo: a fast, scalable data processing engine3 people · 154 points · first shared 2017 · 69 comments on HN
- 3The Snake and the Horse: How Wallaroo's Python API Works with Pony3 people · 28 points · first shared 2018 · 8 comments on HN
- 4Measuring Correctness of State in a Distributed System3 people · 3 points · first shared 2017 · discussion on HN
- 5Dynamic Tracing a Pony and Python Program with DTrace2 people · 112 points · first shared 2017 · 2 comments on HN
- 6Detecting Spam as it happens: Erlang+Python working together with Wallaroo2 people · 16 points · first shared 2018 · discussion on HN
- 7You might have a streaming data problem if2 people · 16 points · first shared 2018 · discussion on HN
- 8How Wallaroo Scales Distributed State2 people · 12 points · first shared 2017 · discussion on HN
- 9Make Python Pandas go fast2 people · 8 points · first shared 2018 · discussion on HN
- 10Hello wallaroo2 people · first shared 2017
- 11Go Python, Go: Stream Processing for Python1 people · 251 points · first shared 2017 · 66 comments on HN
- 12Stream Processing for Go1 people · 198 points · first shared 2018 · 30 comments on HN
- 13Why we wrote our Kafka Client in Pony1 people · 137 points · first shared 2018 · 95 comments on HN
- 14Choosing Elixir's Phoenix to Power a Real-Time Web UI1 people · 104 points · first shared 2018 · 20 comments on HN
- 15How the end-to-end back-pressure mechanism inside Wallaroo works1 people · 78 points · first shared 2018 · 5 comments on HN
What HN people wrote when they linked it
spooneybarger · 2018-04-26
Hi y'all. I'm the author of the post and will be keeping an eye on the comments this evening. Happy to answer questions as best as I can.
Part 1 is available at https://blog.wallaroolabs.com/2018/04/adventures-with-cgo-part-1--the-…
strmpnk · 2017-12-07
While I'm not affiliated with Wallaroo Labs, I've been following their work. One of the best things to check out is their nice collection of blog articles.
1: https://blog.wallaroolabs.com/2017/03/hello-wallaroo/ has some figures around latencies their working with and https://blog.wallaroolabs.com/2017/10/measuring-correctness-of-state-i… talks about how they test their system under faults
2: https://blog.wallaroolabs.com/2017/10/why-we-used-pony-to-write-wallar…
For the rest, I better leave it to them to give the most up to date answers on those as the project is moving fast.
zerebubuth · 2017-09-28
I think that one of the great benefits to open source platforms such as PostgreSQL, Hadoop, Kafka and others is that their open license guarantees no vendor lock-in. This means users can relax in the knowledge that the platform won't disappear if the original company disappears (or hikes prices), and means that it's possible to support the platform forever - even if that means bringing it in-house.
The Wallaroo license seems to be non-free, which I think is very unfortunate and a misses an opportunity to be more widely used: https://blog.wallaroolabs.com/2017/09/open-sourcing-wallaroo/#licensin…
chuckblake · 2017-12-01
Wallaroo Labs | Developer Evangelist | SF Bay Area | Full-time
We are the makers of Wallaroo - ultrafast framework for building & operating stateful data applications without worrying about scale.
Wallaroo Labs is working on a huge idea, and this is a phenomenal opportunity for a person who enjoys challenges. We believe in open source and strive to build on these technologies. Our distributed team is ten people and growing. We had have generated a lot of interest in our product and vision and raised a large seed round with several well-known VCs.
We are looking for a Developer Evangelist to drive the adoption of Wallaroo open-source offering within the developer community. This position is essential to our success; you will be responsible for identifying friction points with Wallaroo and systematically eliminate to improve the developer experience.
Qualities we are looking for
- Ability to learn new technologies quickly.
- Comfortable with a variety of programming languages, experience with Python, Go, JavaScript are a plus.
- Familiar with Big Data technologies.
- Desire and ability to work with enterprise clients and our open source community.
- Experience working with open source software, GitHub, etc.
-Familiar with software development process in a business setting.
Outstanding verbal and written communication skills.
Learn more about Wallaroo
Corporate site: https://www.wallaroolabs.com
Wallaroo Community Site: https://www.wallaroolabs.com/community
Wallaroo…
whynotwhynot · 2020-08-18
bpicolo · 2018-01-18
They also have a blog post on just that:
https://blog.wallaroolabs.com/2017/10/why-we-used-pony-to-write-wallar…
e12e · 2017-09-28
Strikes me as an odd choice - perhaps ideally the open source announcement should have contained a bit more of the "Hello wallaroo" post:
https://blog.wallaroolabs.com/2017/03/hello-wallaroo/
It has a pretty good overview of what wallaroo is/does (I think, as someone outside/new to the project).
Also:
> We are planning on releasing Wallaroo as open source in April of this year.
Ouch! :) Congratulations on getting it out the door - looks very interesting.
dang · 2017-09-27
The Github page seems to have a bit more information so we changed the URL from https://blog.wallaroolabs.com/2017/09/open-sourcing-wallaroo/.
nickpsecurity · 2018-01-08
Note that I'm answering your question with two examples that would and might be considered OS's because they themselves had to implement the capability model in generic ways and with principles you might find useful in non-OS work. Especially with prevalence of things like containers, browsers, and full-on interpreters that are like mini-OS's. I have some non-OS examples, though.
KeyKOS/KeySAFE was a whole, capability-based platform designed for high-security:
http://www.cap-lore.com/Agorics/Library/KeyKos/keysafe/Keysafe.html
Rees did a security kernel for Scheme48:
http://mumble.net/~jar/pubs/secureos/secureos.html
Waterkin server for web apps done with capability-secure version of Java:
http://waterken.sourceforge.net
DarpaBrowser was written in E language:
http://www.combex.com/tech/darpaBrowser.html
Pony is used for Wallaroo. It presumably uses reference capabilities:
https://blog.wallaroolabs.com/2017/10/why-we-used-pony-to-write-wallar…
https://tutorial.ponylang.org/capabilities/reference-capabilities.html
Edited to add Cap n Proto for IPC. Thanks kentonv for reminder. Should not have forgotten!
https://capnproto.org