C
Carol Chen
carolchen.me · Personal blog · on HN since 2020
Carol Chen, a young programmer, writes on JIT compilers, transformer inference, and why she doesn't want to be a founder.
What HN saysHN commenters praise her JIT compiler posts as very nice and impressive given her age, and link her founder essay for another perspective.
15HN people shared it
6linked it in comments
19stories submitted
798story points
4 years agolast shared
2020people per year2026
Most-shared posts
- 1A Deep Introduction to JIT Compilers: JITs are not very Just-in-time3 people · 311 points · first shared 2020 · 97 comments on HN
- 2Transformer Inference Arithmetic3 people · 66 points · first shared 2022 · 2 comments on HN
- 3I Don't Want to Be a Founder2 people · 345 points · first shared 2020 · 233 comments on HN
- 4JIT Compilers Are Implemented and Fast: Julia, PyPy, LuaJIT, Graal and More2 people · 28 points · first shared 2020 · 5 comments on HN
- 5How JIT Compilers Are Implemented and Fast: PyPy, LuaJIT, Graal and More2 people · 9 points · first shared 2021 · discussion on HN
- 6Nvidia calculates 30x speedup for H100s compared to A100s2 people · 1 points · first shared 2022 · discussion on HN
- 7Escape Analysis in PyPy, LuaJIT, V8, C++, Go and More1 people · 11 points · first shared 2020 · discussion on HN
- 8I Don't Want to Be a Founder and I Don't Think You Do Either1 people · 6 points · first shared 2021 · 1 comments on HN
- 9Iconic Images Programmers Happen to Know1 people · 5 points · first shared 2020 · 1 comments on HN
- 10Ideas for Programmers Looking Beyond Web Development1 people · 3 points · first shared 2020 · discussion on HN
- 11Working at Shopify Is Great1 people · 3 points · first shared 2021 · discussion on HN
- 12Escape analysis in PyPy, LuaJIT, V8, C++, Go and more (2020)1 people · 3 points · first shared 2021 · discussion on HN
- 13Shortest Path Faster1 people · 3 points · first shared 2021 · discussion on HN
- 14Python History Since the Fifteenth Century1 people · 2 points · first shared 2020 · discussion on HN
- 15You can't be “not good enough” to skip (or drop out of) college1 people · 2 points · first shared 2020 · discussion on HN
What HN people wrote when they linked it
cs702 · 2020-07-05
Very nice. I just looked at the author's resume.[a] It appears she is still in, or only very recently graduated from, high school. Is that right? Impressive!
[a] https://carolchen.me/
Animats · 2022-05-05
In theory, yes. In CPython, apparently not. In PyPy, yes.[1] PyPy has to do a lot of extra work to permit some unlikely events.
[1] https://carolchen.me/blog/jits-impls/
i-j · 2020-09-13
An additional perspective, Carol Chen had an interesting post and thoughts about her ups and downs of being a co-founder / founder
https://carolchen.me/blog/founding-bad/
kipply · 2020-07-07
I wrote a blog post about hugging that a google recruiter saw and emailed me about. I probably would've been contacted anyway, but the post certainly helped with making an impression!
https://carolchen.me/blog/group-hugging-theory/
Smerity · 2022-04-08
I just want to note the replies to this thread are excessively dismissive and toxic. You may not agree with the wording of their advertising ("world's most powerful NLP toolkit" is marketing speak, sure) but going from that to implying the technical side is "only Min-GPT" is tremendously weird. As someone who works in machine learning and specifically language models this is a team I'm keeping an eye on.
For anyone who wanted more technical discussion re: ML / LM (though the author notes this work "[does] not reflect the architectures or latencies of my employer's models" i.e. it's an exploratory technical breakdown of general model characteristics) I've appreciated the technical write-ups from @kipperrii (ML ops @ Cohere) recently:
- Transformer Inference Arithmetic: https://carolchen.me/blog/transformer-inference-arithmetic/
- Breakdown of H100s for Transformer Inferencing: https://carolchen.me/blog/h100-inferencing/
icandoit · 2020-10-29
I like these resources. The most general are first, more specific toward the end.
https://pragprog.com/titles/tpdsl/language-implementation-patterns/
Language Implementation Patterns
Create Your Own Domain-Specific and General Programming Languages
by Terence Parr (Antlr)
https://craftinginterpreters.com/
by Bob Nystrom
https://interpreterbook.com/
Writing An Interpreter In Go
by Thorsten Ball (also has a compiler book)
The Implementation of Lua 5.0 (short)
https://www.lua.org/doc/jucs05.pdf
A Deep Introduction to JIT Compilers: JITs are not very Just-in-time
https://carolchen.me/blog/jits-intro/
by Carol Chen
video series: JIT programming language development in C
https://www.youtube.com/watch?v=k3gDvF-Fbpw&list=PLvdK1vRmp8wMzH4w…
by Dmitriy Kubyshkin