Adam Karvonen

Hey - Thanks for sharing! Will take a closer look later but if you are hanging around now, it might be worth asking this now. I read this blog post recently: https://adamkarvonen.github.io/machine_learning/2024/06/11/sae-intuiti… And the author talks about challenges with evaluating SAEs. I wonder how you tackled that and where to look inside your repo for understanding the your approach around that if possible. Thanks again!

As described in the OP's blog post https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world… - one of the incredible things here is that the standard GPT architecture, trained from scratch from PGN strings alone, can intuit the rules of the game from those examples, without any notion of the rules of chess or even that it is playing a game. Leela, by contrast, requires a specialized structure of iterative tree searching to generate move recommendations: https://lczero.org/dev/wiki/technical-explanation-of-leela-chess-zero/ Which is not to diminish the work of the Leela team at all! But I find it fascinating that an unmodified GPT architecture can build up internal neural representations that correspond closely to board states, despite not having been designed for that task. As they say, attention may indeed be all you need.

I'm waiting for a build so I went fully down this trail. XD A1) Yes it can be done with a 4090. (2a). A2) 2 days. (4d/4e). B) Up to you, author did both and settled on 50M which they got to 1300 ELO. (note: they also did subsequent work with the same model to increase perf without further training) (2a). C) Mu: there's no limit as you can page in/out (3a, 3c), and its trivial to store in both RAM and VRAM. 30B fits in memory with 32 GB of RAM or VRAM. (3e) Starting from: 1. article: https://adamkarvonen.github.io/machine_learning/2024/03/20/chess-gpt-i… 2. second sentence links to post on training: https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world… 2a. "A 50 million parameter GPT trained on 5 million games of chess learns to play at ~1300 Elo in one day on 4 RTX 3090 GPUs" 2b. "The 50M parameter model played at 1300 Elo with 99.8% of its moves being legal within one day of training" 3. re: most parameters 4090 can do: 3a. understanding is there is no limitation, in that, you don't _need_ to have every parameter in memory at all times, either during training or inference. 3b. google "are amount of parameters in llm limited by vram size" 3c. go to /r/LocalLLaMa link: https://www.reddit.com/r/LocalLLaMA/comments/15j0mvm/what_are_the_vari… (why? its a favorite of mine, believe its the closest you get to local training ppl talking in open space that's not discord) 3d. understanding in 3a…

CAD and machining are different fields, true, but I see a lot of the same flaws that Adam Karvonen highlighted in his essay on LLM-aided machining a few months ago: https://adamkarvonen.github.io/machine_learning/2025/04/13/llm-manufac… Do any people with familiarity on what's under the hood know if the latent space produced by most transformer paradigms is only capable of natively simulating 1-d reasoning and has to kludge together any process for figuring geometry with more degrees of freedom?

1000% this. I would only add this has been demonstrated explicitly with chess: https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world…

Since you can train an LLM to play chess from scratch, I would not be surprised if you could also train one to play Set. I might experiment with it tomorrow. https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world…

>they don't appear to do the obvious thing which is display the reconstructed "internal" board state This is literally figure 4 This also re-constructs the board state of a chess-playing LLM https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world…

related : Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task https://arxiv.org/abs/2210.13382 Chess-GPT's Internal World Model https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world… discussed here https://news.ycombinator.com/item?id=38893456

Chess is not stateless. En Passant requires last move and castling rights requires nearly all previous moves. https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world…

More details in the previous blog post: https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world… > A 50 million parameter GPT trained on 5 million games of chess learns to play at ~1300 Elo in one day on 4 RTX 3090 GPUs. And from the paper: https://arxiv.org/abs/2403.15498 > The 25M parameter model took 72 hours to train on one RTX 3090 GPU. The 50M parameter model took 38 hours to train on four RTX 3090 GPUs. definitely inspiring :)

The previous blog post [0] mentioned they were using stockfish with 0.1 seconds per move. [0] https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world…

Also a nice article[0] featured on here[1] recently. [0] https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world… [1] https://news.ycombinator.com/item?id=38893456

https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world… would be a better link here.

> LLMs can't think. They are generating tokens one at a time Huh? They are generating tokens one at a time - sure that's true. But who's shown that predicting tokens one at a time precludes thinking? It's been shown that the models plan ahead, i.e. think more than just one token forward. [1] How do you explain the world models that have been detected in LLMs? E.g. OthelloGPT [2] is just given sequences of games to train on, but it has been shown that the model learns to have an internal representation of the game. Same with ChessGPT [3]. For tasks like this, (and with words), real thought is required to predict the next token well; e.g. if you don't understand chess to the level of Magnus Carlsen, how are you going to predict Magnus Carlsen's next move... ...You wouldn't be able to, even just from looking at his previous games; you'd have to actually understand chess, and think about what would be a good move, (and in his style). [1] https://www.anthropic.com/research/tracing-thoughts-language-model [2] https://www.neelnanda.io/mechanistic-interpretability/othello [3] https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world…