A
Andrey Kurenkov
andreykurenkov.com · Personal blog · on HN since 2016
Andrey Kurenkov's blog, written as a grad student in AI, with a history of neural nets and deep learning and notes on research life.
What HN saysCommenters repeatedly recommend his multi-part history of neural nets and deep learning as a great write-up, with references to the key publications.
17HN people shared it
7linked it in comments
49stories submitted
849story points
4 years agolast shared
2016people per year2026
Most-shared posts
- 1A 'Brief' History of Neural Nets and Deep Learning8 people · 255 points · first shared 2016 · 20 comments on HN
- 2A 'Brief' History of Neural Nets and Deep Learning (2015)3 people · 47 points · first shared 2018 · 1 comments on HN
- 3A 'Brief' History of Game AI3 people · 8 points · first shared 2016 · discussion on HN
- 4A 'Brief' History of Neural Nets and Deep Learning, Part 4 (2015)2 people · 145 points · first shared 2016 · 7 comments on HN
- 5Lessons learned the hard way in grad school (so far)2 people · 60 points · first shared 2020 · 15 comments on HN
- 6Effective Teamwork – A One Page Guide2 people · 14 points · first shared 2018 · discussion on HN
- 7KerasJS3D interactive deep learning demos2 people · 2 points · first shared 2018 · discussion on HN
- 8Organizing My Emails with a Neural Net1 people · 147 points · first shared 2016 · 32 comments on HN
- 9A 'Brief' History of Game AI Up to AlphaGo1 people · 71 points · first shared 2018 · 18 comments on HN
- 10The Sickness That Is Depression1 people · 41 points · first shared 2018 · 4 comments on HN
- 11Show HN: ObjectCropBot – Interactively Crop Objects from Photos with AI1 people · 33 points · first shared 2017 · 7 comments on HN
- 12Things Everyone Should Know About Depression1 people · 7 points · first shared 2020 · discussion on HN
- 13Why and How to Get the Most Out of Twitter1 people · 4 points · first shared 2020 · 1 comments on HN
- 14My Tools and Practices for a Healthier and More Productive Life1 people · 4 points · first shared 2021 · discussion on HN
- 15IMDB Data Visualizations with D3 and Dimple.js1 people · 3 points · first shared 2016 · discussion on HN
What HN people wrote when they linked it
andreyk · 2019-09-19
I really like this quote from this article:
“I love writing. I get a kick out of sharing my thoughts with others. The act of transforming ideas into words is an amazingly efficient way to solidify and refine your thoughts about a given topic. “
So much so that it is quoted on my own Jekyll-based personal website (http://www.andreykurenkov.com/). I have set up 3 additional site since with Jekyll, all hosted on GitHub, and it's super easy every time.
davidcuddeback · 2018-03-05
Assuming you're asking specifically about the history of DL/ML, I can recommend this (4-part) blog series: http://www.andreykurenkov.com/writing/ai/a-brief-history-of-neural-net… It includes references for the relevant publications that identify problems (e.g., exploding gradients) and their solutions.
bpesquet · 2016-08-19
Great writeup about how deep learning came to be: http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-a… (posted here a few months ago).
withfries2 · 2016-06-11
cs702, this deck started as a short talk so I didn't have time to acknowledge all the great work leading up to the Google YouTube experiment. Your list is good, and I'd add Rosenblatt for the first perceptron, Rumelhart & McClelland for applying techniques to perception, Werbos for backpropogation, Fukushima for convolutional networks, and so many more.
I found these helpful while researching the history:
http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-a…
http://www.scholarpedia.org/article/Deep_Learning
What else have you found particularly useful?
melling · 2018-03-18
The idea of neural networks go back a lot further than CMU.
http://www.andreykurenkov.com/writing/ai/a-brief-history-of-neural-net…
lovelearning · 2017-01-04
I remember an informative article series [1] that was posted here some months ago. Previous discussion on it [2].
[1]: http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-a…
[2]: https://news.ycombinator.com/item?id=10910887
bla2 · 2016-03-15
This four-part series explains it well: http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-a…