Read on Twitter
Today I kept thinking about the machine learning / NLP / deep learning related blog posts (not papers) that have been transformational for me.
Here is a short thread of a few high-impact blog posts that come to mind.
Here is a short thread of a few high-impact blog posts that come to mind.
The Unreasonable Effectiveness of Recurrent Neural Networks
by @karpathy
http://karpathy.github.io/2015/05/21/rnn-effectiveness
by @karpathy
http://karpathy.github.io/2015/05/21/rnn-effectiveness
Understanding Convolutional Neural Networks for NLP
by @dennybritz
http://www.wildml.com/2015/11/understanding-convolutional-neural-networks-for-nlp/
by @dennybritz
http://www.wildml.com/2015/11/understanding-convolutional-neural-networks-for-nlp/
All NLP related blog posts from @VeredShwartz's blog:
http://veredshwartz.blogspot.com/search/label/natural%20language%20processing
http://veredshwartz.blogspot.com/search/label/natural%20language%20processing
An overview of gradient descent optimization algorithms. Sebastian always publishes awesome NLP content that I have been following for a while now.
by @seb_ruder https://ruder.io/optimizing-gradient-descent/
by @seb_ruder https://ruder.io/optimizing-gradient-descent/
An Overview of Deep Learning for Curious People.
by @lilianweng
https://lilianweng.github.io/lil-log/2017/06/21/an-overview-of-deep-learning.html
by @lilianweng
https://lilianweng.github.io/lil-log/2017/06/21/an-overview-of-deep-learning.html
Attention and Memory in Deep Learning and NLP
by @dennybritz
http://www.wildml.com/2016/01/attention-and-memory-in-deep-learning-and-nlp/
by @dennybritz
http://www.wildml.com/2016/01/attention-and-memory-in-deep-learning-and-nlp/
Troubling Trends in Machine Learning Scholarship
by @zacharylipton
http://approximatelycorrect.com/2018/07/10/troubling-trends-in-machine-learning-scholarship/
by @zacharylipton
http://approximatelycorrect.com/2018/07/10/troubling-trends-in-machine-learning-scholarship/
The list will be different for every generation but these are some of the blog posts that had been transformational for me. There are many more blog posts out there, so feel free to share. I thank these and many other people for making ML more accessible and welcoming.
