AI Research Papers

General Information

This is a collection of research papers on AI.

• 27 papers recommended by Ilia Sutskever
• Link to the full paper.

Research Papers

• The Annotated Transformer
• The First Law of Complexodynamics
• The Unreasonable Effectiveness of Recurrent Neural Networks
• Understanding LSTM Networks
• Recurrent Neural Network Regulation
• Keeping Neural Networks Simple by Minimizing the Description Length of the Weights
• Pointer Networks
• ImageNet Classification with Deep Convolutional Neural Networks
• Order Matters: Sequence to Sequence for Sets
• GPipe: Easy Scaling with Micro-Batch Pipeline Parallelism
• Deep Residual Learning for Image Recognition
• Multi-Scale Context Aggregation by Dilated Convolutions
• Neural Message Passing for Quantum Chemistry
• Attention Is All You Need
• Neural Machine Translation By Jointly Learning To Align And Translate
• Identity Mappings in Deep Residual Networks
• A simple neural network module for relational reasoning
• Variational Lossy Autoencoder
• Relational recurrent neural networks
• Quantifying the Rise and Fall of Complexity in Closed Systems: The Coffee Automaton
• Neural Turing Machines
• Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
• Scaling Laws for Neural Language Models
• A Tutorial Introduction to the Minimum Description Length Principle
• Machine Super Intelligence
• Kolmogorov Complexity and Algorithmic Randomness
• CS231n Convolutional Neural Networks for Visual Recognition