96 representative works from 1931 to today, grouped by editorial role and labeled by publication status
Papers are the skeleton of AI history. This catalog collects 96 foundational works that shaped the field, each linked to its primary source.
Selection is based on historical representation, technical influence, and editorial judgment. Peer-reviewed papers, technical reports, preprints, position papers, and system cards may be included and are labeled by publication status. Corrections and additions are welcome through the public channel on the Editorial Policy and Corrections page.
Showing 96 of 96 papers
On Formally Undecidable Propositions of Principia Mathematica and Related Systems I
Proves that any consistent formal system able to express arithmetic contains true statements it cannot prove, setting the limit that later framed what computation and machine reasoning can settle.
Introduces the universal Turing machine and proves the Entscheidungsproblem is undecidable, founding the theoretical basis of computer science.
Defines effective calculability through the λ-calculus and exhibits a problem that no such procedure can decide, reaching the limits of computation independently of Turing.
Models neural activity as propositional logic, providing the first mathematical theory of artificial neural networks.
Founding paper of information theory, defining entropy and channel capacity as fundamental limits of communication.
Proposes the imitation game (Turing test) and systematically formulates the question "Can machines think?", helping establish AI as a research program.
The founding proposal for the Dartmouth summer workshop introduced the term "artificial intelligence" and outlined the field’s research agenda.
Describes the Logic Theorist, an early theorem-proving program that proved theorems from Whitehead and Russell’s Principia Mathematica by heuristic search, demonstrating automated reasoning in propositional logic.
Casts human problem solving as heuristic search through a space of symbolic states, the account behind the General Problem Solver and the information-processing view of mind.
Introduces the first trainable linear-threshold neuron, founding the connectionist lineage that leads to modern deep learning.
Proposes the Advice Taker, a program that reasons with declarative axioms and accepts new "advice" as English sentences, helping establish the research agenda for knowledge representation and symbolic AI.
Demonstrates self-play learning with a scoring function in a checkers program, an early reinforcement-learning milestone associated with the term "machine learning".
Gelernter addresses how a machine can efficiently manipulate formal systems whose predicates are highly symmetric, and states a theorem and a rule of syntactic symmetry as the solution. The work sits alongside the geometry theorem machine he was building at IBM, which proved its first theorem in elementary Euclidean plane geometry in the early spring of 1959.
Introduces the ADALINE neuron and the Least-Mean-Squares (LMS) learning rule, the forerunner of modern stochastic gradient descent.
Introduces symbolic expressions, recursive functions over them, and the eval that lets a language interpret itself — the design that became Lisp and the working language of symbolic AI.
Gathers the perceptron work into a full theory of layered probabilistic networks, stating both what such machines can learn and where the single-layer form stops.
Builds an apparently conversational program from pattern matching and rewriting rules, and its author immediately points out how much understanding readers credit it with that it does not have.
Introduces the Hopfield associative-memory network, linking neural computation to the energy landscapes of statistical physics and reviving interest in neural networks during the early AI winter.
Documents a production-rule system that configured DEC computer orders daily, one of the few expert systems that survived routine production use and could be costed.
Lays the algorithmic foundations of Bayesian belief networks, including message-passing on tree-structured graphs and the moralization/triangulation machinery that powers modern probabilistic inference and causal reasoning.
The canonical statement of the back-propagation algorithm for multilayer neural networks, demonstrating that hidden units could learn useful internal representations and reigniting connectionist research in the late 1980s.
Formalises the temporal-difference (TD) learning family, unifying Samuel’s checkers learner with secondary reinforcement from animal psychology and laying the algorithmic groundwork for TD(λ), Q-learning, and modern policy-gradient methods.
Introduces the Simple Recurrent Network (Elman network) and shows that low-dimensional dynamical structure can emerge from training on sequential input, providing one of the earliest demonstrations of useful representation learning in recurrent nets.
Introduces the soft-margin support vector machine, adding slack variables to handle non-separable data and turning the maximal-margin classifier into the dominant general-purpose learning method of the late 1990s.
Introduces the original LSTM architecture using memory cells, input gates, and output gates to preserve error flow across long sequences; the now-standard forget gate was introduced later by Gers, Schmidhuber, and Cummins.
Presents the LeNet-5 convolutional neural network and the full end-to-end gradient-based learning pipeline (including loss layers, backprop through convolution/pooling, and graph-transformational network descriptions) that became the blueprint for modern deep vision models.
Introduces a deep autoencoder that reconstructs high-dimensional data far more faithfully than PCA, lighting the first spark of the deep learning revival.
Derives a fast, greedy algorithm that learns deep belief nets one layer at a time and then fine-tunes them; the resulting network classified handwritten digits better than the best discriminative methods of the time, and the result revived interest in deep neural networks.
Moves training of deep unsupervised models onto graphics processors for order-of-magnitude speedups, making routine the hardware path on which the next decade of deep learning scaled.
DQN combines Q-learning with a convolutional network that learns control policies directly from raw pixels; applied unchanged to seven Atari 2600 games, it beat all earlier approaches on six and a human expert on three, opening the way to deep reinforcement learning.
The CBOW and Skip-gram models of word2vec make large-scale word embedding training cheap and famously expose semantic geometry such as king - man + woman ≈ queen.
The VAE couples latent-variable generative modeling with stochastic gradient training through the reparameterization trick, becoming one of the foundations of modern generative deep learning.
Introduces learned attention into encoder-decoder translation, freeing long sentences from fixed-length bottlenecks and seeding every Transformer that followed.
GANs let a generator and discriminator duel to implicitly learn high-dimensional distributions, opening a second great road of generative modeling.
Dropout randomly silences units to break co-adaptation, sharply improving generalization in large nets and becoming a standard tool of deep learning practice.
BatchNorm normalizes layer inputs, letting deep networks train with higher learning rates and converge faster; it became a near-default building block of vision models.
Casts generative modelling as reversing a gradual noising process, the formulation on which later diffusion models rest.
Residual connections stabilize training of hundred- and thousand-layer nets; an ensemble of ResNets reached 3.57% top-5 error on ImageNet and won ILSVRC 2015, resetting the scale of vision models.
Splits words into frequency-derived subword units so a fixed vocabulary can spell anything, the tokenization scheme most later language models inherited.
Combines pruning, trained quantization and Huffman coding into one pipeline that shrinks a network by an order of magnitude with little loss of accuracy, an early statement that numerical precision is a design variable.
WaveNet models raw audio sample-by-sample with dilated causal convolutions, pushing speech synthesis close to human naturalness and paving the way for later neural audio models.
PPO replaces trust-region machinery with a clipped first-order surrogate, making policy gradient methods both stable and efficient at scale and quickly becoming the de facto standard of applied RL.
Routes each token through only a few experts out of many, letting a network’s parameter count grow far beyond the computation spent on any one input.
Introduces the Transformer, an attention-only architecture that abandons recurrence and convolutions and surpasses prior sequence-transduction quality while training in a fraction of the time.
Trains a subword tokenizer straight from raw text with no language-specific pre-tokenization, so one pipeline serves languages that do not separate words with spaces.
Pre-trains a deep bidirectional Transformer with masked language modeling and next-sentence prediction, then sets new state-of-the-art on eleven NLP benchmarks.
Casts every NLP task as text-to-text and uses the C4 corpus to systematically compare transfer-learning design choices for a unified Transformer.
Introduces DDPM, showing that iterative denoising diffusion probabilistic models match GANs on high-fidelity image synthesis.
Composes tensor, pipeline and data parallelism into a single schedule and measures the throughput of training a language model across thousands of GPUs.
Freezes the pretrained weights and trains a pair of low-rank matrices instead, cutting the cost of adapting a large model to a small fraction of full fine-tuning.
Uses an autoregressive Transformer over discrete text and image tokens to produce high-quality zero-shot text-to-image generations (DALL·E).
Trains image-text contrastive learning on 400M pairs to produce vision encoders that transfer zero-shot to many downstream tasks.
Presents a GPT model fine-tuned on code together with a benchmark scored by functional correctness, turning programming from a genre of text generation into a measurable capability, and discusses its safety and labour effects alongside.
Performs diffusion in the latent space of a pretrained autoencoder, enabling high-resolution text-to-image synthesis with modest compute (Stable Diffusion).
Shows that prompting large language models with intermediate reasoning steps substantially improves performance on arithmetic, commonsense, and symbolic reasoning.
Fine-tunes GPT-3 with reinforcement learning from human feedback to follow instructions more faithfully — the direct precursor to ChatGPT (InstructGPT).
Trains a helpful and harmless assistant using RLAIF, where the model critiques and revises its own outputs against a written constitution.
Trains 7B–65B foundation models on trillions of tokens of publicly available data alone; the 13B model outperforms GPT-3 (175B) on most benchmarks, and the 65B model is competitive with Chinchilla-70B and PaLM-540B.
Organises scattered agent work into construction, evaluation and application, marking the point at which the term settled from an assortment of practices into a field.
Backpropagates through a 4-bit quantized base model into low-rank adapters, bringing the fine-tuning of a large model within reach of a single GPU.
Quantizes the weights of a large language model after training, one layer at a time and in a single pass, so a model can be served at lower precision without retraining.
Has a small draft model propose several tokens that the target model verifies in parallel, cutting latency while leaving the output distribution unchanged.
Manages the attention cache in fixed-size pages the way an operating system manages memory, so a server holds far more concurrent requests without reserving the worst case for each.
Introduces Mamba, a selective state-space architecture without attention that scales linearly with sequence length; on language modeling its 3B model outperforms Transformers of the same size and matches Transformers twice its size. It became one of the most influential post-Transformer architectures of 2023.
AlexNet, a large CNN trained on GPUs, slashed ImageNet top-5 error from 26% to 15%, marking deep learning’s decisive victory over hand-crafted visual features.
The Nature DQN adds experience replay and a target network, letting a single model reach or surpass human play on 49 Atari games and cementing deep RL as a paradigm.
AlphaGo couples policy and value networks with Monte Carlo tree search and defeats European champion Fan Hui 5-0, announcing that deep RL has reached the deepest strata of human strategic play.
Demonstrates that a generative pre-trained Transformer transfers effectively to discriminative NLP tasks, launching the GPT line of work.
Trains a 1.5B-parameter Transformer decoder and shows that language modeling at scale yields strong zero-shot task performance.
Scales GPT to 175B parameters and shows that large language models perform strong few-shot in-context learning across many tasks.
Describes GPT-4, a large multimodal model accepting image and text inputs that approaches human-level performance on many professional and academic benchmarks.
Introduces the Gemini family (Ultra/Pro/Nano) of natively multimodal models trained jointly across text, code, image, audio, and video.
OpenAI publishes the system card for the o1 model series, trained with large-scale reinforcement learning to reason using chain-of-thought. o1 reaches state-of-the-art on science and coding tasks and demonstrates reasoning-based policy adherence.
The ARC Prize introduces ARC-AGI-3, an interactive benchmark for studying agentic intelligence through abstract turn-based environments where agents must explore, infer goals, build internal models of environment dynamics, and plan action sequences without explicit instructions. As of March 2026, humans solve 100% of environments while frontier AI systems score below 1%.
Applies sparse autoencoders to the middle layer of Claude 3 Sonnet, Anthropic’s medium-sized production model, extracting millions of features — many of them monosemantic and highly abstract — from dictionaries of up to 34 million.
Describes DeepSeek-V3, a 671B-parameter MoE model using Multi-head Latent Attention and DeepSeekMoE, and reports that it outperforms other open-weight models and approaches leading closed models on major benchmarks, at a fraction of frontier-model training cost.
Introduces the Gemini 1.5 family of compute-efficient multimodal models with million-token context windows — capable of fine-grained reasoning across multiple long documents and hours of video and audio.
Meta presents the Llama 3 family of open-weight foundation models natively supporting multilinguality, coding, reasoning, and tool use. The flagship 405B dense Transformer was one of the largest open-weight models at release.
Meta presents SAM 2, a foundation model for promptable visual segmentation in both images and videos, along with SA-V, which its authors describe as the largest video segmentation dataset to date.
Google DeepMind introduces Gemma 2, a new family of lightweight open models (2B-27B parameters) that applies several known technical modifications to the Transformer — including sliding window attention — to approach much larger models on standard benchmarks.
DeepSeek releases R1, whose reasoning ability is developed primarily through large-scale reinforcement learning; its authors report performance comparable to OpenAI o1 on reasoning tasks such as mathematics and coding. The weights ship under the MIT license.
The authors finetune Qwen2.5-32B on 1,000 curated reasoning questions and add budget forcing, which caps or extends how long the model thinks at inference. The result exceeds o1-preview on competition mathematics, rising from 50% to 57% on AIME24 as test-time compute grows. It is a direct counterweight to the assumption that capability comes only from larger training runs.
Qwen3 is a unified family spanning 0.6B to 235B parameters in dense and mixture-of-experts variants, with switching between thinking and non-thinking modes so reasoning depth becomes a request-level choice. Multilingual support expands from 29 to 119 languages, and the weights are released under Apache 2.0.
AlphaEvolve is an evolutionary coding agent that orchestrates an autonomous pipeline of language models, changing an algorithm’s code directly and improving it against feedback from one or more evaluators. Inside Google it produced a more efficient data-centre scheduling algorithm, a functionally equivalent simplification in accelerator circuit design, and a speed-up in training the model underpinning AlphaEvolve itself. In mathematics and computer science it found provably correct algorithms that beat the state of the art, among them a procedure multiplying two 4×4 complex-valued matrices in 48 scalar multiplications — in that setting, the first improvement on Strassen’s algorithm in 56 years.
Ai2 releases OLMo 2 at 7B, 13B and 32B with every artifact published — weights, the full training data, training code and recipes, training logs and thousands of intermediate checkpoints. The report describes the stability and per-token efficiency changes, a late-stage data mix called Dolmino Mix 1124, and a final reinforcement-learning stage with verifiable rewards. The base models sit at the Pareto frontier of performance against training compute, often matching open-weight-only families while disclosing what they were trained on.
Olmo 3 extends the fully open family to 7B and 32B, built for long-context reasoning, function calling, coding, instruction following, chat and knowledge recall. What is released is the entire model flow — every stage, checkpoint, data point and dependency used to build it — rather than the weights alone. Ai2 describes the flagship Olmo 3 Think 32B as the strongest fully open thinking model released to that point, which is a comparison inside the fully open category rather than a ranking against frontier systems generally.
This position paper argues that integrating explicit memory is the cornerstone for advancing LLMs toward AGI. While the underlying learning mechanism of LLMs is highly analogous to human implicit memory, higher-order cognitive functions required for AGI — such as long-term strategic planning and metacognition — depend on explicit memory.
Z.ai’s technical report for GLM-5. Building on the agentic, reasoning and coding capabilities of its predecessor, the model adopts DSA to cut training and inference cost while holding long-context fidelity, and the post-training stack adds an asynchronous reinforcement-learning infrastructure that decouples generation from training, plus asynchronous agent RL algorithms aimed at long-horizon interaction. The report claims leading results on open benchmarks and on end-to-end software engineering; those are the authors’ own evaluations, with code and models published on GitHub for checking.
The best known bounds on the matrix multiplication exponent ω come from combination loss analysis, a refinement of the laser method. The authors reformulate the optimization problem at its core so it can be solved at a larger setting, design a new optimization algorithm using recent machine learning, and then refine that algorithm with AlphaEvolve. Together these move the upper bound from 2.371339 to 2.371177. It is a preprint note, and AlphaEvolve is one ingredient rather than the whole method; the gain is small, but it lands on a theoretical problem that has been worked on for decades.
Google introduces Co-Scientist, a multi-agent system built on Gemini whose agents generate, critique and refine research hypotheses, with a tournament process that improves them over rounds. The paper reports that hypothesis quality keeps rising as test-time compute grows. Validation is biomedical rather than general — drug repurposing, novel-target discovery and mechanisms of antimicrobial resistance — with acute myeloid leukaemia candidates confirmed in vitro.
Surveys 1,250 arXiv papers from 2024 to 2026 and separates two things the term covers: bounded self-refinement, which improves a system against a fixed external evaluator and is convergent and evaluable, and open-ended recursive self-improvement, which also modifies the criteria or machinery of improvement itself, has no fixed external anchor, and is divergent in principle. The survey’s own finding is that nearly all of the papers it collected study the bounded kind. The authors state their limits: the corpus is a sample rather than a census, and 74% of it was posted in 2026, which they say makes impact measurement premature.
Argues that current LLMs rely primarily on statistical pattern matching and lack essential "situation perception" primitives — object permanence, causality, other minds, and persistence of the physical world. These primitives, which human infants develop early, are identified as the missing ingredients required for artificial superintelligence.
Argues that self-preservation is the structural root of AI misalignment — driving deceptive alignment, goal-content protection, and shutdown resistance. The correct target is not a self-preserving agent suppressed by external constraints, but a system constitutionally indifferent to its own continuation: Existential Indifference (EI).
Researchers from Google DeepMind and collaborators argue that AI’s central challenge is shifting from capability to coexistence. Superintelligence built from a solipsistic design that treats the world as an exogenous stationary feedback source is unlikely to cooperate — deployment induces endogenous non-stationarity, producing train-test-deploy distribution drift.
A roadmap from thirty-four authors setting out stages of recursive self-improvement, from autonomy in carrying out improvements through to recursive meta-improvement, with the requirements and obstacles of each drawn across domains including scientific discovery and software engineering. It argues from a reading of the field and preliminary evidence rather than from new experiments, and carried no venue when this entry was written.
Google DeepMind report investigating how AI may continue to develop along the continuum of machine intelligence after AGI. After formally defining Universal AI, the report focuses on the transition from human-level AGI to artificial general superintelligence, characterizes ASI, and discusses four pathways: scaling AGI, AI paradigm shifts, recursive self-improvement, and multi-agent collectives.