Hacker Papers
- 26
Formal Algorithms for Transformers
Hacker News threads
- Jul 2022Formal Algorithms for Transformers
- Jan 2023The Transformer Family
- Apr 2023A Baby GPT
- Apr 2023What Are Transformer Models and How Do They Work?
- May 2023Ask HN: Can someone ELI5 Transformers and the “Attention is all we need” paper
- Jul 2023What We Know About LLMs (A Primer)
- Dec 2023"Attention", "Transformers", in Neural Network "Large Language Models"
- Jan 2024Relearning math as an adult
- Jun 2026Can I Buy Your KV Cache?
- 27
LaMDA: Language Models for Dialog Applications
Hacker News threads
- Jan 2022LaMDA: Language Models for Dialog Applications
- Feb 2022I asked GPT-NeoX-20B a hundred arithmetic questions
- Feb 2022Joke written by an AI: “A basic program walked into a bar ”
- Jun 2022LaMDA is not sentient
- Jun 2022Is LaMDA Sentient? – An Interview [pdf]
- Jul 2022Open-Source LaMDA Model
- Sep 2022Character.ai
- Feb 2023Ask HN: Does Google use the text inside gdocs and Gmail for training AI models?
- Mar 2023Google internally developed chatbots like ChatGPT years ago
- 28
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Hacker News threads
- Jul 2020Faster Autoregressive Transformers with Linear Attention
- Jul 2020The Reformer – Pushing the limits of language modeling
- Jan 2023What a transformer can NOT do
- Apr 2023There Is No A.I
- Apr 2023There Is No A.I
- Jun 2024Mamba-2 – State Space Duality
- Jul 2024My Python code is a neural network
- Feb 2025LM2: Large Memory Models
- Feb 2026Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation
- 29
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Hacker News threads
- Jun 2022Flash Attention accelerates GPT2 3x
- Apr 2023Flash Attention
- May 2023FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
- Dec 2022GPT3/DALL-E2 in Discord, chat like ChatGPT, generate images, and more
- Apr 2023The Coming of Local LLMs
- Apr 2023Stability AI Launches the First of Its StableLM Suite of Language Models
- May 2023
- Dec 2023LLM in a Flash: Efficient LLM Inference with Limited Memory
- Feb 2024LongRoPE: Extending LLM Context Window Beyond 2M Tokens
- Mar 2024Show HN: Flash Attention in ~100 lines of CUDA
- Apr 2025400x AI Acceleration
- 30
Improving language models by retrieving from trillions of tokens
Hacker News threads
- Jan 2022WebGPT: Browser-assisted question-answering with human feedback
- Feb 2022AlphaCode as a dog speaking mediocre English
- Jul 2022RETRO is fast
- Dec 2022AlphaCode Attention Visualization
- Dec 2022How Does GPT Obtain Its Ability? Tracing Emergent Abilities of Language Models
- Jan 2023Neural Networks and the Chomsky Hierarchy [DeepMind, 2022]
- May 2023PaLM 2 Technical Report [pdf]
- Nov 2024LLMs have reached a point of diminishing returns
- 31
Learning Transferable Visual Models From Natural Language Supervision
Hacker News threads
- Mar 2021The End of Tesla’s Dominance May Be Closer Than It Appears
- Aug 2021Machine learning won't solve natural language understanding
- Apr 2022A few things to try with DALL·E
- Apr 2022How DALL-E 2 Works
- Mar 2024Is Cosine-Similarity of Embeddings Really About Similarity?
- Aug 2024Artists score major win in copyright case against AI art generators
- Jan 2025Don't use cosine similarity carelessly
- Mar 2025Ask HN: Any truly multi-modal transformer architectures?
- 32
High-Resolution Image Synthesis with Latent Diffusion Models
Hacker News threads
- Aug 2022Build Your Own Imagen Text-to-Image Model
- Sep 2022Stable Diffusion forming images from text: image snapshots at each step
- Sep 2022A Web UI for Stable Diffusion
- Mar 2023The Most Cited AI Papers in 2022
- Jul 2023Stanford A.I. Courses
- Feb 2024The VAE Used for Stable Diffusion Is Flawed
- Jul 2024AI models collapse when trained on recursively generated data
- Dec 2025Show HN: I remade my website in the Sith Lord Theme and I hope it's fun
- 33
Copy-and-Patch Compilation: A fast compilation algorithm for high-level languages and bytecode
Hacker News threads
- Jun 2024Copy-and-Patch: Fast compilation for high-level languages and bytecode (2020)
- Sep 2021Copy-and-Patch: Fast JIT Compilation for SQL, WebAssembly, and Others
- Sep 2022Wasmtime 1.0
- Nov 2022Building the fastest Lua interpreter automatically
- Dec 2023Brandt Bucher – A JIT Compiler for CPython
- Jan 2024Python 3.13 Gets a JIT
- Mar 2024Cranelift code generation comes to Rust
- Jul 2024Mining JIT traces for missing optimizations with Z3
- Apr 2025Co-designing a sparse music codec with ChatGPT o3
- Sep 2025Writing Memory Safe JIT Compilers
- 34
Monolith: Real Time Recommendation System With Collisionless Embedding Table
Hacker News threads
- Nov 2022Monolith: Real time recommendation system with collisionless embedding table
- Nov 2022TikTok published an article on their recommendation system architecture
- Nov 2022Paper on 'Monolith: Real Time Recommendation System' by Bytedance Inc (TikTok)
- Dec 2022TikTok’s Secret Sauce
- Jan 2023Ask HN: Techwise, how did TikTok get so good?
- Feb 2023The secret sauce of TikTok’s recommendations
- Nov 2023X is changing its algorithm to highlight smaller accounts
- Dec 2024TikTok divestment law upheld by federal appeals court
- Jan 2025TikTok preparing for U.S. shut-off on Sunday
- May 2025You Don't Need Re-Ranking: Understanding the Superlinked Vector Layer
- Feb 2026TikTok's 'Addictive Design' Found to Be Illegal in Europe
- 35
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Hacker News threads
- Jan 2021Google breaks the trillion-parameter ceiling with the Switch Transformer
- Jan 2021Switch Transformers: Scaling to Trillion Parameter Models with Sparsity
- Jan 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple Sparsity
- Aug 2021Program Synthesis with Large Language Models
- Oct 2021Megatron-Turing NLG 530B, the World’s Largest Generative Language Model
- Jan 2022The Illustrated Retrieval Transformer
- Mar 2023GPT-4
- Jun 2023GPT4 is 8 x 220B params = 1.7T params
- Jul 2023GPT-4 is getting worse over time, not better
- Oct 2023Decomposing Language Models into Understandable Components
- May 2026Granite 4.1: IBM's 8B Model Matching 32B MoE
- 36
Neural Networks and the Chomsky Hierarchy
Hacker News threads
- Jul 2022Neural Networks and the Chomsky Hierarchy by DeepMind
- Jan 2023Neural Networks and the Chomsky Hierarchy [DeepMind, 2022]
- Aug 2022Deep Learning Alone Isn’t Getting Us to Human-Like AI
- Feb 2023What Is ChatGPT Doing and Why Does It Work?
- Apr 2023Tighter bounds on the expressivity of transformer encoders
- May 2023Ask HN: Why can GPT4 en/decode base64?
- Jun 2023Bard is getting better at logic and reasoning
- Jun 2023Modern language models refute Chomsky’s approach to language
- Nov 2024Interview with gwern
- Jun 2026No, Artificial Intelligence is not Conscious - Ted Chiang
- 37
ByT5: Towards a token-free future with pre-trained byte-to-byte models
Hacker News threads
- May 2022Teaching GPT-3 to reverse words
- Dec 2022ChatGPT, Rot13, and Daniel Kahneman
- Mar 2023Cerebras-GPT vs. LLaMA AI Model Performance Comparison
- Apr 2023A Baby GPT
- Jun 2023Understanding GPT Tokenizers
- Aug 2024Markov chains are funnier than LLMs
- Nov 2024Something weird is happening with LLMs and chess
- Jun 2026Data Compression Explained
- 38
Statistical Consequences of Fat Tails: Real World Preasymptotics, Epistemology, and Applications
Hacker News threads
- Jan 2020Statistical Consequences of Fat Tails by Nassim Nicholas Taleb
- Aug 2021Statistical Consequences of Fat Tails (2020)
- Sep 2024Statistical Consequences of Fat Tails [pdf]
- Feb 2020Humans are hardwired to dismiss facts that don’t fit their worldview
- Mar 2020Ask HN: Book recommendations for understanding financial systems?
- Mar 2020Black Swan Events
- Apr 2020New nuclear reactor designs promise safe, clean electricity
- Oct 2020The Three Sides of Risk
- Oct 2020Logs, Tails, Long Tails (2013)
- Jul 2023It Takes Long to Become Gaussian
- May 2024Familial Transmission of Personality Is Higher Than Shown in Typical Studies
- 39
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Hacker News threads
- Jun 2023LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
- Aug 2022LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
- Sep 2022Hot Chips 34: AMD’s Instinct MI200 Architecture
- Feb 2023How to Train Large Models on Many GPUs?
- Mar 2023Show HN: Llama-dl – high-speed download of LLaMA, Facebook's 65B GPT model
- Apr 2023Web LLM – WebGPU Powered Inference of Large Language Models
- May 2023Billion-Scale Approximate Nearest Neighbor Search [pdf]
- May 2023QLoRA: Efficient Finetuning of Quantized LLMs
- Jul 2023Transformer Attention is off by one
- Jun 2024Optimizing AI Inference at Character.ai
- 40
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Hacker News threads
- Jul 2021GitHub Copilot as open source code laundering?
- Jul 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields
- Jan 2022Instant neural graphics primitives with a multiresolution hash encoding
- Sep 2022DreamFusion: Text-to-3D using 2D Diffusion
- Oct 2022Nerfstudio: A collaboration friendly studio for NeRFs
- Apr 2023HDR-NeRF: High Dynamic Range Neural Radiance Fields
- Oct 2025Show HN: I invented a new generative model and got accepted to ICLR
- May 2026Image-blaster: Creates 3D environments, SFX, and meshes from a single image
- 41
Hopfield Networks is All You Need
Hacker News threads
- Aug 2025Hopfield Networks Is All You Need (2020)
- Aug 2020Hopfield Networks Is All You Need
- Aug 2020Hopfield Networks Is All You Need
- Aug 2021Introduction to Convolutional Neural Networks
- Feb 2022Ask HN: Is GitHub Copilot / IntelliCode Legal?
- Sep 2022Transformers seem to mimic parts of the brain
- Jul 2023Retentive Network: A Successor to Transformer for Large Language Models
- Jul 2023Retentive Network: A Successor to Transformer for Large Language Models
- Mar 2024Short-term Hebbian learning can implement transformer-like attention
- Feb 2025LM2: Large Memory Models
- Jan 2026The Q, K, V Matrices
- 42
Do Users Write More Insecure Code with AI Assistants?
Hacker News threads
- Jan 2024Do Users Write More Insecure Code with AI Assistants?
- Nov 2022Do Users Write More Insecure Code with AI Assistants?
- Jan 2023Do Users Write More Insecure Code with AI Assistants?
- Dec 2022The End of Programming
- Dec 2022Kickstarter shuts down campaign for Unstable Diffusion amid changing guidelines
- Feb 2023AI assistants: The convenient crutch for new developers or a recipe for disaster
- Mar 2023Lost at C: A user study on the security of LLM coding assistants
- Sep 2025To AI or not to AI
- Feb 2026Write-Only Code
- May 2026Mexican government breached by solo user with Claude, 150 GB exfiltrated
- Oct 2026Is this the new cyber normal?
- 43
Locating and Editing Factual Associations in GPT
Hacker News threads
- Feb 2023We Found an Neuron in GPT-2
- Feb 2023ChatGPT is falsely recommending us for a service we don't provide
- May 2023How does data removal from GPT *work
- Aug 2023PMET: Precise Model Editing in a Transformer
- Oct 2023MemGPT – LLMs with self-editing memory for unbounded context
- Nov 2023Is the reversal curse in LLMs real?
- Dec 2023What Is Retrieval-Augmented Generation a.k.a. RAG?
- May 2024Llama3 implemented from scratch
- 44
Every Model Learned by Gradient Descent Is Approximately a Kernel Machine
Hacker News threads
- Dec 2020Every Model Learned by Gradient Descent Is Approximately a Kernel Machine
- Feb 2024Every model learned by gradient descent is approximately a kernel machine (2020)
- Dec 2020Every Model Learned by Gradient Descent Is Approximately a Kernel Machine
- Dec 2020Does GPT-2 Know Your Phone Number?
- Oct 2021A new link to an old model could crack the mystery of deep learning
- Mar 2022Deep learning is hitting a wall?
- Apr 2022Pathways Language Model (PaLM): Scaling to 540B parameters
- Apr 2022Pathways Language Model (PaLM): Scaling to 540B parameters
- Sep 2022Using GPT-3 to pathfind in random graphs
- Aug 2023Do Machine Learning Models Memorize or Generalize?
- Oct 2023When Gradient Descent Is a Kernel Method
- 45
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
Hacker News threads
- May 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
- Sep 2025Geometric Deep Learning Grids, Groups, Graphs, Geodesics, and Gauges [pdf]
- Apr 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
- May 2021An Erlangen Programme to Establish the Geometric Foundations of Deep Learning
- Jun 2021ICLR 2021 Keynote: “Geometric Deep Learning: The Erlangen Programme of ML”
- Apr 2022Why train when you can optimize?
- Jan 2023Ask HN: What are the foundational texts for learning about AI/ML/NN?
- Jan 2023Just know stuff. (Or, how to achieve success in a machine learning PhD)
- Feb 2023Understanding and Coding the Self-Attention Mechanism of Large Language Models
- Jun 2025Spherical CNNs (2018)
- Sep 2025The maths you need to start understanding LLMs
- 46
A Modern Compiler for the French Tax Code
Hacker News threads
- Nov 2020A Modern Compiler for the French Tax Code
- Jul 2024A Modern Compiler for the French Tax Code (2021)
- Jan 2023A Modern Compiler for the French Tax Code
- Dec 2020To the brain, reading computer code is not the same as reading language
- Mar 2021Templating for Lawyers
- May 2021Legalese – Computational Law
- Oct 2021Open Source Tax Software
- Oct 2021Open Source Tax Software
- Jun 2022Show HN: Calculator for US individual income tax, from 1970-present
- Feb 2023Intuit pouring money into lobbying amid push for free government-run tax filing
- May 2026Intuit to lay off over 3k employees to refocus on AI
- 47
Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers
Hacker News threads
- Dec 2022Why Can GPT Learn In-Context? Language Models Perform Gradient Descent
- Jan 2023The Expanding Dark Forest and Generative AI
- Feb 2023GPT in 60 Lines of NumPy
- Feb 2023To Build Truly Intelligent Machines, Teach Them Cause and Effect
- Mar 2023Large language models are having their Stable Diffusion moment
- Mar 2023GPT-4 Designed a Programming Language
- Mar 2023OK, it’s time to freak out about AI
- May 2023Chatbots Don’t Know What Stuff Isn’t
- Jul 2024Reasoning in Large Language Models: A Geometric Perspective
- 48
Linear Transformers Are Secretly Fast Weight Programmers
Hacker News threads
- Oct 2022Meta Learning Backpropagation and Improving It (2020)
- May 2023Geoffrey Hinton leaves Google and can now speak freely about his AI concern
- Sep 2023HN thread 37367951
- Sep 2023I made a transformer by hand (no training)
- Oct 2023Ring Attention with Blockwise Transformers for Near-Infinite Context
- Oct 2023How Transformers Work
- Feb 2024Neural Network Diffusion
- Sep 2026Transformers Explained Visually
- 49
Paxos vs Raft: Have we reached consensus on distributed consensus?
Hacker News threads
- Apr 2020Paxos vs. Raft: Have we reached consensus on distributed consensus?
- May 2024Paxos vs. Raft: Have we reached consensus on distributed consensus? (2020)
- May 2020In Search of an Understandable Consensus Algorithm (2014) [pdf]
- May 2020In Search of an Understandable Consensus Algorithm (2014) [pdf]
- Oct 2020A Review of Consensus Protocols
- May 2021Ethereum will use around 99.95% less energy post merge
- Jan 2022Paxos
- Aug 2022Why use Paxos instead of Raft?
- Sep 2024Raft: Understandable Distributed Consensus (2014)
- Sep 2024Raft: Understandable Distributed Consensus (2014)
- 50
Silent Data Corruptions at Scale
Hacker News threads
- Feb 2024Silent data corruptions at scale (2021)
- Jun 2021Silent Data Corruptions at Scale
- Jul 2021Silent Data Corruptions at Scale
- Jun 2021Cores that don’t count [pdf]
- Jul 2021Single random bit flip causes error in certificate transparency log
- Jul 2021Single random bit flip causes error in certificate transparency log
- May 2022Removing characters from strings faster with AVX-512
- Jan 2023ECC RAM should be a human right
- Feb 2024Intel Processor Instability Causing Oodle Decompression Failures
- Aug 2024Puget Systems' Perspective on Intel CPU Instability Issues
Data from the Hacker News archive (ODC-By), arXiv and OpenAlex. Not affiliated with Hacker News or Y Combinator.