Hacker Papers
- 26
LaMDA: Language Models for Dialog Applications
Hacker News threads
- Jan 2022LaMDA: Language Models for Dialog Applications
- Feb 2022I asked GPT-NeoX-20B a hundred arithmetic questions
- Feb 2022Joke written by an AI: “A basic program walked into a bar ”
- Jun 2022LaMDA is not sentient
- Jun 2022Is LaMDA Sentient? – An Interview [pdf]
- Jul 2022Open-Source LaMDA Model
- Sep 2022Character.ai
- Feb 2023Ask HN: Does Google use the text inside gdocs and Gmail for training AI models?
- Mar 2023Google internally developed chatbots like ChatGPT years ago
- 27
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Hacker News threads
- Jul 2020Faster Autoregressive Transformers with Linear Attention
- Jul 2020The Reformer – Pushing the limits of language modeling
- Jan 2023What a transformer can NOT do
- Apr 2023There Is No A.I
- Apr 2023There Is No A.I
- Jun 2024Mamba-2 – State Space Duality
- Jul 2024My Python code is a neural network
- Feb 2025LM2: Large Memory Models
- Feb 2026Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation
- 28
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Hacker News threads
- Jun 2022Flash Attention accelerates GPT2 3x
- Apr 2023Flash Attention
- May 2023FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
- Dec 2022GPT3/DALL-E2 in Discord, chat like ChatGPT, generate images, and more
- Apr 2023The Coming of Local LLMs
- Apr 2023Stability AI Launches the First of Its StableLM Suite of Language Models
- May 2023
- Dec 2023LLM in a Flash: Efficient LLM Inference with Limited Memory
- Feb 2024LongRoPE: Extending LLM Context Window Beyond 2M Tokens
- Mar 2024Show HN: Flash Attention in ~100 lines of CUDA
- Apr 2025400x AI Acceleration
- 29
Improving language models by retrieving from trillions of tokens
Hacker News threads
- Jan 2022WebGPT: Browser-assisted question-answering with human feedback
- Feb 2022AlphaCode as a dog speaking mediocre English
- Jul 2022RETRO is fast
- Dec 2022AlphaCode Attention Visualization
- Dec 2022How Does GPT Obtain Its Ability? Tracing Emergent Abilities of Language Models
- Jan 2023Neural Networks and the Chomsky Hierarchy [DeepMind, 2022]
- May 2023PaLM 2 Technical Report [pdf]
- Nov 2024LLMs have reached a point of diminishing returns
- 30
Learning Transferable Visual Models From Natural Language Supervision
Hacker News threads
- Mar 2021The End of Tesla’s Dominance May Be Closer Than It Appears
- Aug 2021Machine learning won't solve natural language understanding
- Apr 2022A few things to try with DALL·E
- Apr 2022How DALL-E 2 Works
- Mar 2024Is Cosine-Similarity of Embeddings Really About Similarity?
- Aug 2024Artists score major win in copyright case against AI art generators
- Jan 2025Don't use cosine similarity carelessly
- Mar 2025Ask HN: Any truly multi-modal transformer architectures?
- 31
High-Resolution Image Synthesis with Latent Diffusion Models
Hacker News threads
- Aug 2022Build Your Own Imagen Text-to-Image Model
- Sep 2022Stable Diffusion forming images from text: image snapshots at each step
- Sep 2022A Web UI for Stable Diffusion
- Mar 2023The Most Cited AI Papers in 2022
- Jul 2023Stanford A.I. Courses
- Feb 2024The VAE Used for Stable Diffusion Is Flawed
- Jul 2024AI models collapse when trained on recursively generated data
- Dec 2025Show HN: I remade my website in the Sith Lord Theme and I hope it's fun
- 32
Monolith: Real Time Recommendation System With Collisionless Embedding Table
Hacker News threads
- Nov 2022Monolith: Real time recommendation system with collisionless embedding table
- Nov 2022TikTok published an article on their recommendation system architecture
- Nov 2022Paper on 'Monolith: Real Time Recommendation System' by Bytedance Inc (TikTok)
- Dec 2022TikTok’s Secret Sauce
- Jan 2023Ask HN: Techwise, how did TikTok get so good?
- Feb 2023The secret sauce of TikTok’s recommendations
- Nov 2023X is changing its algorithm to highlight smaller accounts
- Dec 2024TikTok divestment law upheld by federal appeals court
- Jan 2025TikTok preparing for U.S. shut-off on Sunday
- May 2025You Don't Need Re-Ranking: Understanding the Superlinked Vector Layer
- Feb 2026TikTok's 'Addictive Design' Found to Be Illegal in Europe
- 33
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Hacker News threads
- Jan 2021Google breaks the trillion-parameter ceiling with the Switch Transformer
- Jan 2021Switch Transformers: Scaling to Trillion Parameter Models with Sparsity
- Jan 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple Sparsity
- Aug 2021Program Synthesis with Large Language Models
- Oct 2021Megatron-Turing NLG 530B, the World’s Largest Generative Language Model
- Jan 2022The Illustrated Retrieval Transformer
- Mar 2023GPT-4
- Jun 2023GPT4 is 8 x 220B params = 1.7T params
- Jul 2023GPT-4 is getting worse over time, not better
- Oct 2023Decomposing Language Models into Understandable Components
- May 2026Granite 4.1: IBM's 8B Model Matching 32B MoE
- 34
Neural Networks and the Chomsky Hierarchy
Hacker News threads
- Jul 2022Neural Networks and the Chomsky Hierarchy by DeepMind
- Jan 2023Neural Networks and the Chomsky Hierarchy [DeepMind, 2022]
- Aug 2022Deep Learning Alone Isn’t Getting Us to Human-Like AI
- Feb 2023What Is ChatGPT Doing and Why Does It Work?
- Apr 2023Tighter bounds on the expressivity of transformer encoders
- May 2023Ask HN: Why can GPT4 en/decode base64?
- Jun 2023Bard is getting better at logic and reasoning
- Jun 2023Modern language models refute Chomsky’s approach to language
- Nov 2024Interview with gwern
- Jun 2026No, Artificial Intelligence is not Conscious - Ted Chiang
- 35
ByT5: Towards a token-free future with pre-trained byte-to-byte models
Hacker News threads
- May 2022Teaching GPT-3 to reverse words
- Dec 2022ChatGPT, Rot13, and Daniel Kahneman
- Mar 2023Cerebras-GPT vs. LLaMA AI Model Performance Comparison
- Apr 2023A Baby GPT
- Jun 2023Understanding GPT Tokenizers
- Aug 2024Markov chains are funnier than LLMs
- Nov 2024Something weird is happening with LLMs and chess
- Jun 2026Data Compression Explained
- 36
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Hacker News threads
- Jun 2023LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
- Aug 2022LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
- Sep 2022Hot Chips 34: AMD’s Instinct MI200 Architecture
- Feb 2023How to Train Large Models on Many GPUs?
- Mar 2023Show HN: Llama-dl – high-speed download of LLaMA, Facebook's 65B GPT model
- Apr 2023Web LLM – WebGPU Powered Inference of Large Language Models
- May 2023Billion-Scale Approximate Nearest Neighbor Search [pdf]
- May 2023QLoRA: Efficient Finetuning of Quantized LLMs
- Jul 2023Transformer Attention is off by one
- Jun 2024Optimizing AI Inference at Character.ai
- 37
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Hacker News threads
- Jul 2021GitHub Copilot as open source code laundering?
- Jul 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields
- Jan 2022Instant neural graphics primitives with a multiresolution hash encoding
- Sep 2022DreamFusion: Text-to-3D using 2D Diffusion
- Oct 2022Nerfstudio: A collaboration friendly studio for NeRFs
- Apr 2023HDR-NeRF: High Dynamic Range Neural Radiance Fields
- Oct 2025Show HN: I invented a new generative model and got accepted to ICLR
- May 2026Image-blaster: Creates 3D environments, SFX, and meshes from a single image
- 38
Hopfield Networks is All You Need
Hacker News threads
- Aug 2025Hopfield Networks Is All You Need (2020)
- Aug 2020Hopfield Networks Is All You Need
- Aug 2020Hopfield Networks Is All You Need
- Aug 2021Introduction to Convolutional Neural Networks
- Feb 2022Ask HN: Is GitHub Copilot / IntelliCode Legal?
- Sep 2022Transformers seem to mimic parts of the brain
- Jul 2023Retentive Network: A Successor to Transformer for Large Language Models
- Jul 2023Retentive Network: A Successor to Transformer for Large Language Models
- Mar 2024Short-term Hebbian learning can implement transformer-like attention
- Feb 2025LM2: Large Memory Models
- Jan 2026The Q, K, V Matrices
- 39
Locating and Editing Factual Associations in GPT
Hacker News threads
- Feb 2023We Found an Neuron in GPT-2
- Feb 2023ChatGPT is falsely recommending us for a service we don't provide
- May 2023How does data removal from GPT *work
- Aug 2023PMET: Precise Model Editing in a Transformer
- Oct 2023MemGPT – LLMs with self-editing memory for unbounded context
- Nov 2023Is the reversal curse in LLMs real?
- Dec 2023What Is Retrieval-Augmented Generation a.k.a. RAG?
- May 2024Llama3 implemented from scratch
- 40
Every Model Learned by Gradient Descent Is Approximately a Kernel Machine
Hacker News threads
- Dec 2020Every Model Learned by Gradient Descent Is Approximately a Kernel Machine
- Feb 2024Every model learned by gradient descent is approximately a kernel machine (2020)
- Dec 2020Every Model Learned by Gradient Descent Is Approximately a Kernel Machine
- Dec 2020Does GPT-2 Know Your Phone Number?
- Oct 2021A new link to an old model could crack the mystery of deep learning
- Mar 2022Deep learning is hitting a wall?
- Apr 2022Pathways Language Model (PaLM): Scaling to 540B parameters
- Apr 2022Pathways Language Model (PaLM): Scaling to 540B parameters
- Sep 2022Using GPT-3 to pathfind in random graphs
- Aug 2023Do Machine Learning Models Memorize or Generalize?
- Oct 2023When Gradient Descent Is a Kernel Method
- 41
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
Hacker News threads
- May 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
- Sep 2025Geometric Deep Learning Grids, Groups, Graphs, Geodesics, and Gauges [pdf]
- Apr 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
- May 2021An Erlangen Programme to Establish the Geometric Foundations of Deep Learning
- Jun 2021ICLR 2021 Keynote: “Geometric Deep Learning: The Erlangen Programme of ML”
- Apr 2022Why train when you can optimize?
- Jan 2023Ask HN: What are the foundational texts for learning about AI/ML/NN?
- Jan 2023Just know stuff. (Or, how to achieve success in a machine learning PhD)
- Feb 2023Understanding and Coding the Self-Attention Mechanism of Large Language Models
- Jun 2025Spherical CNNs (2018)
- Sep 2025The maths you need to start understanding LLMs
- 42
Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers
Hacker News threads
- Dec 2022Why Can GPT Learn In-Context? Language Models Perform Gradient Descent
- Jan 2023The Expanding Dark Forest and Generative AI
- Feb 2023GPT in 60 Lines of NumPy
- Feb 2023To Build Truly Intelligent Machines, Teach Them Cause and Effect
- Mar 2023Large language models are having their Stable Diffusion moment
- Mar 2023GPT-4 Designed a Programming Language
- Mar 2023OK, it’s time to freak out about AI
- May 2023Chatbots Don’t Know What Stuff Isn’t
- Jul 2024Reasoning in Large Language Models: A Geometric Perspective
- 43
Linear Transformers Are Secretly Fast Weight Programmers
Hacker News threads
- Oct 2022Meta Learning Backpropagation and Improving It (2020)
- May 2023Geoffrey Hinton leaves Google and can now speak freely about his AI concern
- Sep 2023HN thread 37367951
- Sep 2023I made a transformer by hand (no training)
- Oct 2023Ring Attention with Blockwise Transformers for Near-Infinite Context
- Oct 2023How Transformers Work
- Feb 2024Neural Network Diffusion
- Sep 2026Transformers Explained Visually
- 44
On the Paradox of Learning to Reason from Data
Hacker News threads
- Aug 2022On the Paradox of Learning to Reason from Data
- Jun 2024The Paradox of Learning to Reason from Data (2022)
- Jul 2023On the Paradox of Learning to Reason from Data
- Dec 2022Artificial Intelligence Is Stupid and Causal Reasoning Will Not Fix It
- Feb 2023Getty Images v. Stability AI – Complaint
- Mar 2023Understanding ChatGPT
- Mar 2023HN thread 35320870
- Jul 2023PoisonGPT: We hid a lobotomized LLM on Hugging Face to spread fake news
- Sep 2023Provably safe systems: the only path to controllable AGI
- Oct 2024DeepSeek: Advancing theorem proving in LLMs through large-scale synthetic data
- 45
Extracting Training Data from Large Language Models
Hacker News threads
- Dec 2020Extracting Training Data from Large Language Models
- Dec 2020Extracting Training Data from Large Language Models
- Jun 2021Extracting Training Data from Large Language Models
- Dec 2020Does GPT-2 know your phone number?
- Feb 2021Google Open-Sources Trillion-Parameter AI Language Model Switch Transformer
- Jul 2021All public GitHub code was used in training Copilot
- Jun 2022Ask HN: GPT-3 reveals my full name – can I do anything?
- Apr 2023Record Labels Panic as A.I. Generated Song Becomes Hit Single
- Sep 2026“Next-token predictor” is the wrong mental model for LLMs
- 46
Quantifying Memorization Across Neural Language Models
Hacker News threads
- Mar 2023Quantifying memorization across language models
- Aug 2022Exploring 12M of the 2.3B images used to train Stable Diffusion
- Nov 2022Ask HN: What can I personally do to fight AGAINST the Copilot class action?
- Mar 2023PG: We can't all use AI. Someone has to generate the training data
- Aug 2024Judge dismisses majority of GitHub Copilot copyright claims
- Apr 2025Migrating away from Rust
- Jul 2026The Kimi K3 Moment
- 47
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Hacker News threads
- Aug 2022Imagen: An AI system that creates photorealistic images from input text
- Feb 2023Google Invests Almost $400M in ChatGPT Rival Anthropic
- Mar 2023Visual ChatGPT
- Apr 2023Stability AI releases DeepFloyd IF, a powerful text-to-image model
- May 2023Governance of Superintelligence
- Jul 2023Stability AI releases its latest image-generating model, Stable Diffusion XL 1.0
- 48
STaR: Bootstrapping Reasoning With Reasoning
Hacker News threads
- 49
Relating transformers to models and neural representations of the hippocampal formation
Hacker News threads
- Apr 2022Relating Transformers to Modes and Neural Representations of the Hippocampal
- May 2022Relating transformers to neural representations of hippocampal formation
- Apr 2022Relating Transformers to Neural Representations of the Hippocampal Formation
- Apr 2022Playing with DALL-E 2
- Dec 2022Ask HN: How to get back into AI?
- Jan 2024Understand how transformers work by demystifying the math behind them
- Jun 2024A most profound video game: a good cognitive aid for research
- Sep 2024Kolmogorov-Arnold networks may make neural networks more understandable
- Nov 2025The Case That A.I. Is Thinking
- 50
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Hacker News threads
- May 2023GPTQ Accurate Post-Training Quantization for Generative Pre-Trained Transformers
- Mar 2023LLaMA Text-Generation-Webui
- Mar 2023Large language models are having their Stable Diffusion moment
- Mar 2023Alpaca- An Instruct Tuned Llama 7B. Responses on par with txt-DaVinci-3. Demo up
- Mar 2023LLaMa running at 5 tokens/second on a Pixel 6
- Mar 2023Apple: Transformer architecture optimized for Apple Silicon
- Apr 2023Matrix Calculus: Calculate derivatives of matrices
- May 2023The tiny corp raised $5.1M
- Dec 2023Do large language models need all those layers?
Data from the Hacker News archive (ODC-By), arXiv and OpenAlex. Not affiliated with Hacker News or Y Combinator.