Hacker Papers
- 01
Language Models are Few-Shot Learners
Hacker News threads
- May 2020GPT-3: Language Models Are Few-Shot Learners
- Jun 2024Language Models Are Few-Shot Learners
- Nov 2024Language models are few-shot learners (2020)
- Jun 2020GPT-3 and Scaling Trends
- Jul 2020Show HN: Humans vs AI – A/B testing GPT-3
- Oct 2020AI training method exceeds GPT-3 performance with fewer parameters
- Oct 2022Why Mastering Language Is So Difficult for AI
- Feb 2023Why China Didn’t Invent ChatGPT
- May 2023Michael J. Fox Foundation Announces Breakthrough for Parkinson's Biomarker
- Nov 2023Sam Altman Exposes the Charade of AI Accountability
- Sep 2026GPT-6 Astra
- 02
Scaling Laws for Neural Language Models
Hacker News threads
- Feb 2020Scaling Laws for Neural Language Models
- Jun 2022Scaling Laws for Neural Language Models
- Sep 2026Scaling Laws for Neural Language Models (first "scaling laws" paper from 2020)
- Jan 2020Talking to myself: how I trained GPT2-1.5b for rubber ducking using my chat data
- Oct 2021Megatron-Turing NLG 530B, the World’s Largest Generative Language Model
- Feb 2023Ask HN: How “real” are AI scaling laws?
- Apr 2023OpenAI’s CEO confirms the company isn’t training GPT-5 and ‘won’t for some time’
- Dec 2023Do large language models need all those layers?
- Oct 2024Understanding the Limitations of Mathematical Reasoning in LLMs
- Feb 2026The Problem with LLMs
- Oct 2026Attention Is Not What You Need (2025)
- 03
Featherweight Go
Hacker News threads
- May 2020Featherweight Go
- May 2020Featherweight Go (A generics design for Go)
- Dec 2021Featherweight Go [pdf]
- Jun 2020Philip Wadler's talk on generics for Go (“Featherweight Go”)
- Jun 2020The Next Step for Generics
- Nov 2020Go Type Parameters – Draft Design
- Jan 2021A Proposal for Adding Generics to Go
- May 2021Oxide: The Essence of Rust (2020)
- Mar 2022How generics are implemented in Go 1.18
- Nov 2024Borgo Programming Language
- Aug 2026Golang proposal: container/: generic collection types
- 04
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Hacker News threads
- Jun 2023The Pile: An 800GB Dataset of Diverse Text for Language Modeling
- May 2021The Pile: An 800GB Dataset of Diverse Text for Language Modeling
- Jul 2023The Pile: a dataset for language modeling [pdf]
- Mar 2021The makers of Eleuther hope it will be an open source alternative to GPT-3
- Apr 2022Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API
- Jan 2023The Limits of GPT-3 and Similar Large Language Models
- Apr 2023RedPajama: Reproduction of Llama with Friendly License (Stanford, MILA Quebec)
- Jul 2023Sarah Silverman is suing OpenAI and Meta for copyright infringement
- Sep 2023What OpenAI Really Wants
- Mar 2024DBRX: A new open LLM
- Apr 2026Even 'uncensored' models can't say what they want
- 05
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Hacker News threads
- Apr 2022An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Jul 2021Deep reinforcement learning is a waste of time (2019)
- Mar 2022Transformers, originally designed to handle language, are taking on vision
- Mar 2023The Most Cited AI Papers in 2022
- Jun 2023What Is a Transformer Model?
- Feb 2024The killer app of Gemini Pro 1.5 is using video as an input
- Oct 2024Show HN: Doctly AI – Accurate AI-Powered PDF to Markdown Parser
- Jul 2025Baba Is Eval
- Sep 2026Ask HN: (Why) Was the LLM breakthrough useful for images, audio, etc.?
- 06
Learning in High Dimension Always Amounts to Extrapolation
Hacker News threads
- Oct 2023Learning in High Dimension Always Amounts to Extrapolation
- Nov 2023Learning in High Dimension Always Amounts to Extrapolation
- Dec 2021Training computer vision models on random noise instead of real images
- May 2022The Scaling Hypothesis (2021)
- Oct 2023The copyright fight over authors and OpenAI's ChatGPT
- Nov 2023Transformers struggle with generalizing tasks beyond pre-training data
- Mar 2024Large language models can do jaw-dropping things. But nobody knows why
- Oct 2024GitHub cuts AI deals with Google, Anthropic
- Feb 2026GPT-5.2 derives a new result in theoretical physics
- Oct 2026“Math 2.0” will need to value mathematical progress more holistically
- 07
DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning
Hacker News threads
- Dec 2023DreamCoder: Growing Generalizable, Interpretable Knowledge
- Jun 2020DreamCoder: Growing generalizable, interpretable knowledge with program learning
- Feb 2021DreamCoder, a system that learns to solve problems by writing programs
- Dec 2020Ask HN: What's the best paper you've read in 2020?
- May 2021Kobra – visual programming language for machine learning
- Nov 2021GPT-3 is no longer the only game in town
- Feb 2022Competitive Programming with AlphaCode
- Feb 2022Competitive Programming with AlphaCode
- Jul 2022AI Coding with CodeRL: Toward Mastering Program Synthesis with Deep RL
- Sep 2023Doug Lenat has died
- May 2026Language Models Need Sleep
- 08
Thinking Like Transformers
Hacker News threads
- Jun 2021Thinking Like Transformers
- Jun 2023Thinking Like Transformers (pdf)
- Dec 2021The potential of transformers in reinforcement learning
- May 2023It's not just statistics: GPT-4 does reason
- Jun 2023From Word Models to World Models
- Aug 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Models
- Sep 2023I made a transformer by hand (no training)
- Apr 2024Mixture-of-Depths: Dynamically allocating compute in transformers
- Nov 2025Ask HN: How are Markov chains so different from tiny LLMs?
- Feb 2026I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
- 09
Hopfield Networks is All You Need
Hacker News threads
- Aug 2025Hopfield Networks Is All You Need (2020)
- Aug 2020Hopfield Networks Is All You Need
- Aug 2020Hopfield Networks Is All You Need
- Aug 2021Introduction to Convolutional Neural Networks
- Feb 2022Ask HN: Is GitHub Copilot / IntelliCode Legal?
- Sep 2022Transformers seem to mimic parts of the brain
- Jul 2023Retentive Network: A Successor to Transformer for Large Language Models
- Jul 2023Retentive Network: A Successor to Transformer for Large Language Models
- Mar 2024Short-term Hebbian learning can implement transformer-like attention
- Feb 2025LM2: Large Memory Models
- Jan 2026The Q, K, V Matrices
- 10
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Hacker News threads
- Apr 2022Chain of Thought Prompting Elicits Reasoning in Large Language Models
- Dec 2022Chain of Thought Prompting Elicits Reasoning in Large Language Models
- Apr 2022Pathways Language Model (PaLM): Scaling to 540B parameters
- Jul 2022Am I doing it wrong? (OpenAI test)
- Mar 2023Oceania Always at War with Eastasia: Generative AI and Knowledge Pollution
- Apr 2023Teaching ChatGPT to Speak My Son’s Invented Language
- Aug 2023GPT-4 Can't Reason
- Sep 2024Training Language Models to Self-Correct via Reinforcement Learning
- Oct 2025Ortega hypothesis
- Sep 2026GPT-6 Astra
- 11
Emergent Abilities of Large Language Models
Hacker News threads
- Feb 2023Emergent Abilities of Large Language Models
- May 2024Emergent Abilities of Large Language Models
- Apr 2023Emergent Abilities of Large Language Models
- Dec 2022Ask HN: How does ChatGPT work?
- Feb 2023It Looks Like You’re Trying to Take over the World
- May 2023LLMs are not greater than the sum of their parts: Stanford researchers
- Jul 2023Llama 2 – Meta AI
- Nov 2023Telling GPT-4 you're scared or under pressure improves performance
- Mar 2024“Emergent” abilities in LLMs actually develop gradually and predictably – study
- Feb 2025Understanding Reasoning LLMs
- Aug 2026Humanity has the debate about AI consciousness backwards
- 12
Evaluating Large Language Models Trained on Code
Hacker News threads
- Jul 2021Evaluating Large Language Models Trained on Code
- Jul 2021Evaluating Large Language Models Trained on Code
- Jul 2021Evaluating Large Language Models Trained on Code (paper about GH copilot model)
- Jul 2021All public GitHub code was used in training Copilot
- Sep 2021GitHub Copilot Generated Insecure Code in 40% of Circumstances During Experiment
- Dec 2021GPT-3 APIs are now in public beta
- Jul 2022ML code generation vs. coding by hand: what we think programming will look like
- May 2023Replit's new Code LLM: Open Source, 77% smaller than Codex, trained in 1 week
- Oct 2023Show HN: Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context
- Feb 2025AI is stifling new tech adoption?
- Jul 2025Mercury: Ultra-fast language models based on diffusion
- 13
Training language models to follow instructions with human feedback
Hacker News threads
- Jan 2023Training language models to follow instructions with human feedback [pdf]
- Dec 2022Training language models to follow instructions with human feedback
- Apr 2023Training language models to follow instructions with human feedback
- Oct 2022GPT-3 can create both sides of an Interactive Fiction transcript
- Jan 2023Announcement: AI generated answers are officially banned here
- Feb 2023What Is ChatGPT Doing and Why Does It Work?
- Mar 2023Microsoft lays off an ethical AI team as it doubles down on OpenAI
- May 2023Lawyer cites fake cases invented by ChatGPT, judge is not amused
- Jun 2023How RLHF Works
- Jun 2024Safe Superintelligence Inc.
- Sep 2026I built non-autoregressive decision models with RL a year ago
- 14
Large Language Models are Zero-Shot Reasoners
Hacker News threads
- May 2022Large Language Models are Zero-Shot Reasoners: Let's think step by step
- May 2022Large Language Models Are Zero-Shot Reasoners
- Jun 2022LaMDA is not sentient
- Feb 2023Tech’s hottest new job: AI whisperer. No coding required
- Apr 2023Teaching ChatGPT to Speak My Son’s Invented Language
- Jul 2023What we learned from using GPT for 500k+ classifications
- Oct 2023Think Before You Speak: Training Language Models with Pause Tokens
- Jul 2024Large models of what? Mistaking engineering achievements for linguistic agency
- Mar 2025ChatGPT can't kill anything worth preserving
- Jan 2026LLMs are a 400-year-long confidence trick
- 15
The Hardware Lottery
Hacker News threads
- Sep 2020The Hardware Lottery
- Sep 2020The Hardware Lottery
- Sep 2020The Hardware Lottery
- Nov 2020Ride the Hardware Lottery
- Apr 2022Large-Scale Matrix Factorization on TPUs
- Jul 2023Ask HN: Which recently research paper blow your mind?
- Oct 2023Nvidia and Foxconn to build 'AI factories'
- Dec 2023A new old kind of R&D lab
- Apr 2025Multi-Token Attention
- May 2026A Eureka machine that thinks like nature and explores what AI cannot
- Jun 2026How LLMs Work
- 16
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Hacker News threads
- Jul 2020Faster Autoregressive Transformers with Linear Attention
- Jul 2020The Reformer – Pushing the limits of language modeling
- Jan 2023What a transformer can NOT do
- Apr 2023There Is No A.I
- Apr 2023There Is No A.I
- Jun 2024Mamba-2 – State Space Duality
- Jul 2024My Python code is a neural network
- Feb 2025LM2: Large Memory Models
- Feb 2026Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation
- 17
Monolith: Real Time Recommendation System With Collisionless Embedding Table
Hacker News threads
- Nov 2022Monolith: Real time recommendation system with collisionless embedding table
- Nov 2022TikTok published an article on their recommendation system architecture
- Nov 2022Paper on 'Monolith: Real Time Recommendation System' by Bytedance Inc (TikTok)
- Dec 2022TikTok’s Secret Sauce
- Jan 2023Ask HN: Techwise, how did TikTok get so good?
- Feb 2023The secret sauce of TikTok’s recommendations
- Nov 2023X is changing its algorithm to highlight smaller accounts
- Dec 2024TikTok divestment law upheld by federal appeals court
- Jan 2025TikTok preparing for U.S. shut-off on Sunday
- May 2025You Don't Need Re-Ranking: Understanding the Superlinked Vector Layer
- Feb 2026TikTok's 'Addictive Design' Found to Be Illegal in Europe
- 18
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Hacker News threads
- Jul 2021GitHub Copilot as open source code laundering?
- Jul 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields
- Jan 2022Instant neural graphics primitives with a multiresolution hash encoding
- Sep 2022DreamFusion: Text-to-3D using 2D Diffusion
- Oct 2022Nerfstudio: A collaboration friendly studio for NeRFs
- Apr 2023HDR-NeRF: High Dynamic Range Neural Radiance Fields
- Oct 2025Show HN: I invented a new generative model and got accepted to ICLR
- May 2026Image-blaster: Creates 3D environments, SFX, and meshes from a single image
- 19
A Modern Compiler for the French Tax Code
Hacker News threads
- Nov 2020A Modern Compiler for the French Tax Code
- Jul 2024A Modern Compiler for the French Tax Code (2021)
- Jan 2023A Modern Compiler for the French Tax Code
- Dec 2020To the brain, reading computer code is not the same as reading language
- Mar 2021Templating for Lawyers
- May 2021Legalese – Computational Law
- Oct 2021Open Source Tax Software
- Oct 2021Open Source Tax Software
- Jun 2022Show HN: Calculator for US individual income tax, from 1970-present
- Feb 2023Intuit pouring money into lobbying amid push for free government-run tax filing
- May 2026Intuit to lay off over 3k employees to refocus on AI
- 20
Extracting Training Data from Large Language Models
Hacker News threads
- Dec 2020Extracting Training Data from Large Language Models
- Dec 2020Extracting Training Data from Large Language Models
- Jun 2021Extracting Training Data from Large Language Models
- Dec 2020Does GPT-2 know your phone number?
- Feb 2021Google Open-Sources Trillion-Parameter AI Language Model Switch Transformer
- Jul 2021All public GitHub code was used in training Copilot
- Jun 2022Ask HN: GPT-3 reveals my full name – can I do anything?
- Apr 2023Record Labels Panic as A.I. Generated Song Becomes Hit Single
- Sep 2026“Next-token predictor” is the wrong mental model for LLMs
- 21
Quantifying Memorization Across Neural Language Models
Hacker News threads
- Mar 2023Quantifying memorization across language models
- Aug 2022Exploring 12M of the 2.3B images used to train Stable Diffusion
- Nov 2022Ask HN: What can I personally do to fight AGAINST the Copilot class action?
- Mar 2023PG: We can't all use AI. Someone has to generate the training data
- Aug 2024Judge dismisses majority of GitHub Copilot copyright claims
- Apr 2025Migrating away from Rust
- Jul 2026The Kimi K3 Moment
- 22
DBOS: A Proposal for a Data-Centric Operating System
Hacker News threads
- Oct 2020DBOS: A Proposal for a Data-Centric Operating System
- Aug 2021DBOS: A Proposal for a Data-Centric Operating System
- Jul 2020DBOS: A Proposal for a Data-Centric Operating System
- Dec 2020Ask HN: What's the best paper you've read in 2020?
- Sep 2022DBOS: A database-oriented operating system
- Dec 2023Postgres pioneer Michael Stonebraker promises to upend the database once more
- Oct 2025Dbos: Durable Workflow Orchestration with Go and PostgreSQL
- Sep 2026Postgres SELECT DISTINCT Does Not Scale
- 23
Training Compute-Optimal Large Language Models
Hacker News threads
- Apr 2022Training Compute-Optimal Large Language Models
- Mar 202270B language model outperforms Gopher and GPT-3
- Sep 2022Training Compute-Optimal Large Language Models
- Apr 2022Estimating PaLM's Training Cost
- Oct 2022GPT-3 can create both sides of an Interactive Fiction transcript
- Feb 2023Sundar Pichai: An important next step on our AI journey
- Mar 2023LLaMA-7B in Pure C++ with full Apple Silicon support
- Apr 2023OpenAI’s CEO confirms the company isn’t training GPT-5 and ‘won’t for some time’
- Jul 2023Free and Fast LLM Finetuning
- Dec 2023Ask HN: AI/ML papers to catch up with current state of AI?
- Jun 2026Cohere's First Model for Developers
- 24
ReAct: Synergizing Reasoning and Acting in Language Models
Hacker News threads
- Dec 2024ReAct: Synergizing Reasoning and Acting in Language Models
- Jan 2023ReAct: Synergizing Reasoning and Acting in Language Models
- Feb 2023ReAct – interesting paper on LLM prompt engineering
- Mar 2023Visual ChatGPT
- Mar 2023TaxyAI: Open-source browser automation with GPT-4
- Apr 2023The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
- May 2023Delimiters won’t save you from prompt injection
- Jul 2023Langchain Is Pointless
- Sep 2023ChatGPT can now see, hear, and speak – openai.com
- Jul 2025Hierarchical Reasoning Model
- Sep 2026Prompting Is Dead in 6 Months. Andrew Ng, Stanford [video]
- 25
LoRA: Low-Rank Adaptation of Large Language Models
Hacker News threads
- May 2023LORA: Low-Rank Adaptation of Large Language Models
- Oct 2026LoRA: Low-Rank Adaptation of Large Language Models (2021)
- Mar 2023Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook
- Mar 2023How to use Alpaca-LoRA to fine-tune a model like ChatGPT
- Mar 2023LoRA: Low-Rank Adaptation of Large Language Models
- Jul 2023Ask HN: Which recently research paper blow your mind?
- Sep 2023Run LLMs at home, BitTorrent‑style
- Apr 2024DECT NR+: A technical dive into non-cellular 5G
- Nov 2024LoRA vs. Full Fine-Tuning: An Illusion of Equivalence
- Aug 2026Claude: System Prompts
Data from the Hacker News archive (ODC-By), arXiv and OpenAlex. Not affiliated with Hacker News or Y Combinator.