Hacker Papers
- 201
Formal Algorithms for Transformers
Hacker News threads
- Jul 2022Formal Algorithms for Transformers
- Jan 2023The Transformer Family
- Apr 2023A Baby GPT
- Apr 2023What Are Transformer Models and How Do They Work?
- May 2023Ask HN: Can someone ELI5 Transformers and the “Attention is all we need” paper
- Jul 2023What We Know About LLMs (A Primer)
- Dec 2023"Attention", "Transformers", in Neural Network "Large Language Models"
- Jan 2024Relearning math as an adult
- Jun 2026Can I Buy Your KV Cache?
- 202
Byte Latent Transformer: Patches Scale Better Than Tokens
Hacker News threads
- May 2025Byte latent transformer: Patches scale better than tokens (2024)
- Dec 2024Tokenisation Is NP-Complete
- Dec 2024Show HN: I made a website to semantically search ArXiv papers
- Feb 2025Ask HN: Is anybody building an alternative transformer?
- May 2025Tokenization for language modeling: BPE vs. Unigram Language Modeling (2020)
- Jun 2026"They're made out of weights"
- Jun 2026Data Compression Explained
- Sep 2026When did Google get so weird?
- Oct 2026Retrofitting language models to operate over bytes
- 203
Improving language models by retrieving from trillions of tokens
Hacker News threads
- Jan 2022WebGPT: Browser-assisted question-answering with human feedback
- Feb 2022AlphaCode as a dog speaking mediocre English
- Jul 2022RETRO is fast
- Dec 2022AlphaCode Attention Visualization
- Dec 2022How Does GPT Obtain Its Ability? Tracing Emergent Abilities of Language Models
- Jan 2023Neural Networks and the Chomsky Hierarchy [DeepMind, 2022]
- May 2023PaLM 2 Technical Report [pdf]
- Nov 2024LLMs have reached a point of diminishing returns
- 204
The Internal State of an LLM Knows When It's Lying
Hacker News threads
- Nov 2023The Internal State of an LLM Knows When It's Lying
- Sep 2023The Internal State of a Large Language Model Knows When Its Lying
- May 2023The internal state of an LLM knows when it is lying
- Jun 2023Show HN: StonksGPT – A Natural Language search tool for Stocks and Finance data
- Aug 2023How to Get ChatGPT to Stop Apologizing?
- May 2024Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet
- Aug 2024LLMs know more than what they say
- Sep 2024AI is growing faster than companies can secure it, warn industry leaders
- Sep 2024Is telling a model to "not hallucinate" absurd?
- Oct 2024LLMs know more than they show: On the intrinsic representation of hallucinations
- Feb 2026Psychometric Jailbreaks Reveal Internal Conflict in Frontier Models
- 205
Faith and Fate: Limits of Transformers on Compositionality
Hacker News threads
- Apr 2025Faith and Fate: Limits of Transformers on Compositionality
- Jun 2023Faith and Fate: Limits of Transformers on Compositionality
- Jun 2023Faith and Fate: Limits of Transformers on Compositionality
- Jun 2023Weird GPT-4 behavior for the specific string “ davidjl”
- Jun 2023Researchers warn of ‘model collapse’ as AI trains on AI-generated content
- Dec 2023Will scaling work?
- Jan 2024Chess-GPT's Internal World Model
- Jan 2024New theory suggests LLMs can understand text
- Mar 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking
- Feb 2025Recent results show that LLMs struggle with compositional tasks
- Oct 2025OpenAI researcher announced GPT-5 math breakthrough that never happened
- 206
GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
Hacker News threads
- Oct 2024Understanding the Limitations of Mathematical Reasoning in LLMs
- Oct 2024Cwal: Scripting Engine Without a Language
- Oct 2024Language is not essential for the cognitive processes that underlie thought
- Oct 2024OpenAI builds first chip with Broadcom and TSMC, scales back foundry ambition
- Nov 2024OK, I can partly explain the LLM chess weirdness now
- Dec 2024GPT-5 is behind schedule
- Jan 202530% drop in O1-preview accuracy when Putnam problems are slightly variated
- Jun 2025The Illusion of Thinking: Strengths and limitations of reasoning models [pdf]
- Jul 2026Emily Bender Sets the Record Straight on "Stochastic Parrots"
- 207
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Hacker News threads
- May 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models
- May 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models
- May 2023Tree-of-Thought (ToT), complex and general problem solving with LLMs
- May 2023Ask HN: Those with success using GPT-4 for programming – what are you doing?
- May 2023Tree of Thoughts
- Jun 2023Tree of Thoughts: Official vs. Wrong Implementation
- Jun 2023Native JSON Output from GPT-4
- Jun 2023LLM Powered Autonomous Agents
- Jul 2023Bard’s latest update: more features, languages and countries
- Sep 2024g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
- Mar 2026Tree Search Distillation for Language Models Using PPO
- 208
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Hacker News threads
- Jan 2024LLM in a Flash: Efficient Large Language Model Inference with Limited Memory
- Dec 2023LLM in a Flash: Efficient Large Language Model Inference with Limited Memory
- Dec 2023LLM in a Flash: Efficient Large Language Model Inference with Limited Memory
- Dec 2023Apple Announces LLM in a Flash: Efficient LLM Inference with Limited Memory
- Dec 2023Apple wants AI to run directly on its hardware instead of in the cloud
- Dec 2023Show HN: Emu2 – A Gemini-like open-source 37B Multimodal Model
- Dec 2023Ferret: A Multimodal Large Language Model
- Mar 2024Towards 1-bit Machine Learning Models
- Mar 2026Qwen3.5-397B at 4.74 tok/s using 5.9GB RAM
- Mar 2026iPhone 17 Pro Demonstrated Running a 400B LLM
- Aug 2026New Mac Studio with M5 Max and M5 Ultra
- 209
Levels of AGI for Operationalizing Progress on the Path to AGI
Hacker News threads
- Nov 2023Levels of AGI: Operationalizing Progress on the Path to AGI
- Nov 2023Levels of AGI: Operationalizing Progress on the Path to AGI
- Nov 2023DeepMind on the Definitions and Levels of AGI
- Nov 2023Sutskever: OpenAI board doing its mission to build AGI that benefits all
- Nov 2023The deal to bring Sam Altman back to OpenAI has fallen apart
- Dec 2023Audiobox: Meta's new foundation research model for audio generation
- Mar 2024Elon Musk sues Sam Altman, Greg Brockman, and OpenAI [pdf]
- May 2024Transformers Can Do Arithmetic with the Right Embeddings
- May 2025Evolving OpenAI's Structure
- May 2025John Carmack talk at Upper Bound 2025
- Jun 2025Seven replies to the viral Apple reasoning paper and why they fall short
- 210
GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
Hacker News threads
- Mar 2023GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs
- Mar 2026An early look at the labor market impact potential of LLMs (2023)
- Mar 2023ChatGPT is down
- Mar 2023OpenAI Research Says 80% of U.S. Workers' Jobs Will Be Impacted by GPT
- Apr 2023Anthropic’s $5B, 4-year plan to take on OpenAI
- Nov 2023Google AI chief says there's a 50% chance we'll hit AGI in just 5 years
- Mar 2024AutoDev: Automated AI-driven development by Microsoft
- Oct 2024OpenAI not expecting to break into profitability until 2029
- May 2025John Carmack talk at Upper Bound 2025
- Nov 2025MIT study finds AI can replace 11.7% of U.S. workforce
- 211
The Llama 3 Herd of Models
Hacker News threads
- Aug 2024The Llama 3 Herd of Models
- Dec 2024The Llama 3 Herd of Models
- Aug 2024Meta's Joe Spisak on Llama 3.1 405B [video]
- Aug 2024Fine-tuning now available for GPT-4o
- Oct 2024Gavin Newsom vetoes SB 1047
- Dec 2024Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
- Feb 2025Grok 3: Another win for the bitter lesson
- Mar 2025AMD Announces "Instella" Open-Source 3B Language Models
- May 2025Type-constrained code generation with language models
- Jul 2026Kimi-K3 Technical Report [pdf]
- 212
SequenceMatch: Imitation Learning for Autoregressive Sequence Modelling with Backtracking
Hacker News threads
- Jun 2023Giving LLM’s a <Backspace> Token
- Jun 2023LLM Powered Autonomous Agents
- Jun 2024AI Detectors Get It Wrong. Writers Are Being Fired Anyway
- Mar 2025Understanding R1-Zero-Like Training: A Critical Perspective
- May 2025Mercury: Commercial-scale diffusion language model
- Aug 2025Hacking Diffusion into Qwen3 for the Arc Challenge
- Sep 2025The wall confronting large language models
- Oct 2025Why do LLMs freak out over the seahorse emoji?
- Oct 2025Why do LLMs freak out over the seahorse emoji?
- 213
Computational Life: How Well-formed, Self-replicating Programs Emerge from Simple Interaction
Hacker News threads
- Jun 2024Computational Life: How self-replicating programs emerge from simple interaction
- Jun 2024Computational Life: How Self-Replicating Programs Emerge from Simple Interaction
- Jul 2024The data that powers AI is disappearing fast
- Jul 2024Google creates self-replicating life from digital 'primordial soup'
- Aug 2024Self-replicating programs emerge from simple interaction (in JavaScript)
- Sep 2024Brainfuck Enterprise Solutions
- Nov 2024OpenAI, Google and Anthropic are struggling to build more advanced AI
- Nov 2025Updated practice for review articles and position papers in ArXiv CS category
- Aug 2026The Computational Theory of Mind (2015)
- Aug 2026Computational Life Reactor (Based on Brainfuck)
- 214
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Hacker News threads
- Jun 2023LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
- Aug 2022LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
- Sep 2022Hot Chips 34: AMD’s Instinct MI200 Architecture
- Feb 2023How to Train Large Models on Many GPUs?
- Mar 2023Show HN: Llama-dl – high-speed download of LLaMA, Facebook's 65B GPT model
- Apr 2023Web LLM – WebGPU Powered Inference of Large Language Models
- May 2023Billion-Scale Approximate Nearest Neighbor Search [pdf]
- May 2023QLoRA: Efficient Finetuning of Quantized LLMs
- Jul 2023Transformer Attention is off by one
- Jun 2024Optimizing AI Inference at Character.ai
- 215
Progress measures for grokking via mechanistic interpretability
Hacker News threads
- Jan 2023Do Large Language Models learn world models or just surface statistics?
- Apr 2023We need a much more sophisticated debate about AI
- Apr 2023Grokking in Julia
- May 2023Tiny Transformer trained for addition learns bizarre addition algorithm
- Aug 2023The Myth of AI Omniscience
- Feb 2024Every model learned by gradient descent is approximately a kernel machine (2020)
- Oct 2024OpenAI builds first chip with Broadcom and TSMC, scales back foundry ambition
- Jan 2026Claude is not a senior engineer (yet)
- 216
Accelerating Large Language Model Decoding with Speculative Sampling
Hacker News threads
- Feb 2023Accelerating Large Language Model Decoding with Speculative Sampling
- Sep 2023Accelerating Large Language Model Decoding with Speculative Sampling
- Mar 2023Facebook LLAMA is being openly distributed via torrents
- Mar 2023LLaMA-7B in Pure C++ with full Apple Silicon support
- Mar 2023Run 100B+ language models at home, BitTorrent‑style
- Apr 2023Stability AI Launches the First of Its StableLM Suite of Language Models
- Nov 2023Major Outage Across ChatGPT and API
- May 2024Better and Faster Large Language Models via Multi-Token Prediction
- Sep 2024AMD Unveils Its First Small Language Model AMD-135M
- May 2026Accelerating Gemma 4: faster inference with multi-token prediction drafters
- 217
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Hacker News threads
- May 2015Deep Unsupervised Learning Using Nonequilibrium Thermodynamics [pdf]
- Apr 2022Dall-E 2
- Oct 2022The Illustrated Stable Diffusion
- Jan 2023Denoising Diffusion models from first principle in Julia
- Jul 2023Stanford A.I. Courses
- Feb 2024Mamba Explained: The State Space Model Taking On Transformers
- May 2024Diffusion Models
- Sep 2024Physics is unreasonably good at creating new math
- Sep 2024Too much efficiency makes everything worse (2022)
- 218
Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural Networks
Hacker News threads
- Jan 2014How Google Cracked House Number Identification in Street View
- Apr 2014Google's Street View computer vision can beat reCAPTCHA with 99% accuracy
- Apr 2014Google's Street View computer vision can beat reCAPTCHA with 99% accuracy
- Jun 2014Captchas are Becoming Ridiculous
- Jul 2014Inside Google Brain
- Feb 2016Judge tosses proposed class action accusing Google of CAPTCHA fraud
- Jun 2016Intro to Hidden Markov Models (2010) [pdf]
- Mar 2017ReBreakCaptcha: Breaking Google’s ReCaptcha v2 Using Google
- 219
End to End Learning for Self-Driving Cars
Hacker News threads
- Apr 2016ConvNet-Based “End to End Learning for Self-Driving Cars”
- Apr 2016End to End Learning for Self-Driving Cars
- Apr 2016End to End Learning for Self-Driving Cars [pdf]
- Jul 2016Master Plan, Part Deux
- Feb 2017The most cited deep learning papers
- May 2017Volta: Advanced Data Center GPU
- Jun 2017Tesla hires Andrej Karpathy
- Sep 2017Europilot: A toolkit for Euro Truck Simulator to develop self-driving algorithms
- May 2018A self-driving toy car using end-to-end learning
- Jul 2018Ask HN: What makes a good autonomous vehicles engineer?
- Jul 2018Steps Toward Super Intelligence Part I: How We Got Here
- 220
Pretraining on the Test Set Is All You Need
Hacker News threads
- Oct 2023Pretraining on test set is all you need
- Feb 2025Pretraining on the Test Set Is All You Need
- Oct 2023Pretraining on the Test Set Is All You Need
- Oct 2023AI hype is built on high test scores. Those tests are flawed
- Nov 2023Grok
- Mar 2024Claude 3 model family
- Apr 2024The "it" in AI models is the dataset
- Jun 2024Gemma 2: Improving Open Language Models at a Practical Size [pdf]
- Jul 2024Fitting an elephant with four non-zero parameters
- Feb 2025Grok3 Launch [video]
- 221
Technical Report on the Pangram AI-Generated Text Classifier
Hacker News threads
- Mar 2024Technical Report on the Checkfor.ai AI-Generated Text Classifier
- Jul 2026Technical Report on the Pangram AI-Generated Text Classifier (2024)
- Oct 2024AI Slop Is Flooding Medium
- Nov 2025Open-source Zig book
- Jan 2026Amazon axes 16,000 jobs as it pushes AI and efficiency
- Jan 2026For most flagged articles, nearly every cited sentence failed verification
- Feb 2026Show HN: Showboat and Rodney, so agents can demo what they've built
- Apr 2026Ask HN: How do systems (or people) detect when a text is written by an LLM
- Jul 2026The bottleneck might be the air in the room
- Jul 2026Detecting LLM-Generated Texts with "Classical" Machine Learning
- 222
European Union regulations on algorithmic decision-making and a "right to explanation"
Hacker News threads
- Jul 2016EU regulations on algorithmic decision-making and a “right to explanation”
- Jun 2016EU regulations on algorithmic decision-making and a “right to explanation”
- Jul 2016EU regulations on algorithmic decision-making and a “right to explanation”
- Jul 2016Artificial Intelligence Is Setting Up the Internet for a Huge Clash with Europe
- Jul 2016Training Computers to Find Future Criminals
- Aug 2016Make Algorithms Accountable
- Sep 2016Approaching fairness in machine learning
- Sep 2016Approaching fairness in machine learning
- Jun 2017You can probably use deep learning even if you don't have a lot of data
- Jan 2018Algorithmic decision making and the cost of fairness (2017)
- Oct 2018How Do Insurance Companies Know My Health History? (2017)
- 223
Universal adversarial perturbations
Hacker News threads
- Oct 2016Universal adversarial perturbations
- Nov 2016How close are we to solving vision?
- Nov 2016Show HN: Interactive deep convnet visualization for Keras and Tensorflow
- Jan 2017OpenNMT: Open-Source Neural Machine Translation
- Jun 2017Noninvasive Deep Brain Stimulation via Temporally Interfering Electric Fields
- Jul 2017Robust Adversarial Examples
- Oct 2017AI Model Fundamentally Cracks Captchas, Scientists Say
- Oct 2017One pixel attack for deceiving deep neural networks
- Nov 2018Adversarial Examples That Fool Both Computer Vision and Time-Limited Humans
- 224
Building Machines That Learn and Think Like People
Hacker News threads
- Apr 2016Building machines that learn and think like people
- Apr 2016Building Machines That Learn and Think Like People
- Apr 2016Building Machines That Learn and Think Like People
- Aug 2016The Difference Between AI, Machine Learning, and Deep Learning
- Aug 2016The Difference Between AI, Machine Learning, and Deep Learning
- Feb 2017Causality in machine learning
- Apr 2017Ask HN: AI winter coming in next few years for AGI research?
- Apr 2017How brains are built: Principles of computational neuroscience
- Jul 2017The future of deep learning
- May 2019Automakers Are Rethinking the Timetable for Fully Autonomous Cars
- Jun 2019An Explicitly Relational Neural Network Architecture
- 225
QLoRA: Efficient Finetuning of Quantized LLMs
Hacker News threads
- May 2023QLoRA: Efficient Finetuning of Quantized LLMs
- May 2023QLoRA: Efficient Finetuning of Quantized LLMs
- May 2023The False Promise of Imitating Proprietary LLMs
- May 2023Ask HN: What's the best self hosted/local alternative to GPT-4?
- May 2023Ask HN: What's the best self hosted/local alternative to GPT-4?
- May 2023Ask HN: What's the best self hosted/local alternative to GPT-4?
- Dec 202380% faster, 50% less memory, 0% loss of accuracy Llama finetuning
- May 2024LoRA Learns Less and Forgets Less
- Oct 2024Guide to Fine-Tuning LLMs
- Mar 2026TorchLean: Formalizing Neural Networks in Lean
Data from the Hacker News archive (ODC-By), arXiv and OpenAlex. Not affiliated with Hacker News or Y Combinator.