Hacker Papers
- 01
Scaling Laws for Neural Language Models
Hacker News threads
- Feb 2020Scaling Laws for Neural Language Models
- Jun 2022Scaling Laws for Neural Language Models
- Sep 2026Scaling Laws for Neural Language Models (first "scaling laws" paper from 2020)
- Jan 2020Talking to myself: how I trained GPT2-1.5b for rubber ducking using my chat data
- Oct 2021Megatron-Turing NLG 530B, the World’s Largest Generative Language Model
- Feb 2023Ask HN: How “real” are AI scaling laws?
- Apr 2023OpenAI’s CEO confirms the company isn’t training GPT-5 and ‘won’t for some time’
- Dec 2023Do large language models need all those layers?
- Oct 2024Understanding the Limitations of Mathematical Reasoning in LLMs
- Feb 2026The Problem with LLMs
- Oct 2026Attention Is Not What You Need (2025)
- 02
LoRA: Low-Rank Adaptation of Large Language Models
Hacker News threads
- May 2023LORA: Low-Rank Adaptation of Large Language Models
- Oct 2026LoRA: Low-Rank Adaptation of Large Language Models (2021)
- Mar 2023Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook
- Mar 2023How to use Alpaca-LoRA to fine-tune a model like ChatGPT
- Mar 2023LoRA: Low-Rank Adaptation of Large Language Models
- Jul 2023Ask HN: Which recently research paper blow your mind?
- Sep 2023Run LLMs at home, BitTorrent‑style
- Apr 2024DECT NR+: A technical dive into non-cellular 5G
- Nov 2024LoRA vs. Full Fine-Tuning: An Illusion of Equivalence
- Aug 2026Claude: System Prompts
- 03
Learning in High Dimension Always Amounts to Extrapolation
Hacker News threads
- Oct 2023Learning in High Dimension Always Amounts to Extrapolation
- Nov 2023Learning in High Dimension Always Amounts to Extrapolation
- Dec 2021Training computer vision models on random noise instead of real images
- May 2022The Scaling Hypothesis (2021)
- Oct 2023The copyright fight over authors and OpenAI's ChatGPT
- Nov 2023Transformers struggle with generalizing tasks beyond pre-training data
- Mar 2024Large language models can do jaw-dropping things. But nobody knows why
- Oct 2024GitHub cuts AI deals with Google, Anthropic
- Feb 2026GPT-5.2 derives a new result in theoretical physics
- Oct 2026“Math 2.0” will need to value mathematical progress more holistically
- 04
Mastering the Game of Stratego with Model-Free Multiagent Reinforcement Learning
Hacker News threads
- Jul 2022Mastering the Game of Stratego with Model-Free Multiagent Reinforcement Learning
- Jul 2022(typo in URL, ignore)
- Jul 2022DeepMind: Mastering the Game of Stratego with Model-Free Multiagent RL
- Dec 2022Mastering Stratego, the classic game of imperfect information
- Oct 2025Poker Tournament for LLMs
- Oct 2026With most information hidden, the game Stratego had stumped AI until now
- 05
Will we run out of data? Limits of LLM scaling based on human-generated data
Hacker News threads
- Aug 2023Will we run out of data to train LLMs?
- Nov 2022We might run out of language data to train ML models soon [pdf]
- Dec 2022An analysis of the limits of scaling datasets in Machine Learning
- Dec 2022Drowning in AI Generated Garbage: the silent war we are fighting
- Dec 2023Dropbox: How to opt out of 3rd party AI partner access to your Dropbox
- Sep 2025Failing to Understand the Exponential, Again
- Sep 2026Nvidia wants to put a watchdog chip next to every AI agent
- 06
Linear Transformers Are Secretly Fast Weight Programmers
Hacker News threads
- Oct 2022Meta Learning Backpropagation and Improving It (2020)
- May 2023Geoffrey Hinton leaves Google and can now speak freely about his AI concern
- Sep 2023HN thread 37367951
- Sep 2023I made a transformer by hand (no training)
- Oct 2023Ring Attention with Blockwise Transformers for Near-Infinite Context
- Oct 2023How Transformers Work
- Feb 2024Neural Network Diffusion
- Sep 2026Transformers Explained Visually
- 07
Locally Typical Sampling
Hacker News threads
- 08
Training language models to follow instructions with human feedback
Hacker News threads
- Jan 2023Training language models to follow instructions with human feedback [pdf]
- Dec 2022Training language models to follow instructions with human feedback
- Apr 2023Training language models to follow instructions with human feedback
- Oct 2022GPT-3 can create both sides of an Interactive Fiction transcript
- Jan 2023Announcement: AI generated answers are officially banned here
- Feb 2023What Is ChatGPT Doing and Why Does It Work?
- Mar 2023Microsoft lays off an ethical AI team as it doubles down on OpenAI
- May 2023Lawyer cites fake cases invented by ChatGPT, judge is not amused
- Jun 2023How RLHF Works
- Jun 2024Safe Superintelligence Inc.
- Sep 2026I built non-autoregressive decision models with RL a year ago
- 09
Constitutional AI: Harmlessness from AI Feedback
Hacker News threads
- Feb 2023Prompt Engineering Guide: Guides, papers, and resources for prompt engineering
- Mar 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks
- Sep 2023AI Model Weight Providers Should Not Police Uses, No Matter How Awful They Are
- Oct 2024Anthropic hires OpenAI co-founder Durk Kingma
- Dec 2025Claude 4.5 Opus’ Soul Document
- Jan 2026Claude's New Constitution
- Jan 2026Claude's New Constitution
- Sep 2026OpenAI Agents API
- 10
ReAct: Synergizing Reasoning and Acting in Language Models
Hacker News threads
- Dec 2024ReAct: Synergizing Reasoning and Acting in Language Models
- Jan 2023ReAct: Synergizing Reasoning and Acting in Language Models
- Feb 2023ReAct – interesting paper on LLM prompt engineering
- Mar 2023Visual ChatGPT
- Mar 2023TaxyAI: Open-source browser automation with GPT-4
- Apr 2023The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
- May 2023Delimiters won’t save you from prompt injection
- Jul 2023Langchain Is Pointless
- Sep 2023ChatGPT can now see, hear, and speak – openai.com
- Jul 2025Hierarchical Reasoning Model
- Sep 2026Prompting Is Dead in 6 Months. Andrew Ng, Stanford [video]
- 11
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Hacker News threads
- Apr 2022An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Jul 2021Deep reinforcement learning is a waste of time (2019)
- Mar 2022Transformers, originally designed to handle language, are taking on vision
- Mar 2023The Most Cited AI Papers in 2022
- Jun 2023What Is a Transformer Model?
- Feb 2024The killer app of Gemini Pro 1.5 is using video as an input
- Oct 2024Show HN: Doctly AI – Accurate AI-Powered PDF to Markdown Parser
- Jul 2025Baba Is Eval
- Sep 2026Ask HN: (Why) Was the LLM breakthrough useful for images, audio, etc.?
- 12
Extracting Training Data from Large Language Models
Hacker News threads
- Dec 2020Extracting Training Data from Large Language Models
- Dec 2020Extracting Training Data from Large Language Models
- Jun 2021Extracting Training Data from Large Language Models
- Dec 2020Does GPT-2 know your phone number?
- Feb 2021Google Open-Sources Trillion-Parameter AI Language Model Switch Transformer
- Jul 2021All public GitHub code was used in training Copilot
- Jun 2022Ask HN: GPT-3 reveals my full name – can I do anything?
- Apr 2023Record Labels Panic as A.I. Generated Song Becomes Hit Single
- Sep 2026“Next-token predictor” is the wrong mental model for LLMs
- 13
Language Models are Few-Shot Learners
Hacker News threads
- May 2020GPT-3: Language Models Are Few-Shot Learners
- Jun 2024Language Models Are Few-Shot Learners
- Nov 2024Language models are few-shot learners (2020)
- Jun 2020GPT-3 and Scaling Trends
- Jul 2020Show HN: Humans vs AI – A/B testing GPT-3
- Oct 2020AI training method exceeds GPT-3 performance with fewer parameters
- Oct 2022Why Mastering Language Is So Difficult for AI
- Feb 2023Why China Didn’t Invent ChatGPT
- May 2023Michael J. Fox Foundation Announces Breakthrough for Parkinson's Biomarker
- Nov 2023Sam Altman Exposes the Charade of AI Accountability
- Sep 2026GPT-6 Astra
- 14
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Hacker News threads
- Apr 2022Chain of Thought Prompting Elicits Reasoning in Large Language Models
- Dec 2022Chain of Thought Prompting Elicits Reasoning in Large Language Models
- Apr 2022Pathways Language Model (PaLM): Scaling to 540B parameters
- Jul 2022Am I doing it wrong? (OpenAI test)
- Mar 2023Oceania Always at War with Eastasia: Generative AI and Knowledge Pollution
- Apr 2023Teaching ChatGPT to Speak My Son’s Invented Language
- Aug 2023GPT-4 Can't Reason
- Sep 2024Training Language Models to Self-Correct via Reinforcement Learning
- Oct 2025Ortega hypothesis
- Sep 2026GPT-6 Astra
- 15
Emergent Abilities of Large Language Models
Hacker News threads
- Feb 2023Emergent Abilities of Large Language Models
- May 2024Emergent Abilities of Large Language Models
- Apr 2023Emergent Abilities of Large Language Models
- Dec 2022Ask HN: How does ChatGPT work?
- Feb 2023It Looks Like You’re Trying to Take over the World
- May 2023LLMs are not greater than the sum of their parts: Stanford researchers
- Jul 2023Llama 2 – Meta AI
- Nov 2023Telling GPT-4 you're scared or under pressure improves performance
- Mar 2024“Emergent” abilities in LLMs actually develop gradually and predictably – study
- Feb 2025Understanding Reasoning LLMs
- Aug 2026Humanity has the debate about AI consciousness backwards
- 16
Inductive logic programming at 30: a new introduction
Hacker News threads
- 17
TruthfulQA: Measuring How Models Mimic Human Falsehoods
Hacker News threads
- 18
Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals
Hacker News threads
- Aug 2021A dubious writing style emerging in science
- Aug 2021Tortured phrases: A dubious writing style emerging in science
- Jun 2023Junk websites filled w AI-generated text pulling in money from programmatic ads
- Dec 2023Tortured conference series thriving in Computer Science
- Aug 2026Research papers using "kidney disappointment" instead of "kidney failure"
- Aug 2026Research papers using "kidney disappointment" instead of "kidney failure"
- Aug 2026Anthropic's 'Watermark' Text Adulteration in Claude Is a Perversion of Writing
- 19
Precise Zero-Shot Dense Retrieval without Relevance Labels
Hacker News threads
- Nov 2024Hypothetical Document Embeddings (HyDE) for Precise Zero-Shot Retrieval [pdf]
- Aug 2026Hypothetical Document Embeddings
- Jan 2023Precise Zero-Shot Dense Retrieval Without Relevance Labels
- Jan 2023How to implement Q&A against your docs with GPT3 embeddings and Datasette
- Feb 2023I made ChatGPT and Bing AI have a conversation
- Mar 2023
- Sep 2023A Comprehensive Guide for Building Rag-Based LLM Applications
- Dec 2023Build a search engine, not a vector DB
- May 2024Show HN: Hacker Search – A semantic search engine for Hacker News
- Sep 2024Contextual Retrieval
- Aug 2026Don't classify, hallucinate!
- 20
GraphCast: Learning skillful medium-range global weather forecasting
Hacker News threads
- Dec 2022End-to-end deep learning methods beat production weather forecast accuracy
- Jan 2023GraphCast: Learning skillful medium-range global weather forecasting
- Aug 2023Ask HN: If we train an LLM with “data” instead of “language” tokens
- Dec 2023Predict the next frame. Results of training a transformer on "visual sentences"
- Dec 2025NOAA deploys new generation of AI-driven global weather models
- Aug 2026DeepMind's WeatherNext model achieves breakthrough forecasting cyclones
- 21
Flow Matching for Generative Modeling
Hacker News threads
- 22
Quantifying Memorization Across Neural Language Models
Hacker News threads
- Mar 2023Quantifying memorization across language models
- Aug 2022Exploring 12M of the 2.3B images used to train Stable Diffusion
- Nov 2022Ask HN: What can I personally do to fight AGAINST the Copilot class action?
- Mar 2023PG: We can't all use AI. Someone has to generate the training data
- Aug 2024Judge dismisses majority of GitHub Copilot copyright claims
- Apr 2025Migrating away from Rust
- Jul 2026The Kimi K3 Moment
- 23
Petals: Collaborative Inference and Fine-tuning of Large Models
Hacker News threads
- Jul 2026Petals: Collaborative Inference and Fine-Tuning of Large Models
- Mar 2023Petals: Collaborative Inference and Fine-Tuning of Large Models
- Dec 2022Petals is creating a free, distributed network for running text-generating AI
- Jan 2023Petals: Run 100B+ language models at home bit-torrent style
- Jan 2023Petals: Run 100B+ language models at home bit-torrent style
- Jan 2023Ask HN: Can you crowdfund the compute for GPT?
- Feb 2023Running large language models like ChatGPT on a single GPU
- Mar 2023The Most Cited AI Papers in 2022
- 24
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Hacker News threads
- Dec 2023RAG: Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- Mar 2021Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- Jan 2023Wolfram Alpha as the Way to Bring Computational Knowledge Superpowers to ChatGPT
- May 2023Anthropic - Introducing 100K Token Context Windows, Around 75,000 Words
- Jun 2023Emerging Architectures for LLM Applications
- Aug 2023GPU-Accelerated LLM on a $100 Orange Pi
- Aug 2023How do domain-specific chatbots work? A retrieval augmented generation overview
- Nov 2023Grok
- Mar 2024Show HN: Ragdoll Studio (fka Arthas.AI) is the FOSS alternative to character.ai
- Jul 2026We taught a small LLM to throw away 68% of our RAG context
- 25
The case for 4-bit precision: k-bit Inference Scaling Laws
Hacker News threads
- Jul 2023The case for 4-bit precision: k-bit Inference Scaling Laws
- Jan 2023Some Remarks on Large Language Models – Yoav Goldberg
- Mar 2023LLaMA-7B in Pure C++ with full Apple Silicon support
- Mar 2023Llama.cpp 30B runs with only 6GB of RAM now
- Aug 2023How Is LLaMa.cpp Possible?
- Nov 2023QUIK is a method for quantizing LLM post-training weights to 4 bit precision
- Jan 2024Meta AI releases Code Llama 70B
- Nov 2024AMD now has more compute on the top 500 than Nvidia
- Jun 2026Qwen 3.6 27B is the sweet spot for local development
Data from the Hacker News archive (ODC-By), arXiv and OpenAlex. Not affiliated with Hacker News or Y Combinator.