Hacker Papers
- 51
Discovering Latent Knowledge in Language Models Without Supervision
Hacker News threads
- Dec 2022Discovering Latent Knowledge in Language Models Without Supervision
- Dec 2022Discovering Latent Knowledge in Language Models Without Supervision
- Dec 2022AlphaCode Attention Visualization
- Jan 2023ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based, open) language model
- Feb 2023Microsoft Adds ChatGPT AI Technology to Bing Search Engine
- Feb 2023ArxivGPT: Chrome extension that summarizes arxived research papers using ChatGPT
- Feb 2023ChatGPT is falsely recommending us for a service we don't provide
- Feb 2023ChatGPT get-rich-quick schemes are coming for magazines, Amazon, and YouTube
- Jul 2024ChatGPT Isn't 'Hallucinating'–It's Bullshitting – Scientific American
- Apr 2025GPT o3 frequently fabricates actions, then elaborately justifies these actions
- 52
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
Hacker News threads
- May 2023Attention with Linear Biases (ALiBi)
- May 2023Replit's new Code LLM: Open Source, 77% smaller than Codex, trained in 1 week
- May 2023Anthropic - Introducing 100K Token Context Windows, Around 75,000 Words
- Jul 2023
- Aug 2023Code Llama, an AI tool for coding
- Aug 2023
- Jan 2024ChatGPT for Teams
- Oct 2024Differential Transformer
- 53
RoFormer: Enhanced Transformer with Rotary Position Embedding
Hacker News threads
- Mar 2023Large language models are having their Stable Diffusion moment
- Apr 2023Why Are Sinusoidal Functions Used for Position Encoding?
- Aug 2023Llama from Scratch (or how to implement a paper without crying)
- Apr 2025Multi-Token Attention
- Apr 2025The Llama 4 herd
- Apr 2025Llama 4 Now Live on Groq
- Aug 2025Open models by OpenAI
- 54
Deep Differentiable Logic Gate Networks
Hacker News threads
- Feb 2023Logic Gate Simulator
- Dec 2023Transformers on Chips
- Sep 2024GSoC'24: Differentiable Logic for Interactive Systems and Generative Music
- May 2025Compiling a neural net to C for a speedup
- May 2025Compiling a neural net to C for a speedup
- Nov 2025Weight-sparse transformers have interpretable circuits [pdf]
- Nov 2025TPUs vs. GPUs and why Google is positioned to win AI race in the long term
- 55
Fast Inference from Transformers via Speculative Decoding
Hacker News threads
- Sep 2023Fast Inference from Transformers via Speculative Decoding
- Jul 2025Playing with Open Source LLMs
- Feb 2026Raspberry Pi Pico 2 at 873.5MHz with 3.05V Core Abuse
- Apr 2026We got 207 tok/s with Qwen3.5-27B on an RTX 3090
- May 2026Accelerating Gemma 4: faster inference with multi-token prediction drafters
- Jun 2026DeepSeek open-sources inference optimizations with 60–85% faster generation [pdf]
- Jun 2026DeepSeek open-sources inference optimizations with 60–85% faster generation [pdf]
- Jun 2026DeepSeek open-sources inference optimizations with 60–85% faster generation [pdf]
- 56
Self-Instruct: Aligning Language Models with Self-Generated Instructions
Hacker News threads
- Apr 2023Self-Instruct: Aligning Language Model with Self Generated Instructions
- Mar 2023The genie escapes: Stanford copies the ChatGPT AI for less than $600
- Mar 2023Show HN: Finetune LLaMA-7B on commodity GPUs using your own text
- May 2023LIMA: Less Is More for Alignment
- Dec 2023Ask HN: AI/ML papers to catch up with current state of AI?
- Dec 2024The Curse of Recursion: Training on generated data makes models forget (2023)
- Jan 2025AI Engineer Reading List
- 57
Deduplicating Training Data Makes Language Models Better
Hacker News threads
- May 2022Google fires another AI researcher who reportedly challenged findings
- Aug 2022Chinchilla's Wild Implications
- Aug 2022Exploring 12M of the 2.3B images used to train Stable Diffusion
- Nov 2022Ask HN: What can I personally do to fight AGAINST the Copilot class action?
- Jun 2024Large language model data pipelines and Common Crawl
- Jan 202530% drop in O1-preview accuracy when Putnam problems are slightly variated
- 58
Generative Language Modeling for Automated Theorem Proving
Hacker News threads
- Sep 2020Generative Language Modeling for Automated Theorem Proving
- Sep 2020Generative Language Modeling for Automated Theorem Proving
- Sep 2020Graph Representations for Higher-Order Logic and Theorem Proving (2019)
- Sep 2020At the International Mathematical Olympiad, computers prepare to go for the gold
- Sep 2020The Collatz Conjecture: the simple math problem we still can’t solve
- Nov 2020AI Expert Roadmap
- Jan 2021DALL·E: Creating Images from Text
- Jun 2021Mathematicians welcome computer-assisted proof in ‘grand unification’ theory
- Jul 2024AI solves International Math Olympiad problems at silver medal level
- 59
Predictive Coding Approximates Backprop along Arbitrary Computation Graphs
Hacker News threads
- May 2021Predictive Coding Approximates Backprop Along Arbitrary Computation Graphs (2020)
- Feb 2021Artificial Neural Nets Finally Yield Clues to How Brains Learn
- Apr 2021Predictive coding has been unified with backpropagation
- Apr 2021Cerebras’ new monster AI chip adds 1.4T transistors
- Apr 2021The Fourier transform is a neural network
- Jun 2023Artificial brains help understand real brains
- Sep 2023What Is an Emotion? William James’s Theory of How Our Bodies Affect Our Feelings
- May 2024Energy, not compute, will be the #1 bottleneck to AI progress – Mark Zuckerberg [video]
- 60
Decision Transformer: Reinforcement Learning via Sequence Modeling
Hacker News threads
- Nov 2022Decision Transformer: Reinforcement Learning via Sequence Modeling
- Jun 2021Decision Transformer: ReinforcementLearning via Sequence Modeling
- Jul 2021Deep reinforcement learning is a waste of time (2019)
- Jul 2021The Surprising Effectiveness of PPO in Cooperative Multi-Agent Games
- Oct 2023MemGPT: Towards LLMs as Operating Systems
- Aug 2024RLHF is just barely RL
- Jun 2025Q-learning is not yet scalable
- Oct 2025Implicit Actor Critic Coupling via a Supervised Learning Framework for RLVR
- 61
Character-Aware Models Improve Visual Text Rendering
Hacker News threads
- Dec 2022Improving Text Rendering in Image Generation Models
- Dec 2022What ChatGPT Can't Do
- Feb 2023Illusion Diffusion: Optical Illusions Using Stable Diffusion
- Apr 2023A Baby GPT
- Apr 2023Stability AI releases DeepFloyd IF, a powerful text-to-image model
- Oct 2023DALL-E 3: Improving image generation with better captions [pdf]
- Mar 2024Ask HN: Why can't image generation models spell?
- 62
The Forward-Forward Algorithm: Some Preliminary Investigations
Hacker News threads
- Jan 2023The Forward-Forward Algorithm, potential alternative to backpropagation
- May 2023The Forward-Forward Algorithm: Some Preliminary Investigations (2022)
- Jan 2023Deep Learning Pioneer Geoffrey Hinton Publishes New Deep Learning Algorithm
- Jun 2023MeZO: Fine-Tuning Language Models with Just Forward Passes
- Jun 2023Geoffrey Hinton: “We're toast. This is the actual end of history”
- Apr 2024Storm: LLM system that researches a topic and generates full-length wiki article
- Jul 2024Training of Physical Neural Networks
- Jan 2025Antiqua et Nova: Note on the relationship between AI and human intelligence
- 63
Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions
Hacker News threads
- Aug 2021An empirical cybersecurity evaluation of GitHub Copilot's code contributions
- Sep 2021GitHub Copilot Generated Insecure Code in 40% of Circumstances During Experiment
- Sep 2021GitHub Copilot Generated Insecure Code in 40% of Circumstances During Experiment
- Oct 2021GitHub Copilot available for JetBrains and Neovim
- Jun 2022Papers on GitHub Copilot, copyright law, and ownership for AI-generated code
- Dec 2022Study finds AI assistants help developers produce code likely to be buggy
- Jan 2023It's Plausible, but Is It True?
- 64
Why AI is Harder Than We Think
Hacker News threads
- Apr 2021Why AI is harder than we think
- Aug 2023Why AI Is Harder Than We Think (2021) [pdf]
- Jan 2023Why AI Is Harder Than We Think (2021)
- Apr 2021Superintelligence Risk Project: Conclusion
- May 2021Why A.I. Moonshots Miss
- Jan 2023The Expanding Dark Forest and Generative AI
- Jun 2024Ask HN: I have many PDFs – what is the best local way to leverage AI for search?
- Sep 2025Four Fallacies of Modern AI
- 65
Are Transformers Effective for Time Series Forecasting?
Hacker News threads
- Jan 2024Are Transformers Effective for Time Series Forecasting?
- Apr 2023From Deep to Long Learning
- Feb 2024A decoder-only foundation model for time-series forecasting
- Jul 2024XLSTMTime: Long-Term Time Series Forecasting with xLSTM
- Jun 2025Time Series Forecasting with Graph Transformers
- Dec 2025The Illustrated Transformer
- 66
PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models
Hacker News threads
- Jun 2020Pulse: Self-Supervised Photo Upsampling via Latent Space Exploration
- Jun 2020Facial Recognition Leads To False Arrest Of Black Man In Detroit
- Jul 2020Yann LeCun quits Twitter amid acrimonious exchanges on AI bias
- Feb 2022Recovering redacted information from pixelated videos
- May 2022Imagen, a text-to-image diffusion model
- Dec 2022Pixelmator Pro gets a magical, AI‑powered Deband feature
- 67
Solving Quantitative Reasoning Problems with Language Models
Hacker News threads
- Sep 2022Solving Quantitative Reasoning Problems with Language Models
- Oct 2022AI language models are struggling to “get” math
- Dec 2022Building a Virtual Machine Inside ChatGPT
- Feb 2023To Build Truly Intelligent Machines, Teach Them Cause and Effect
- Nov 2023Sam Altman's ouster was precipitated by letter to board about AI breakthrough
- Jan 2025Berkeley Researchers Replicate DeepSeek R1's Core Tech for Just $30: A Small Mod
- 68
Denoising Diffusion Probabilistic Models
Hacker News threads
- 69
Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models
Hacker News threads
- Dec 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion
- Dec 2022Investigating Data Replication in Diffusion Models
- Dec 2022Diffusion Art or Digital Forgery? Data Replication in Diffusion Models
- Dec 2022GPT3/DALL-E2 in Discord, chat like ChatGPT, generate images, and more
- Jan 2023Lawsuit challenging Stable Diffusion filed against DeviantArt & others
- Jan 2023Lawsuit challenging Stable Diffusion filed against DeviantArt & others
- Jan 2023Stable Diffusion Frivolous Litigation
- Jan 2023An IP Attorney’s Reading of the Stable Diffusion Class Action Lawsuit
- Feb 2023Stable Diffusion found to emit some images from training at generation time
- Feb 2023Stable Attribution
- Jul 2024Brazil data regulator bans Meta from mining data to train AI models
- 70
Large Language Models Can Self-Improve
Hacker News threads
- Nov 2022Large Language Models Can Self-Improve
- Feb 2023Large language models can self-improve
- Feb 2023Large Language Models Can Self-Improve
- Jan 2023ChatGPT Can't Kill Anything Worth Preserving
- Feb 2023Exclusive Q&A John Carmack’s ‘Different Path’ to Artificial General Intelligence
- Feb 2023ChatGPT Is a Blurry JPEG of the Web
- Feb 2023Are we racing toward AI catastrophe?
- Feb 2023Poisoning Web-Scale Training Datasets Is Practical
- Feb 2023Eventually ChatGPT will eat itself
- Mar 2023GPT-3 will ignore tools when it disagrees with them
- May 2023Constitutional AI: RLHF on Steroids
- 71
The Principles of Deep Learning Theory
Hacker News threads
- Apr 2022The Principles of Deep Learning Theory
- Jun 2021The Principles of Deep Learning Theory
- Jul 2021The Principles of Deep Learning Theory
- Oct 2021A new link to an old model could crack the mystery of deep learning
- Apr 2022The Mathematics of Artificial Intelligence (2022)
- Jan 2023Ask HN: What are the foundational texts for learning about AI/ML/NN?
- Jan 2023Critical brain hypothesis: A physical theory for when the brain performs best
- Nov 2023Understanding Deep Learning
- 72
Vectorized and performance-portable Quicksort
Hacker News threads
- Feb 2024Vectorized and performance-portable Quicksort (2022)
- Jun 2022Vectorized and performance-portable Quicksort
- Jun 2022Vectorized and performance-portable Quicksort
- Jun 2022Apple M2 Die Shot and Architecture Analysis – Big Cost Increase and A15 Based IP
- Dec 2022Sorting with SIMD
- Jan 2023Efficient and performance-portable vector software
- Mar 2024JPEG XL and the Pareto Front
- 73
Transformers learn in-context by gradient descent
Hacker News threads
- Dec 2022Transformers learn in-context by gradient descent
- Jan 2023Do Large Language Models learn world models or just surface statistics?
- Feb 2023ChatGPT Hype Is Proof Nobody Understands AI
- Apr 2023Teaching ChatGPT to Speak My Son’s Invented Language
- Apr 2023GPT-4 gets a B on my quantum computing final exam
- Mar 2025ARC-AGI without pretraining
- 74
GLU Variants Improve Transformer
Hacker News threads
- Aug 2023Llama from Scratch (or how to implement a paper without crying)
- Nov 2023Simplifying Transformer Blocks
- Sep 2024SwiGLU activation function causes instability in FP8 LLM training
- Jun 2026Don't trust large context windows
- Jun 2026Anthropic to Require ID Verification for Certain Capabilities Starting July 8
- 75
A ConvNet for the 2020s
Hacker News threads
- May 2024A ConvNet for the 2020s
- Jan 2022A ConvNet for the 2020s
- Jan 2022A ConvNet for the 2020s
- Apr 2022Transformers Are All You Need
- Apr 2022Transformers Are All You Need
- Apr 2023Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows
- Jan 2024Citation cartels help mathematicians-and their universities-climb the rankings
- Aug 2024What's Going on in Machine Learning? Some Minimal Models
Data from the Hacker News archive (ODC-By), arXiv and OpenAlex. Not affiliated with Hacker News or Y Combinator.