Hacker Papers

1. 101
   

   What Algorithms can Transformers Learn? A Study in Length Generalization

   Hattie Zhou et al. · 2023

   Hacker News threads

   • Feb 2024What Algorithms Can Transformers Learn? A Study in Length Generalization
   • Feb 2024Every model learned by gradient descent is approximately a kernel machine (2020)
   • Apr 2024What can LLMs never do?
   • Dec 2024Byte Latent Transformer: Patches Scale Better Than Tokens

   arXiv ↗
2. 102
   

   Power Hungry Processing: Watts Driving the Cost of AI Deployment?

   Alexandra Sasha Luccioni et al. · 2023

   Hacker News threads

   • Apr 2024Power Hungry Processing: Watts Driving the Cost of AI Deployment?
   • Dec 2023Making an image with generative AI uses as much energy as charging your phone
   • Feb 2024Paragraph Pollution: AI is (probably) greener than you typing on a laptop
   • Apr 2024When Will the GenAI Bubble Burst?

   arXiv ↗
3. 103
   

   Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

   Chengyi Wang et al. · 2023

   Hacker News threads

   • Jan 2023Neural Codec Language Models Are Zero-Shot Text to Speech Synthesizers
   • Jan 2023Will TTS and STT benefit from the AI boom?
   • Feb 2023I had ChatGPT write a Decemberists song
   • Sep 2024Amazon's Secret Weapon in Chip Design Is Amazon

   arXiv ↗
4. 104
   

   Mastering Diverse Domains through World Models

   Danijar Hafner et al. · 2023

   Hacker News threads

   • Jan 2023Mastering Diverse Domains Through World Models
   • Jan 2023Google’s DeepMind: Mastering Diverse Domains Through World Models
   • Jul 2023Ask HN: Who is hiring? (July 2023)
   • Apr 2025DeepMind program finds diamonds in Minecraft without being taught

   arXiv ↗
5. 105
   

   How Language Model Hallucinations Can Snowball

   Muru Zhang et al. · 2023

   Hacker News threads

   • May 2023How Language Model Hallucinations Can Snowball
   • May 2023A Logic for Expressing Transformers
   • Sep 2025An LLM is a lossy encyclopedia
   • Dec 2025Project Vend: Phase Two

   arXiv ↗
6. 106
   

   SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

   Tim Dettmers et al. · 2023

   Hacker News threads

   • Jun 2023SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
   • Jun 2023LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
   • Sep 2023ROCm Is AMD's #1 Priority, Executive Says
   • Mar 2024Fine tune a 70B language model at home

   arXiv ↗
7. 107
   

   In-Context Learning Creates Task Vectors

   Roee Hendel et al. · 2023

   Hacker News threads

   • Oct 2023In-Context Learning Creates Task Vectors
   • Oct 2023LLMs playing chess are sensitive to how the position came to be
   • Nov 2024Task Vectors [in Vision and Language Models (VLM's)] Are Cross-Modal
   • Dec 2025Ask HN: How can I get better at using AI for programming?

   arXiv ↗
8. 108
   

   Scaling Laws for Generative Mixed-Modal Language Models

   Armen Aghajanyan et al. · 2023

   Hacker News threads

   • Feb 2023Planning for AGI and Beyond
   • Mar 2023Google Releases Paper on Embodied LLM (562b parameters)
   • Apr 2025Liquid: Language models are scalable and unified multi-modal generators

   arXiv ↗
9. 109
   

   Tracr: Compiled Transformers as a Laboratory for Interpretability

   David Lindner et al. · 2023

   Hacker News threads

   • Feb 2023Why Can't Little Chatty Do Math?
   • Sep 2023I made a transformer by hand (no training)
   • Dec 2023Phi-2: The surprising power of small language models

   arXiv ↗
10. 110
    

    G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

    Yang Liu et al. · 2023

    Hacker News threads

    • Jun 2023The Darwinian argument for worrying about AI
    • Dec 2024Garvata: Observability and Debugging for AI Agent Stack
    • May 2025Positional preferences, order effects, prompt sensitivity undermine AI judgments

    arXiv ↗
11. 111
    

    Visual Instruction Tuning

    Haotian Liu et al. · 2023

    Hacker News threads

    • Dec 2023Vowels and Diphthongs in Sperm Whales
    • Apr 2024Suggest HN: Rabbit r1 AI device for blind or visually impaired people?
    • May 2024PaliGemma: Open-Source Multimodal Model by Google

    arXiv ↗
12. 112
    

    Simple and Controllable Music Generation

    Jade Copet et al. · 2023

    Hacker News threads

    • Jun 2023MusicGen-Looper: Generate fixed-bpm loops from text prompts
    • Mar 2025Show HN: Sonauto API – Generative music for developers
    • Oct 2025Should LLMs just treat text content as an image?

    arXiv ↗
13. 113
    

    Efficient Guided Generation for Large Language Models

    Brandon T. Willard, Rémi Louf · 2023

    Hacker News threads

    • Aug 2023Show HN: LLMs can generate valid JSON 100% of the time
    • May 2024Mistral Fine-Tune
    • Jan 2026LLM Structured Outputs Handbook

    arXiv ↗
14. 114
    

    Emergent Linear Representations in World Models of Self-Supervised Sequence Models

    Neel Nanda et al. · 2023

    Hacker News threads

    • Jul 2024Large models of what? Mistaking engineering achievements for linguistic agency
    • Nov 2024Evaluating the world model implicit in a generative model
    • Dec 2024Alignment faking in large language models

    arXiv ↗

Data from the Hacker News archive (ODC-By), arXiv and OpenAlex. Not affiliated with Hacker News or Y Combinator.