AI Papers of the Week
Every paper worth reading in AI, hand-picked one week at a time.
CogAgent
Tsinghua's CogAgent is an 18B-parameter visual-language model purpose-built for GUI understanding and navigation, with unusually high input resolution.
From Gemini to Q-Star
A 300+-paper survey mapping the state of Generative AI and the research frontiers that followed the Gemini + rumored Q* news cycle.
PromptBench
A unified library for comprehensive evaluation and analysis of LLMs that consolidates multiple evaluation concerns under one roof.
Exploiting Novel GPT-4 APIs
A red-team study of three newer GPT-4 API surfaces - fine-tuning, function calling, and knowledge retrieval - that reveals each introduces new attack vectors.
Fact Recalling in LLMs
A mechanistic-interpretability study showing that early MLP layers function as a lookup table for factual recall.
Generative AI for Math (OpenWebMath / MathPile)
Releases a diverse, high-quality math-centric corpus of ~9.5B tokens designed for training math-capable foundation models.
Principled Instructions Are All You Need
Distills effective LLM prompting into 26 guiding principles and validates them across multiple model families.
Survey of Reasoning with Foundation Models
A comprehensive survey of reasoning with foundation models, covering tasks, methods, benchmarks, and future directions.
LLaRA
LLaRA adapts a decoder-only LLM for dense retrieval via two tailored pretext tasks that leverage text embeddings from the LLM itself.
Gemini vs GPT-4V
A qualitative side-by-side comparison of Gemini and GPT-4V across vision-language tasks, documenting systematic behavioral differences.
Gemini's Language Abilities
CMU's impartial, reproducible evaluation of Gemini Pro against GPT and Mixtral across standard LLM benchmarks.
PowerInfer
A high-speed LLM inference engine for consumer GPUs that exploits sparse neuron activation patterns to run large models on commodity hardware.
Antibiotic Discovery with Graph Deep Learning (Nature)
MIT researchers use explainable graph neural networks to discover a new structural class of antibiotics.
VideoPoet
Google Research's VideoPoet is a large language model for zero-shot video generation that treats video as just another token stream.
AppAgent
Introduces an LLM-based multimodal agent that operates real smartphone apps through touch actions and screenshots.
LLM in a Flash
Apple researchers show how to run LLMs larger than available DRAM by streaming weights from flash storage on demand.
ReST Meets ReAct
Proposes a ReAct-style agent that improves itself via reinforced self-training on its own reasoning traces.
Adversarial Attacks on GPT-4
Demonstrates that a trivially simple random-search procedure can jailbreak GPT-4 with high reliability.
RAG for LLMs
A broad survey of Retrieval-Augmented Generation research, organizing the rapidly growing literature into a coherent map.
BabyLLM Challenge Findings
Reports results from a challenge on sample-efficient pretraining using a developmentally plausible corpus.
FunSearch
DeepMind's FunSearch uses LLMs as a mutation operator in an evolutionary loop to discover genuinely new mathematical knowledge.
Weak-to-Strong Generalization
OpenAI's superalignment team shows that weak supervisors can still elicit capabilities from much stronger models - a first empirical signal for scalable oversight.
Audiobox
Meta's Audiobox is a unified flow-matching audio model that generates speech, sound effects, and music from natural-language and example prompts.
Mathematical LLMs Survey
A survey on the progress of LLMs on mathematical reasoning tasks, covering methods, benchmarks, and open problems.