AI Papers of the Week
Every paper worth reading in AI, hand-picked one week at a time.
Fast Inference of Mixture-of-Experts
Achieves practical Mixtral-8x7B inference on consumer hardware through MoE-aware quantization and offloading.
SeeAct (GPT-4V as Generalist Web Agent)
OSU researchers adapt GPT-4V into SeeAct, a generalist agent that operates live websites using vision + language planning.
DocLLM
JPMorgan's DocLLM is a lightweight extension to LLMs for visual-document understanding that uses bounding-box spatial information rather than image pixels.
How Code Empowers LLMs
A survey on why training LLMs with code data produces capabilities well beyond coding itself.
Instruct-Imagen
Google's Instruct-Imagen is a multimodal instruction-tuned image generation model that generalizes across heterogeneous generation tasks, including unseen ones.
CogAgent
Tsinghua's CogAgent is an 18B-parameter visual-language model purpose-built for GUI understanding and navigation, with unusually high input resolution.
From Gemini to Q-Star
A 300+-paper survey mapping the state of Generative AI and the research frontiers that followed the Gemini + rumored Q* news cycle.
PromptBench
A unified library for comprehensive evaluation and analysis of LLMs that consolidates multiple evaluation concerns under one roof.
Exploiting Novel GPT-4 APIs
A red-team study of three newer GPT-4 API surfaces - fine-tuning, function calling, and knowledge retrieval - that reveals each introduces new attack vectors.
Fact Recalling in LLMs
A mechanistic-interpretability study showing that early MLP layers function as a lookup table for factual recall.
Generative AI for Math (OpenWebMath / MathPile)
Releases a diverse, high-quality math-centric corpus of ~9.5B tokens designed for training math-capable foundation models.
Principled Instructions Are All You Need
Distills effective LLM prompting into 26 guiding principles and validates them across multiple model families.
Survey of Reasoning with Foundation Models
A comprehensive survey of reasoning with foundation models, covering tasks, methods, benchmarks, and future directions.
LLaRA
LLaRA adapts a decoder-only LLM for dense retrieval via two tailored pretext tasks that leverage text embeddings from the LLM itself.
Gemini vs GPT-4V
A qualitative side-by-side comparison of Gemini and GPT-4V across vision-language tasks, documenting systematic behavioral differences.
Gemini's Language Abilities
CMU's impartial, reproducible evaluation of Gemini Pro against GPT and Mixtral across standard LLM benchmarks.
PowerInfer
A high-speed LLM inference engine for consumer GPUs that exploits sparse neuron activation patterns to run large models on commodity hardware.
Antibiotic Discovery with Graph Deep Learning (Nature)
MIT researchers use explainable graph neural networks to discover a new structural class of antibiotics.
VideoPoet
Google Research's VideoPoet is a large language model for zero-shot video generation that treats video as just another token stream.
AppAgent
Introduces an LLM-based multimodal agent that operates real smartphone apps through touch actions and screenshots.
LLM in a Flash
Apple researchers show how to run LLMs larger than available DRAM by streaming weights from flash storage on demand.
ReST Meets ReAct
Proposes a ReAct-style agent that improves itself via reinforced self-training on its own reasoning traces.
Adversarial Attacks on GPT-4
Demonstrates that a trivially simple random-search procedure can jailbreak GPT-4 with high reliability.
RAG for LLMs
A broad survey of Retrieval-Augmented Generation research, organizing the rapidly growing literature into a coherent map.