🚀NEW COURSEVibe Coding AI Apps with Claude Code 🤖✨Enroll now
← All papersIssue 30 of 176

The week of Oct 23 – Oct 29, 2023

10 papers, hand-picked and summarised.

Zephyr

Zephyr

Hugging Face's Zephyr-7B is a 7B parameter LLM whose chat performance rivals much larger chat models aligned with human feedback.

01Reinforcement Learning
Fact-Checking with LLMs

Fact-Checking with LLMs

Investigates the fact-checking capabilities of frontier LLMs across multiple languages and claim types.

02Retrieval
Matryoshka Diffusion Models

Matryoshka Diffusion Models

Apple introduces an end-to-end framework for high-resolution image and video synthesis that denoises across multiple resolutions jointly.

03Multimodal
Spectron

Spectron

Google's Spectron is a spoken-language model trained end-to-end on raw spectrograms rather than text or discrete audio tokens.

04Multimodal
LLMs Meet New Knowledge

LLMs Meet New Knowledge

A benchmark that evaluates how well LLMs handle new knowledge beyond their training cutoff.

05Evaluation
Min-K% Prob (Detecting Pretraining Data)

Min-K% Prob (Detecting Pretraining Data)

Proposes Min-K% Prob as an effective detection method for determining whether specific text was in an LLM's pretraining data.

06Training
ConvNets Match Vision Transformers

ConvNets Match Vision Transformers

DeepMind shows that strong ConvNet architectures pretrained at scale match ViTs on ImageNet performance at comparable compute.

07Training
CommonCanvas

CommonCanvas

Releases CommonCanvas, a text-to-image dataset composed entirely of Creative-Commons-licensed images.

08Data
Managing AI Risks (Bengio, Hinton, et al.)

Managing AI Risks (Bengio, Hinton, et al.)

A high-profile position paper by leading AI researchers laying out risks from upcoming advanced AI systems.

09Safety
Branch-Solve-Merge (BSM)

Branch-Solve-Merge (BSM)

BSM decomposes LLM tasks into parallel sub-tasks via three LLM-programmed modules: branch, solve, and merge.

10Agents
Every Monday
Get next week’s papers.

The same picks and the same summaries, in your inbox. Free, and 176 issues deep.

Subscribe on Substack