Gemma
Free while signed in. Answers cite the passages they came from.
Google DeepMind releases Gemma, a family of open models (2B and 7B) built from the same research stack as Gemini and shipped with both base and instruction-tuned variants.
Model sizes: Gemma 2B trained on 2T tokens and Gemma 7B trained on 6T tokens, both with an 8192-token context window and open weights.
Beats similar-sized peers: Gemma 7B generally outperforms Llama 2 7B and Mistral 7B on the standard Open LLM Leaderboard tasks (reasoning, math, code, knowledge).
Instruction variants: Instruction-tuned versions use supervised fine-tuning plus RLHF and are designed to be drop-in friendly via Hugging Face, Keras, JAX, and PyTorch.
Responsible release: Ships with a responsible-use toolkit, safety classifiers, and debugging utilities - an explicit answer to growing scrutiny of open-weight release practices.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack