Code · Training

CodeT5+

First page

Paper summary

An open code LLM family for code understanding and generation.

Ask this paper

Key points

Flexible architecture: Supports encoder-only, decoder-only, and encoder-decoder modes to handle diverse code tasks.

20-benchmark evaluation: Tested on 20 code-related benchmarks across zero-shot, fine-tuning, and instruction tuning.

SOTA on multiple tasks: Achieves SOTA on code completion, math programming, and text-to-code retrieval.

Training efficiency: Uses multiple training objectives combined to improve efficacy and compute efficiency.

Every Monday