A Survey on Data Synthesis and Augmentation for LLMs
First page
Paper summary
provides a comprehensive summary of data generation techniques in the lifecycle of LLMs; includes discussions on data preparation, pre-training, fine-tuning, instruction-tuning, preference alignment, and applications.