Comprehensive Survey of Small Language Models
Figure 1
The curator’s take
This survey provides a comprehensive overview of Small Language Models (SLMs), which address key LLM limitations including high computational demands, privacy concerns from cloud APIs, and poor performance on edge devices. The authors propose a standardized SLM definition based on specialized task capability and resource-constrained suitability, and develop taxonomies and frameworks for SLM acquisition, enhancement, application, and reliability.