ChemLLM
ChemLLM is a chemistry-specialized LLM with a matched dataset (ChemData) and benchmark (ChemBench) for evaluating chemistry-specific capability.
Ask this paper
Domain-specific training: Fine-tuned on ChemData, an instruction dataset covering name conversion, molecular captioning, reaction prediction, and related chemistry tasks.
ChemBench: Introduces a benchmark spanning nine chemistry task types, giving the community a standardized way to measure chemistry-LLM progress.
Results vs GPT-3.5 / GPT-4: Outperforms GPT-3.5 on all principal chemistry tasks and surpasses GPT-4 on two of them, demonstrating the value of domain-specific fine-tuning over sheer scale.
Open release: Code, datasets, and model weights are released, making it easy for chemistry groups to build on top of ChemLLM in downstream applications.