Fact-Checking with LLMs

Contextual information helps: LLMs perform significantly better at fact-checking when equipped with retrieved evidence, validating the RAG pattern for claim verification.

GPT-4 > GPT-3: GPT-4 shows meaningful accuracy gains over GPT-3 for fact-checking, but both struggle without supporting context.

Multilingual variance: Accuracy varies substantially by query language and claim veracity, exposing persistent language-equity gaps in fact-checking.

Inconsistent reliability: While LLMs show real fact-checking promise, their accuracy is inconsistent enough that they can't replace human fact-checkers - useful as assistants, not arbiters.