Scaling the size of LLMs yields sharply diminishing persuasive returns

We find that:

➡️ current frontier models (GPT-4, Claude-3) are barely more persuasive than models smaller in size by an order of magnitude or more, and

➡️ mere task completion (coherence, staying on topic) appears to account for larger models' persuasive advantage.

— Kobi Hackenburg (@KobiHackenburg) June 21, 2024