Improvisational Games as a Benchmark for Social Intelligence of AI Agents: The Case of Connections

“Researchers introduce Connections, an improvisational wordplay game that benchmarks AI agents' social intelligence beyond traditional metrics. The game tests language models' ability to combine knowledge retrieval, summarization, and understanding of other agents' cognitive states, offering a more nuanced evaluation framework for AI reasoning capabilities.”