Stony Brook University and Columbia researchers discover that the New York Times word game Connections can serve as a challenging benchmark for training Large Language Models in abstract reasoning.

Stony Brook, NY, Nov 1, 2024 - While AI and machine learning regularly beat the world’s greatest chess players, a recent study found that when it comes to the New York Times Connections, even the best-performing Large Learning Model (LLM), Claude 3.5 Sonnect, can fully solve only 18% of the games.

From using the New York Times Connections word game to decoding the basics of language and cognition, AI researchers from Stony Brook University present their out-of-the-box approaches at this year's EMNLP conference on how we can improve machines’ understanding of human language.

Artificial Intelligence (AI) tools like ChatGPT and Google Gemini are transforming how content is created, and creating new problems around privacy and truth. At the same time, these tools can be incredibly useful in compiling information and drafting messages.

A group of Stony Brook students this spring took a close look at potential benefits and risks of using AI tools, particularly as they could enhance or hinder advocacy efforts for social causes. The students created a guide for advocacy groups that will help those groups consider how, when or if to use AI in their work.