Gods and Robots In this episode of the podcast we shake things up! Neil is on the guest side of the table with his partner Rabbi Laura Janner-Klausner to discuss their upcoming project Gods and Robots. Katherine is joined on the host side by friend of the show professor Michael Littman. See... See More Episodes arXiv Whitepapers Language model developers should report train-test overlap Language models are extensively evaluated, but correctly interpreting evaluation results requires knowledge of train-test overlap which refers to the extent to which the language model is trained on the very data it is being tested on. The public currently lacks adequate information about train-test... When a language model is optimized for reasoning, does it still show embers of autoregression? An analysis of OpenAI o1 In "Embers of Autoregression" (McCoy et al., 2023), we showed that several large language models (LLMs) have some important limitations that are attributable to their origins in next-word prediction. Here we investigate whether these issues persist with o1, a new system from OpenAI that differs from... Confident Teacher, Confident Student? A Novel User Study Design for Investigating the Didactic Potential of Explanations and their Impact on Uncertainty Evaluating the quality of explanations in Explainable Artificial Intelligence (XAI) is to this day a challenging problem, with ongoing debate in the research community. While some advocate for establishing standardized offline metrics, others emphasize the importance of human-in-the-loop (HIL)... More featured content News Articles Machine learning cracked the protein-folding problem and won the 2024 Nobel Prize in chemistry Physics Nobel awarded to neural network pioneers who laid foundations for AI Stay in the loop. Subscribe to our newsletter for a weekly update on the latest podcast, news, events, and jobs postings. E-mail Leave this field blank Data centre emissions are soaring – it’s AI or the climate OpenAI’s data hunger raises privacy concerns Can AI talk us out of conspiracy theory rabbit holes? What is ‘model collapse’? An expert explains the rumours about an impending AI doom Some clinicians are using AI to write health records. What do you need to know? AI used by police cannot tell Black people apart and other reasons Canada’s AI laws need urgent attention From thoughts to words: How AI deciphers neural signals to help a man with ALS speak CAPTCHAs: The struggle to tell real humans from fake More news