Blog
News, updates, and editorials from our DSRI expert researchers.
Bridging Safety Research and Safety Application
Fri Jul 26 2024
To help create safer digital products for people around the world, the Digital Safety Research Institute (DSRI) of UL Research Institutes is excited to announce a research collaboration with The Allen Institute for Artificial Intelligence (Ai2). DSRI and Ai2 will collaborate on scientific research to advance the current state of large language model (LLM) safety evaluation practices.
Learning from the Past – The AI Incident Database
Tue Mar 05 2024
The Digital Safety Research Institutes (DSRI) of UL Research Institutes is thrilled to announce our partnership with TheCollab to continue developing and maintaining the AI Incident Database (AIID). DSRI views the AIID as a crucial first step in mitigating the harms of AI systems.
How to Understand Large Language Models through Improv
Tue Mar 28 2023
On February 16th, the New York Times published Kevin Roose's conversation with Microsoft's chatbot wherein the chatbot attempted to end Mr. Roose's marriage. A deeper examination of the chatlog reveals the bot conformed to technical intuition not broadly shared by people outside the machine learning engineering community.
Is your AI a "Clever Hans"?
Fri Feb 17 2023
What a counting horse can teach us about evaluating AI tools and systems. Clever Hans, the horse mathematician, was a worldwide sensation in 1904. With skill comparable to a human grade schooler, the horse solved basic arithmetic problems. “Ten minus six?” His owner would ask. ”stamp, stamp, stamp, stamp”. Clever Hans would stamp the ground four times to give his answer.