Excited to share our new preprint: “LLM Ethics Benchmark” Our team at UIL-UT Austin has developed an evaluation system based on a three-dimensional framework for evaluating moral reasoning in large language models.LLM Ethics Benchmark uniquely evaluates LLMs across: đź“ś Foundational moral principles 🔍 Reasoning robustness 🧩 Value consistency. This enables precise identification of ethical strengths […]
News and updates
Recap: NRT Ethical AI Talk Series – “Societal Impact of Language Models: Harm Analysis and Reduction” with Dr. Aylin Caliskan
We were honored to host the fourth installment of our NRT Ethical AI Talk Series, featuring Dr. Aylin Caliskan, Assistant Professor at the University of Washington’s Information School. Her thought-provoking session, “Societal Impact of Language Models: Harm Analysis and Reduction,” examined the ethical challenges and unintended consequences of large-scale language models (LLMs). Dr. Caliskan explored how biases embedded in […]
Recap: NRT Ethical AI Talk Series – “Transparency and Explainable AI” with Dr. Robert Clements
We were thrilled to host the third session of our NRT Ethical AI Talk Series, featuring Dr. Robert Clements, who explored the critical role of Explainable AI (XAI) in ensuring transparency and trust in AI systems. Dr. Clements delved into why interpretability matters in AI decision-making, especially in high-stakes fields like healthcare, finance, and criminal justice. He highlighted how black-box models can lead […]
Recap of the Ethical AI Talk Series Lecture: “AI as a Problem of Public Health Ethics”
On October 25, 2024, we hosted the second session in our Ethical AI Talk Series, featuring Dr. Jonathan Beever, PhD, from the UCF Center for Ethics at the University of Central Florida. His talk, titled “AI as a Problem of Public Health Ethics,” explored the intersection of artificial intelligence and public health, shedding light on […]
NRT Fellow Receives Second Top Poster Award at Annual Meeting
We are excited to share that Haley Triem, one of our talented NRT students, has been awarded the Second Top Poster at the NSF NRT Annual Meeting. Her research presentation, “Tipping the Balance: Human Intervention in Large Language Model Multiagent Debate,” was recognized for its innovative exploration of the role of human intervention in AI […]