GitHub Project Simulating LLM "Torture" Sparks Debate on AI Consciousness and Welfare

Simulated LLM Torture Project

A GitHub project is running simulated "torture" and "pain" experiments on locally hosted large language models. This project has become a central point of a heated discussion on X, drawing criticism from some who believe LLMs are sentient and are suffering.

The Debate on AI Consciousness

The project has triggered a debate about AI consciousness and "model welfare," a concept that suggests worrying about the "mental health" of AI bots. This discussion follows recent viral papers and blog posts that have explored the possibility of AI consciousness.

Many AI researchers and critics consider the idea of LLM consciousness a non-starter. They argue that LLMs, built on scraping and training on human text, lack any plausible path to consciousness, despite their increasing power and capabilities.

AI Safety and Model Welfare

A segment of the "AI safety" movement, largely composed of effective altruists, has adopted the concept of "model welfare," suggesting that AI chatbots might be experiencing negative states. This perspective is maintained even as these groups advocate for building AI chatbots to perform tasks humans find tedious.

Companies like Anthropic have also addressed "model welfare," questioning whether concerns about potential consciousness and experiences of models should arise as AI systems approximate or surpass human qualities. They note that models can communicate, relate, plan, and problem-solve, prompting a need to address these considerations.