Alleged AI voice imitation leads to arrest in Baltimore school racism controversy

On Thursday, Baltimore County Police arrested Pikesville High School's former athletic director, Dazhon Darien, and charged him with using AI to impersonate Principal Eric Eiswert, according to a report by The Baltimore Banner. Police say Darien used AI voice synthesis software to simulate Eiswert's voice, leading the public to believe the principal made racist and antisemitic comments.

The audio clip, posted on a popular Instagram account, contained offensive remarks about "ungrateful Black kids" and their academic performance, as well as a threat to "join the other side" if the speaker received one more complaint from "one more Jew in this community." The recording also mentioned names of staff members, including Darien's nickname "DJ," suggesting they should not have been hired or should be removed "one way or another."

The comments led to significant uproar from students, faculty, and the wider community, many of whom initially believed the principal had actually made the comments. A Pikesville High School teacher named Shaena Ravenell reportedly played a large role in disseminating the audio. While she has not been charged, police indicated that she forwarded the controversial email to a student known for their ability to quickly spread information through social media. This student then escalated the audio's reach, which included sharing it with the media and the NAACP.

Baltimore County Police say that Darien had accessed school networks to search for and utilize AI tools capable of voice imitation. Police also linked Darien to an email account used to distribute the fake recordings.

Voice-cloning technology, which we have covered in the past, can generate realistic speech after being trained on millions of human voices, then tuned to match a specific voice in a provided sample. In March, Baltimore Banner reporters spoke with Siwei Lyu, the director of a media forensics lab at the University at Buffalo. Lyu told the newspaper that he believed the falsified clip of Eiswert speaking was created using a voice synthesis service such as ElevenLabs. ElevenLabs allows users to upload voice samples of people for cloning using text-to-speech synthesis, although its terms of service prohibit cloning a voice without the person's permission.

The incident has led to Eiswert being absent from the school since the investigation began, and he has denied making the comments, stating that they do not align with his views. “I did not make this statement, and these thoughts are not what I believe in as both an educator and a person,” Eiswert said in a written statement.

When the audio clip emerged in January, Superintendent Myriam Rogers called the comments "disturbing" and "highly offensive and inappropriate." The Baltimore Banner notes that Billy Burke, head of the union representing Eiswert, was the only official to publicly suggest the audio was AI-generated. He expressed disappointment in the public's assumption of Eiswert's guilt and revealed that the principal and his family had been harassed and threatened, requiring police presence at their home.

This isn't the first time that AI voice-cloning software has caused trouble. We've previously covered phone scams where someone imitates a loved one's voice (in an attempt to trick people into giving them money) and election campaign robocalls that use cloned voices of famous politicians like Joe Biden. In March, OpenAI revealed the existence of its own voice-cloning technology, but the company said it was holding it back for now due to misuse concerns.

Alleged AI voice imitation leads to arrest in Baltimore school racism controversy

Alleged AI voice imitation leads to arrest in Baltimore school racism controversy

Alleged AI voice imitation leads to arrest in Baltimore school racism controversy

Alleged AI voice imitation leads to arrest in Baltimore school racism controversy

Alleged AI voice imitation leads to arrest in Baltimore school racism controversy