AI Voice Cloning and Its Misuse Has Opened a Pandoras Box of Legal Issues: Heres What to Know

From these millions of speech examples, the AI can modify the basic word sounds to reflect intonation, stress, and rhythm, making the sounds seem more natural and holistic. The researchers examined the key differences between real and fake voices. These perceptual cues often make synthetic voices sound unnatural or ‘off’, and thus, distinguishable from real speech. Romit Barua, Machine Learning Engineer and Researcher from UC Berkeley explains that voice cloning involves leveraging advancements in audio signal processing and neural network technologies to replicate a person’s voice. But it is not just elections that can be affected but voice cloning technology or deepfakes. Fraudulent extortion scams via impersonating AI are also a growing concern.

How Hedra voice cloning works

Out of frustration and a tiny bit of curiosity, I finally decided to click the “AI Help” button. This kind of misrepresentation is illegal, and the voice service provider has agreed to pay $1 million to the government in fines. In addition, the political operative who set up the scam is facing a court case that could result in him owing $6 million to the government. A real text-to-speech computer-synthesized voice gave physicist Stephen Hawking his actual voice. That was built using a 1986 desktop computer fastened to his wheelchair.

Meet the world’s best programmer: A Polish man who beat ChatGPT

The Basic premium plan allows for 20 minutes of video a month, videos up to 1 minute long and the voice cloning function with no watermark. Some AI voice generators then personalize the output further, adjusting pitch and tone to represent different voices and even applying accents that reflect speech coming from a particular region. Right now, that’s beyond ChatGPT’s smartphone app, but you can ask Siri and Alexa to use different voices or voices from various regions. In January, a voice service telecom provider made thousands of fraudulent robocalls using an AI-generated voice sounding like President Joe Biden. The voice told voters that if they voted in the state’s then-upcoming primary, they wouldn’t be allowed to vote in the November general election. In April, we saw some real-world examples of next-gen AI scams that are quite frightening.

• Employees, though, might start to feel the pinch, or start moving to parts of the job that tech can’t yet replicate, like solving problems, connecting with people, or hopping in when the system makes a mistake.
• Alongside people like Bogdan, we have people like Roger Anderson making ChatGPT-powered bots to mess with telemarketers.
• The first task for voice cloners is to click on the New Voice button in the first panel, and record their voice in the clone voice box.
• These artifacts, although not always perceptible to the human ear, can be detected through analysis, similar to how MP3 compression removes certain frequencies to reduce file size.
• Always obtain clear and explicit consent from individuals whose voices are being cloned.

What features make cloned voices convincing?

The US Federal Communications Commission (FCC), as a result, banned AI-generated robocalls last month. Voice cloning AI technology is not new and has already been used under concerning circumstances. As a business owner, you might feel like AI will boost your workers’ productivity while reducing costs, but you’ll also need to keep an eye out on issues of privacy, trust, and training. You may want to start hiring people who have higher levels of judgment, empathy, and communication to be able to work with your new AI systems. Gev Balyan, CEO of Hoory AI says, “Startups and solopreneurs now have an always-on assistant — answering calls, qualifying leads, booking — at enterprise scale, without enterprise cost.”

Technology News

Siri, when it first hit the market in 2011, was amazing in terms of what it could do. I was recently dumped into an AI when I needed to solve a technical problem. I’d already filed a help ticket — and waited a week for a fairly unhelpful response.