this post was submitted on 15 Sep 2023
725 points (97.1% liked)

Harry Potter

886 readers
7 users here now

founded 1 year ago
MODERATORS
 

LINK (archive.ph)


AI may be a buzzword on Wall Street, but on the West Coast it’s at the center of Hollywood’s biggest labor dispute in more than 50 years. Among those warning about the technology’s potential to cause harm is British actor and author Stephen Fry, who told an audience at the CogX Festival in London on Thursday about his personal experience of having his identity digitally cloned without his permission.

“I’m a proud member of [actors’ union SAG-AFTRA], as you know we’ve been on strike for three months now. And one of the burning issues is AI,” he said.

Actors’ union SAG-AFTRA, which has around 160,000 members, went on strike last month over pay, working conditions, and concerns related to the use of AI in the film industry. It joined the Writers Guild of America—a union representing thousands of Hollywood writers—which went on strike in early May, marking the industry’s biggest shutdown in more than six decades.

A key sticking point for actors on strike is the possibility that studios could use AI to make digitally replicate their image without compensating them fairly for using their likeness.

Speaking at a news conference as the strike was announced, union president Fran Drescher said AI “poses an existential threat” to creative industries, and said actors needed protection from having “their identity and talent exploited without consent and pay.”

During his speech at CogX Festival on Thursday, Fry played a clip to the audience of an AI system mimicking his voice to narrate a historical documentary.

“I said not one word of that—it was a machine. Yes, it shocked me,” he said. “They used my reading of the seven volumes of the Harry Potter books, and from that dataset an AI of my voice was created and it made that new narration.”

Fry—who has appeared in movies including Gosford Park, V for Vendetta, and The Hitchhiker’s Guide to the Galaxy—is the narrator of the British Harry Potter audiobooks, while actor Jim Dale narrated the American version of the series.

“What you heard was not the result of a mash up, this is from a flexible artificial voice, where the words are modulated to fit the meaning of each sentence,” Fry told the audience at CogX Festival on Thursday.

“It could therefore have me read anything from a call to storm parliament to hard porn, all without my knowledge and without my permission. And this, what you just heard, was done without my knowledge. So I heard about this, I sent it to my agents on both sides of the Atlantic, and they went ballistic—they had no idea such a thing was possible.”

Fry added that when he discovered his voice was being used in projects without his consent, he saw it as just the beginning of an emerging threat to creative talent, warning his angry agents: “You ain’t seen nothing yet.” “This is audio,” he said he told them. “It won’t be long until full deepfake videos are just as convincing.”

As AI technology has advanced, doctored footage of celebrities and world leaders—known as deepfakes—has been circulating with increasing frequency, prompting warnings from experts about artificial intelligence risks. Fry warned on Thursday that those technologies only had further to go.

“We have to think about [AI] like the first automobile: impressive but not the finished article,” he said, noting that when cars were invented no one could have envisioned how widespread they are today.

“Tech is not a noun, it is a verb, it is always moving,” he said. “What we have now is not what will be. When it comes to AI models, what we have now will advance at a faster rate than any technology we have ever seen. One thing we can all agree on: it’s a f***ing weird time to be alive.”

Not the first

Fry isn’t the only famous actor to publicly vocalize their concerns about AI and its place in the film industry.

At a U.K. rally held in support of the SAG-AFTRA strike over the summer, Emmy-winning Succession star Brian Cox shared an anecdote about a friend in the industry who had been told “in no uncertain terms” that a studio would keep his image and do what they liked with it.

“That is a completely unacceptable position,” Cox said. “And that is the position that we should be really fighting against, because that is the worst aspect. The wages are one thing, but the worst aspect is the whole idea of AI and what AI can do to us.”

Oscar winner Matthew McConaughey told Salesforce CEO Marc Benioff during a panel event at this year’s Dreamforce conference that he had concerns about the rise of AI in Hollywood.

“We have a real chance, if we are irresponsible, of cannibalizing ourselves and creating this digital god that we’ll bow to, and we’ll all of a sudden become tools of this tool,” he said.

Meanwhile, Star Trek and Mission Impossible star Simon Pegg has called AI “worrying” for actors.

“We’re looking at being replaced in some ways,” he said at the rally in London in July. “We have to be compensated and we have to have some say in how [our image is] used. I don’t want to turn up in an advert for something I disagree with… I want to be able to hang on to my image, and voice, and know where it’s going.”

A spokesperson for the Alliance of Motion Picture and Television Producers (AMPTP), the entertainment industry’s official collective bargaining representative, was not available for comment when contacted by Fortune.

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 166 points 1 year ago (25 children)

The much, much, much more concerning aspect of voice cloning technology is that it will be used to scam people on a massive scale.

Imagine you get a call at 4am from a loved one who tells you that they are in an emergency situation and had to borrow a phone to call you. The beg you to venmo some money to a stranger's account so that they can get their car fixed/get a plane ticket/pay someone back for giving them a lift/etc.

You recognize your loved one's voice. They can respond to your questions (because chatbot AI). They know details about your life (because social media). It's the middle of the night. You're scared and not thinking clearly.

This technology all exists TODAY. In 10 or 20 years it'll be so terrifyingly sophisticated, even the most wary people will be vulnerable to it.

[–] [email protected] 62 points 1 year ago (2 children)

Easy solution, don't have any loved ones. Checkmate scam artists

[–] [email protected] 37 points 1 year ago (3 children)

"Hey it's ur son I've been arrested in Mexico"

"Well good then".

[–] [email protected] 10 points 1 year ago

My uncle was recently arrested in another state. We had a similar reaction.

load more comments (2 replies)
[–] [email protected] 7 points 1 year ago

Or if you do, make sure none of 'em are dumb enough to rely on "cash apps" like venmo. Even Zelle, through our bank is suspicious as shit.

[–] [email protected] 50 points 1 year ago (1 children)

That's why I do like Gilbert Gottfried and do two voices: one in public and one for friends and family.

It gets confusing when we dine outside.

[–] [email protected] 10 points 1 year ago* (last edited 1 year ago) (2 children)

😂 Wtf does that guy sound like at home? Posh mid Atlantic accent or some shit? I'm so curious now.

[–] [email protected] 12 points 1 year ago (1 children)
load more comments (1 replies)
[–] [email protected] 8 points 1 year ago

There's a Howard Stern clip of Gilberts "normal" voice on his voicemail.

[–] [email protected] 18 points 1 year ago

They can't get me if I live in a hole. Not a nasty, dirty, wet hole, filled with the ends of worms and an oozy smell, nor yet a dry, bare, sandy hole with nothing in it to sit down on or to eat: but a hobbit-hole, and that means comfort.

[–] [email protected] 15 points 1 year ago (3 children)

The solution that EVERYBODY needs to learn for something like that is to hang up and call them back using the contact you have in your phone. They can afford 10 seconds while you do that if they're calling you for money. And if it isn't them calling for money, well sorry for waking you up Frank, but an AI was posing as you asking for cash.

[–] [email protected] 10 points 1 year ago (5 children)

That and a family or per person verification word or protocol or something.

"Clumsy..."

"Draconiquist!"

load more comments (5 replies)
load more comments (2 replies)
[–] [email protected] 8 points 1 year ago

yet another reason to never answer the phone

[–] [email protected] 7 points 1 year ago

Ah, that'll be the equivalent scam for our age that spam emails are for the age before.

[–] [email protected] 6 points 1 year ago

Scam them out of what?

90% of the world will be unemployed and fighting for whatever scraps of food are grown between the constant flooding and fires we had 100 years to prevent but it wasn't profitable to.

We will have to learn to live entirely without factual information as every form of communication becomes hopelessly compromised by corporations, governments and billionaire extremists.

You won't even be able to trust the people you meet in meatspace. You think Fox News addicts are fucked up? Wait until every piece of entertainment is propaganda that's been personalised just for you.

And when it inevitably turns to war and you're put in charge of the big red button, will you even care if the order to press it has been deep faked by a death cult?

Unemployment and petty scams are small fry. With this technology, we can end the world.

load more comments (18 replies)
[–] [email protected] 49 points 1 year ago (11 children)

I'm not going to lie, the ability to have Stephen Fry narrate my daily schedule every morning is one of the things I am most excited for. Like, I understand why he's upset about a movie using his voice without his permission, but I didn't expect to get his permission for my thing, either.

[–] [email protected] 14 points 1 year ago (2 children)

I mean if he wants to make a fortune and also make people giddily happy... I'd totally pay for that. Or like Andy Serkis (whose narration of The Hobbit is a fucking masterpiece, by the way).

Probably couldn't afford it though.

[–] [email protected] 7 points 1 year ago (1 children)

Andy Serkis is such a good audiobook narrator. I loved his version of Terry Pratchett's Small Gods!

load more comments (1 replies)
load more comments (1 replies)
[–] [email protected] 8 points 1 year ago

I already have Siri be an English man so it kind of sounds like a butler. I would pay for it to sound like Stephen Fry. Or Michael Gough.

load more comments (9 replies)
[–] [email protected] 37 points 1 year ago (1 children)

There really needs to be a "right to identity" that companies can't pretend to be you without express permission on a per instance basis and roll it into fraud protection/identity theft laws.

[–] [email protected] 10 points 1 year ago (1 children)

Arguably, enumerating such rights in the first place mainly benefits the wealthy and corporations because once encapsulated, such "rights" can be bought and sold.

An established actor like Fry has a lot of leverage, and the union may win the recognition of those rights, but then that's just putting them on the negotiating table. What studio, trying to launch a film franchise, wouldn't get the exclusive Digital Identity Use Rights, in-perpetuity, solely for use in that character? Sure, RDJ is free to go make other movies and control how his image is otherwise used, but Marvel-Fox-Disney gets to keep making Iron Man content (starting the AI-replicated likeness) for all time. And if they want Iron Man to sell Big Macs, too fucking bad, shouldn't have sold your rights so cheap. Leverage he didn't have when Marvel was rebooting his career.

load more comments (1 replies)
[–] [email protected] 36 points 1 year ago (1 children)

Actors need to be able to trademark their image and audio likeness or corporations will puppeteer them for free. Forever.

[–] [email protected] 12 points 1 year ago (4 children)

I honestly think this is the way forward. Trademark the likeness, and studios can use the likeness while you get an upfront fee and royalties.

Everyone wins.

[–] [email protected] 9 points 1 year ago (1 children)

Expansion of copyright that way could set a very dangerous precedent and have unintended consequences.

For example, does that mean Trump, who was once part of SAG, can claim royalties every time SNL/late night talk show shows a clip of him saying dumb things? (I'm pretty sure one of these shows used a combination of impressionist/deepfake to mock him too, and you KNOW Trump is petty enough to actually do it)

[–] [email protected] 13 points 1 year ago* (last edited 1 year ago) (1 children)

Clips being used in such a way would fall under Fair Use and Parody, no?

You do raise a good point about knock-off effects, but things like "clip shows" and similar segments are generally protected by existing law.

Again, not a bad point overall, and definitely thought-provoking, but I think this one specific example has an "out."

load more comments (1 replies)
load more comments (3 replies)
[–] [email protected] 27 points 1 year ago (3 children)

David Attenborough documentaries for eternity!

[–] [email protected] 12 points 1 year ago

That will be AI Attenboro promoting fossil fuel interests camouflaged as environmentalism.

load more comments (1 replies)
[–] [email protected] 23 points 1 year ago* (last edited 1 year ago) (1 children)

Don't piss off Stephen Fry. You don't know what it's like to have a Cambridge-educated wit fighting against you.

EDIT: And you should watch this if you don't think so.

[–] [email protected] 10 points 1 year ago

I'd say it's not just his intelligence and presentation. There's a high level of bravery there. You never know how someone is going to react when you tell them their beliefs are suspect (or outright bullshit) and just saying this opens him up to derision or worse from any rando with a soapbox to stand on.

[–] [email protected] 19 points 1 year ago (1 children)

I will never pay for an AI audio book. Never. Why would I pay a book company when I can train my own AI voice clone?

Book publishers don't realize how hard they'll fuck themselves over if people realize how easy this is.

[–] [email protected] 15 points 1 year ago (5 children)

At that point, why not just pirate the audiobook? If it’s going to be AI anyway…

load more comments (5 replies)
[–] [email protected] 19 points 1 year ago (2 children)

Voice actor here. There's an ad on the radio that sent in an audition tape for. I keep hearing it and I'm pretty sure it's an AI voice. Thankfully it's awful. Unfortunately, only a few people will notice or even care.

[–] [email protected] 7 points 1 year ago (1 children)

It astounds me that people tolerate bad computer voices, i'm rather picky which real actual human voices i can tolerate listening to..

[–] [email protected] 7 points 1 year ago (1 children)

I hear AI voices on YT videos all the f'n time. It's monotonous, super consistent pauses, and not obvious until you listen for 30 secs or so.

load more comments (1 replies)
load more comments (1 replies)
[–] [email protected] 18 points 1 year ago (15 children)

Oh hell yeah it’s just the beginning. Go check out some popular twitch streamers, they have TTS of tons of celebs using their voices. Those idiots are gonna get sued so fucking fast once celebrities figure out computers

[–] [email protected] 15 points 1 year ago (3 children)

So never then?

Really hard to sue someone if you're just using sound bites, I doubt actors give zero shits about twitch streamers.

[–] [email protected] 9 points 1 year ago (3 children)

Oh I definitely think they’ll care. It’s using their likeness for their own personal gain, the actors will want some of that money

load more comments (3 replies)
load more comments (2 replies)
load more comments (14 replies)
[–] [email protected] 12 points 1 year ago (1 children)

What we're talking about is not so much AI itself but who owns the data set that the AI is created and trained with?

Individuals should own the right to themselves, but if they want to sell it as a data set, then so be it.

They can have restrictions as to how the AI that uses their data set to be created can be used and for what purposes.

[–] [email protected] 8 points 1 year ago* (last edited 1 year ago) (1 children)

I disagree with this because companies will start enforcing a "if you wish to work for us you must give the ability to use your data set including after termination and etc with no further compensation". This needs to be strictly a per individual per instance basis preferably requiring the person who owns it be the primary sale person included in the transaction.

load more comments (1 replies)
[–] [email protected] 7 points 1 year ago (1 children)

There are going to be some laws hastily passed for this that is going to put impressionists out of the job. If it is Rich Little or and AI impersonating Howard Cosell, how is it any different?

load more comments (1 replies)
load more comments
view more: next ›