this post was submitted on 23 Aug 2024
2 points (100.0% liked)

TechTakes

1435 readers
120 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago
MODERATORS
[email protected]
2
Copilot AI calls journalist a child abuser, Microsoft tries to launder responsibility (pivot-to-ai.com)
submitted 3 months ago* (last edited 3 months ago) by [email protected] to c/[email protected]
10 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 0 points 3 months ago (8 children)

Copilot then listed a string of crimes Bernklau had supposedly committed — saying that he was an abusive undertaker exploiting widows, a child abuser, an escaped criminal mental patient. [SWR, in German]

These were stories Bernklau had written about. Copilot produced text as if he was the subject. Then Copilot returned Bernklau’s phone number and address!

and there’s fucking nothing in place to prevent this utterly obvious failure case, other than if you complain Microsoft will just lazily regex for your name in the result and refuse to return anything if it appears

[–] [email protected] 0 points 3 months ago (1 children)

it helps they did it to someone with contacts and it was on prime time news telly

[–] [email protected] 0 points 3 months ago (1 children)

god, so this is actually the best the AI researchers can do with the tools they’ve shit out into the world without giving any thought to failure cases or legal liability (beyond their manager on ~~slack~~Teams claiming it’s been taken care of)

so fuck it, let’s make the defamation machine a non-optional component of windows. we’ll just make it a P0 when someone who could actually get us in legal trouble complains! everyone else is a P2 that never gets assigned.

[–] [email protected] 0 points 3 months ago (1 children)

so this is actually the best the AI researchers can do

Highly unlikely. This is what corporation's public facing products can do.

[–] [email protected] 0 points 3 months ago (1 children)

are there mechanisms known to researchers that Microsoft’s not using that can prevent this type of failure case in an LLM without resorting to whack-a-mole with a regex?

[–] [email protected] 0 points 3 months ago (1 children)

Yeah there's already a lot of this in play.

You run the same query multiple times through multiple models and do a web search looking for conflicting data.

I've had copilot answer a query, then erase the output and tell me it couldn't answer it after about 5 seconds.

I've also seen responses contradict themselves later paragraphs saying there are other points of view.

It would be a simple matter to have it summarize the output it's about to give you and dump the output of it paints the subject in a negative light.

[–] [email protected] 1 points 3 months ago

It would be a simple matter to have it summarize the output it's about to give you and dump the output of it paints the subject in a negative light.

lol. like that’s a fix

(Hindenburg, hitler, great depression, ronald reagan, stalin, modi, putin, decades of north korea life, …)

load more comments (6 replies)