305
submitted 1 year ago by [email protected] to c/[email protected]

A very NSFW website called Pornpen.ai is churning out an endless stream of graphic, AI-generated porn. We have mixed feelings.

you are viewing a single comment's thread
view the rest of the comments
[-] [email protected] 3 points 1 year ago

Aren't AI generated images pretty obvious to detect from noise analysis? I know there's no effective detection for AI generated text, and not that there won't be projects to train AI to generate perfectly realistic images, but it'll be a while before it does fingers right, let alone invisible pixel artifacts.

As a counterpoint, won't the prevalence of AI generated CSAM collapse the organized abuse groups, since they rely on the funding from pedos? If genuine abuse material is swamped out by AI generated imagery, that would effectively collapse an entire dark web market. Not that it would end abuse, but it would at least undercut the financial motive, which is progress.

That's pretty good for 2023.

[-] [email protected] 2 points 1 year ago

With StableDiffusion you can intentionally leave an "invisible watermark" that machines can easily detect but humans cannot see. The idea being that in the future you don't accidentally train on already AI generated images. I'd hope most sites are doing that but it can be turned off easily enough. Apart from that I'm not sure.

[-] [email protected] 1 points 1 year ago

I could have sworn I saw an article talking about how there were noise artifacts that were fairly obvious, but now I can't turn anything up. The watermark should help things, but outside of that it looks like there's just a training dataset of pure generative AI images (GenImage) to train another AI to detect generated images. I guess we'll see what happens with that.

this post was submitted on 23 Sep 2023
305 points (94.5% liked)

Technology

58164 readers
3951 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS