this post was submitted on 12 Jan 2025
659 points (98.0% liked)

Technology

60469 readers
4450 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
659
VLC player demos real-time AI subtitling for videos (www.theverge.com)
submitted 2 days ago* (last edited 2 days ago) by [email protected] to c/[email protected]
113 comments fedilink hide all child comments
 

cross-posted from: https://lemmy.ca/post/37011397

[email protected]

The popular open-source VLC video player was demonstrated on the floor of CES 2025 with automatic AI subtitling and translation, generated locally and offline in real time. Parent organization VideoLAN shared a video on Tuesday in which president Jean-Baptiste Kempf shows off the new feature, which uses open-source AI models to generate subtitles for videos in several languages. 

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 22 points 2 days ago (2 children)

It's already available for anyone to use. https://github.com/openai/whisper

They're using OpenAI's Whisper model for this: https://code.videolan.org/videolan/vlc/-/merge_requests/5155

[–] [email protected] 3 points 1 day ago

Note that openai's original whisper models are pretty slow; in my experience the distil-whisper project (via a tool like whisperx) is more than 10x faster.

[–] [email protected] 5 points 2 days ago (1 children)

Has there been any estimated minimal system requirements for this yet, since it runs locally?

[–] [email protected] 11 points 2 days ago* (last edited 2 days ago) (1 children)

It's actually using whisper.cpp

From the README:

Memory usage Model Disk Mem tiny 75 MiB ~273 MB base 142 MiB ~388 MB small 466 MiB ~852 MB medium 1.5 GiB ~2.1 GB large 2.9 GiB ~3.9 GiB

Those are the model sizes

[–] [email protected] 3 points 2 days ago

Oh wow those pretty tiny memory requirements for a decent modern system! That's actually very impressive! :D

Many people can probably even run this on older media servers or even just a plain NAS! That's awesome! :D