AI Generate/Translate Subtitles

For foreign language videos that don’t include language subtitles in your native tongue, wouldn’t it be neat if there was an option to auto-translate an included subtitle file to your native language? Or to grab one from OpenSubtitle and do the same thing?

I found a similar add-on feature for Streamio: https://stremioaddon.sonsuzanime.com/configure

Looks like VLC just demonstrated this feature at CES 2025!

AutoTranslate and auto-sync on VLC! That´s amazing!
Auto-sync subs is my most desire feature but I don´t see Infuse ever having that, unfortunately.

Rather than AI-based image quality enhancement, what is more needed is AI-generated subtitles that are automatically created based on the video’s audio and translated into a preset language—similar to how it’s done on YouTube or Bilibili web pages. Many videos lack subtitles, and subtitles are often not available for download.

This. If there’s one thing Infuse leaves a lot to be desired, it’s subtitles. For me (my mother tongue isn’t English) and many others who use subtitles, there’s so much Infuse could do… AI subtitles as you said, AI sync, auto-download from Opensubtitles, choose the subtitle on the movie page before pressing play and so on…
Of all the good that AI can bring to Infuse and its customers, they went for something that TVs already do pretty well, upscalling…

Not the same as automatic subtitles. Local AI models are already good enough for generated subtitles on the go.

I moved your post to an already running suggestion for this feature.

Don’t forget that you need to click the like button on the first post in this thread to show your support for this suggestion! :wink:

Agreed. And we can directly interface with AI or APIs to localize other subtitles. Or, taking it a step further, we can even replace the actors’ spoken dialogue with the local language while preserving the unique qualities of their voices, as well as their tone and intonation.

同意,并且我们可以直接对接AI或者API把其他字幕本地化。或者更进一步,直接将演员说的话,替换成本地语言,而保留演员的声音特质和语气、语调。

Currently, infuse cannot customize ass subtitles, and it cannot modify some poor ass subtitles, which is annoying.

Hi, for some older movies/series there are no subtitles available or they’re not synced to the version being played. Since there are now offline tools that can generate subtitles, which can be fed to media players, and even media players that do this on the fly, I guess not just people who aren’t native speakers would benefit if Infuse would implement this.

This would be very useful, infuse needs to support this

Since Apple TV 4K will be updated with an AI capable processor, it would be great if infuse can take advantage of it to have AI subtitle generation capability

I moved your post to the already running thread requesting this. Please do not duplicate already running suggestions.

I haven’t tested it but Apple supposedly added this in tvOS 27 via an accessibility setting.

“Transcribed audio helps you follow along with content when standard captions or subtitles aren’t provided.”

Hi, I’d like to suggest an AI-powered real-time subtitle translation feature.

Problem:
Many shows and movies I watch in Infuse have no subtitles in my language (Chinese). Downloading subtitles via OpenSubtitles doesn’t always help — sometimes Chinese subtitles simply don’t exist for a title.

Existing request:
I found an earlier suggestion covering the same idea — “AutoTranslate Subtitles” (Dec 2024): AutoTranslate Subtitles. It’s been almost two years and there seems to be no visible progress on this. Meanwhile, VLC demoed real-time AI subtitling at CES 2025 supporting 100+ languages, so the technology is clearly maturing. Is this on the roadmap at all?

Suggestion:
Add an option to automatically translate the active subtitle track into the user’s preferred language in real time during playback.

How it could work:

  • In subtitle settings, add “Auto-translate subtitles to: [language]”.
  • When the active subtitle track is not in the selected language, Infuse translates each line on the fly and displays the translation, optionally keeping the original as a second line (dual subtitles).
  • Processed on-device where possible, or via cloud with user opt-in.

This would be a huge help for non-native speakers, especially for content where translated subtitles don’t exist at all. Similar features already exist in browser extensions (e.g. dual-subtitle extensions using DeepL / Google Translate), so the tech is proven — it would be great to have it natively in Infuse.

Thanks for considering!

I moved your post to that thread to keep the suggestions together.

Don’t forget that you need to click the like button on the first post in this thread to show your support for this suggestion! :wink: