ScriptSync
2024Translates a whole lecture video — including the teacher's handwriting and notes on screen — and redraws it, in place, in your language.
Most video translation stops at subtitles. ScriptSync translates the whole thing — and the part I'm proudest of is what happens behind the speaker.
Lecture videos are full of handwritten notes, slides, and diagrams that every subtitle tool ignores — and for a student who doesn't speak the language, that's often the most important thing on screen. ScriptSync detects all of it, translates it, and redraws each piece of text back in its exact original position. So a Hindi speaker watching a French lecture sees the board in Hindi too, laid out exactly where the teacher wrote it.
It re-voices the audio properly, too. Translating the transcript as one block makes the new audio slide out of sync with the video, so instead we split the audio into timestamped sentences, translate each one, and slot the new audio back into its original window.
Built in 40 hours. English, French, German, Spanish, Russian, Hindi, Marathi, Tamil, Bulgarian, and more.