Staff Research Engineer - Multimodal Generative Modelling

Job summary

Responsibilities

Synthesia's long-term vision is to build the best human-interactive models: systems that don't just talk to people, but perceive and respond to them, reacting to a user's actions and emotions, not only their words.

• Shape our roadmap to create new model capabilities and unlock new functionality for our customer base, on both short and long time horizons.
• Propose novel multi-modal system architectures (especially text and voice).
• Develop and evaluate streaming and conversational systems for low-latency, interactive voice-video synthesis.
• Design solutions that reinforce emotional expressiveness and natural interaction.
• Implement and bring designs to life, from pretraining through post-training.

What they're looking for

• The ability to bring novel ideas and designs that advance the field of interactive multimodal systems.
• Strong understanding of generative modelling, ideally applied to sequential or multimodal data.
• Hands-on experience with large language models or similar transformer-based architectures.
• High proficiency in PyTorch, including distributed training and model optimization.
• A solid grasp of time-series modeling and tokenization, preferably in the context of audio, speech, or video.

Tech stack

• PyTorch