Multimodal LLM Researcher (MLLM)

About This RoleAI processing…

Key Responsibilities

• 1
  Lead and contribute to research efforts focused on real-time, multimodal generation—including text, image, video, and audio synthesis—as well as orchestration of agentic platform infrastructure
• 2
  Design and prototype novel algorithms and architectures for high-fidelity, real-time multimodal synthesis and interactive experiences
• 3
  Focus on real-time aspects of model inference and synthesis across modalities
• 4
  Work on diffusion model distillation and/or develop diffusion-based world models for multimodal applications
• 5
  Train and finetune autoregressive and diffusion models in LLM, VLM, or Audio LM contexts with a focus on real-time performance
• 6
  Curate specific datasets, especially for video, audio, cross-modal, and sensory-rich data
• 7
  Collaborate with cross-functional teams to bring research advancements into production-ready technologies
• 8
  Publish work in top-tier conferences and journals; communicate research results internally and externally
• 9
  Stay at the cutting edge of real-time multimodal generative AI and agentic orchestration

Requirements

• 5+ years of relevant experience, including research during graduate studies, in large language models, vision-language models, audio language models, deep learning, or related fields
• Demonstrated impact as first author on major publications in top conferences or journals (e.g., NeurIPS, ICML, ICLR, frontier research background)
• Deep expertise in at least one area: language modeling (LLM), vision-language modeling (VLM), or audio language modeling (Audio LM)
• Strong experience with generative models, including autoregressive and diffusion models, and their real-time deployment
• Hands-on experience curating, constructing, or augmenting large, high-quality multimodal datasets
• Experience developing and deploying real-time systems and/or agentic orchestration infrastructure
• Strong programming and prototyping skills (Python, PyTorch, TensorFlow, etc.)
• Passion for building creative tools and platforms that empower users
• Excellent communication and collaboration skills

Perks & Benefits