Software Engineer, Inference

About This Role

Key ResponsibilitiesAI-extracted

• 1
  Lead and implement advanced inference acceleration techniques, including attention optimization and quantization for efficient model serving.
• 2
  Engineer and optimize GPU strategies across tensor, sequence, and pipeline parallelism for maximal efficiency and scalability.
• 3
  Develop and optimize high-performance computing kernels and distributed workloads using CUDA and NCCL.
• 4
  Collaborate with research and engineering teams to bring state-of-the-art videogen and large language models into production.
• 5
  Drive rigorous code reviews, participate in technical discussions, and mentor fellow engineers on best practices in inference and GPU programming.

RequirementsAI-extracted

• 5+ years engineering experience, with a strong track record in inference acceleration and model deployment at scale.
• Proven expertise in inference optimization, including quantization, attention acceleration, and deep learning compiler stacks.
• Deep knowledge of GPU programming and experience with parallelism for distributed inference.
• Familiarity with video generation models and large language models.
• Strong cross-discipline communication skills and ability to drive shared goals across research and engineering functions.

Perks & BenefitsAI-extracted