DA

Senior AI Research Engineer - GPU Systems & Kernels

datadog· 68 open roles

Paris, Germany On-siteFull-time1 weeks ago
Salaryest.
€90,000 - €140,000
Experience
Mid
Job Type
Full-time
Posted
1 weeks ago
Apply Now

Boost your chances at datadog

Tailor your resume to this exact job and generate a matching cover letter in about 60 seconds with JobEase — our AI application assistant.

  • ATS-optimized resume
  • Personalized cover letter
  • Match score & keyword gaps
Tailor my application

Free to start · no card required

Get more other jobs in your inbox

Verified daily — no ghost listings.

About This Role

Senior AI Research Engineer focuses on optimizing GPU kernels and communication for large language model training and inference, working closely with research scientists to build high-performance infrastructure for Datadog's AI initiatives.

Key ResponsibilitiesAI-extracted

  • 1
    Write, tune, and debug GPU kernels for LLM training and inference
  • 2
    Optimize GPU performance for latest NVIDIA generations, including memory hierarchy and low-precision formats
  • 3
    Reduce communication costs in distributed workloads and overlap communication with compute
  • 4
    Profile end-to-end training and rollout workloads to identify bottlenecks
  • 5
    Build benchmarks, profiling tools, and regression tests to guide optimizations
  • 6
    Collaborate with research scientists to implement new model architectures efficiently
  • 7
    Explore emerging techniques such as low-precision training, speculative decoding, and fused kernels

RequirementsAI-extracted

  • Depth in GPU kernel development and optimization (CUDA or similar)
  • Experience with low-latency communication and collective operations (e.g., RDMA, NCCL)
  • Proficiency in a systems language (C++, Rust, or CUDA C) and Python
  • Strong debugging and profiling skills using tools such as Nsight
  • Ability to reason about hardware constraints and explain bottlenecks
  • Clear communication of design and performance trade-offs
  • Experience with Mixture-of-Experts models or sparse inference is a plus
  • Familiarity with distributed training frameworks such as Megatron-LM or DeepSpeed

Perks & BenefitsAI-extracted

Typically: Comprehensive health, dental, and vision coverage
Typically: Generous paid time off and flexible work arrangements
Typically: Equity or stock options
Typically: Professional development and training budget
Typically: Remote or hybrid work flexibility

Apply to This Job in Minutes

Generate ATS-optimized resume + cover letter + interview prep with Jobease.ca AI. Complete your application faster.

Get Started Free

Similar Jobs

RE

Analytics Engineer

redditRemote
View
RE

Associate General Counsel, Ads Product

redditRemote
View
RE

Group Product Manager, Finance Technology

redditRemote
View