Senior AI Research Engineer - GPU Systems & Kernels
Boost your chances at datadog
Tailor your resume to this exact job and generate a matching cover letter in about 60 seconds with JobEase — our AI application assistant.
- ATS-optimized resume
- Personalized cover letter
- Match score & keyword gaps
Free to start · no card required
Get more other jobs in your inbox
Verified daily — no ghost listings.
About This Role
Senior AI Research Engineer focuses on optimizing GPU kernels and communication for large language model training and inference, working closely with research scientists to build high-performance infrastructure for Datadog's AI initiatives.
Key ResponsibilitiesAI-extracted
- 1Write, tune, and debug GPU kernels for LLM training and inference
- 2Optimize GPU performance for latest NVIDIA generations, including memory hierarchy and low-precision formats
- 3Reduce communication costs in distributed workloads and overlap communication with compute
- 4Profile end-to-end training and rollout workloads to identify bottlenecks
- 5Build benchmarks, profiling tools, and regression tests to guide optimizations
- 6Collaborate with research scientists to implement new model architectures efficiently
- 7Explore emerging techniques such as low-precision training, speculative decoding, and fused kernels
RequirementsAI-extracted
- Depth in GPU kernel development and optimization (CUDA or similar)
- Experience with low-latency communication and collective operations (e.g., RDMA, NCCL)
- Proficiency in a systems language (C++, Rust, or CUDA C) and Python
- Strong debugging and profiling skills using tools such as Nsight
- Ability to reason about hardware constraints and explain bottlenecks
- Clear communication of design and performance trade-offs
- Experience with Mixture-of-Experts models or sparse inference is a plus
- Familiarity with distributed training frameworks such as Megatron-LM or DeepSpeed
Perks & BenefitsAI-extracted
Apply to This Job in Minutes
Generate ATS-optimized resume + cover letter + interview prep with Jobease.ca AI. Complete your application faster.
75% of AI Resumes Get Rejected
Beat the ATS with Jobease.ca's AI Resume Builder. Optimized for real hiring systems.
Build My ResumeProfile Match
Loading…Checking your profile against this job…
Job Overview
Share This Job
Track All Your Applications
Never lose track again. Jobease.ca organizes every application, interview, and follow-up.
Organize My Search