Principal ML Platform Engineer

NVIDIA is at the forefront of innovations in Artificial Intelligence, High-Performance Computing, and Visualization. Our invention—the GPU—functions as the visual cortex of modern computing and is central to groundbreaking applications from generative AI to autonomous vehicles. We are now looking for an ML Platform Engineer to help accelerate the next era of machine learning innovation.

In this role, you will architect, scale, and optimize high-performance ML infrastructure used across NVIDIA's AI research and product teams. Your work will empower scientists and engineers to train, fine-tune, and deploy the most advanced ML models on some of the world’s most powerful GPU systems. Join a top team passionate about crafting user-friendly platforms for seamless ML development.
 

What You'll Be Doing:

• Design, build, and maintain scalable ML platforms and infrastructure for training and inference on large-scale, distributed GPU clusters.

• Develop internal tools and automation for ML workflow orchestration, resource scheduling, data access, and reproducibility.

• Collaborate with ML researchers and applied scientists to optimize performance and streamline end-to-end experimentation.

• Evolve and operate multi-cloud and hybrid (on-prem + cloud) environments with a focus on high availability and performance for AI workloads.

• Define and monitor ML-specific infrastructure metrics, such as model efficiency, resource utilization, job success rates, and pipeline latency.

• Build tooling to support experimentation tracking, reproducibility, model versioning, and artifact management.

• Participate in on-call support for platform services and infrastructure running critical ML jobs.

• Drive the adoption of modern GPU technologies and ensure smooth integration of next-generation hardware into ML pipelines (e.g., GB200, NVLink, etc.).

What We Need To See:

• BS/MS in Computer Science, Engineering, or equivalent experience.

• 15+ years in software/platform engineering, including 3+ years in ML infrastructure or distributed compute systems.

• Solid understanding of ML training/inference workflows and lifecycle—from data preprocessing to deployment.

• Proficiency in crafting and operating containerized workloads with Kubernetes, Docker, and workload schedulers.

• Experience with ML orchestration tools such as Kubeflow, Flyte, Airflow, or Ray.

• Strong coding skills in languages such as Python, Go, or Rust.

• Experience running Slurm or custom scheduling frameworks in production ML environments.

• Familiarity with GPU computing, Linux systems internals, and performance tuning at scale.

Ways To Stand Out From The Crowd:

• Experience building or operating ML platforms supporting frameworks like PyTorch, TensorFlow, or JAX at scale.

• Deep understanding of distributed training techniques (e.g., data/model parallelism, Horovod, NCCL).

• Expertise with infrastructure-as-code tools (Terraform, Ansible) and modern CI/CD methodologies.

• Passion for building developer-centric platforms with great UX and strong operational reliability.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 425,500 USD.Applications for this job will be accepted at least until September 22, 2025.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.