NVIDIA DGX™ Cloud is an end-to-end, scalable AI platform for developers, offering scalable capacity built on the latest NVIDIA architecture and co-engineered with the world’s leading cloud service providers (CSPs). We are seeking highly skilled Parallel and Distributed Systems engineers to drive the performance analysis, optimization, and modeling to define the architecture and design of Nvidia’s DGX Cloud clusters.
The ideal candidate will have a deep understanding of the methodology to conduct end to end performance analysis of critical AI applications running on large scale parallel and distributed systems. Candidates will work closely with the cross functional teams to define DGX Cloud cluster architecture for different CSPs, optimize workloads running on these systems and develop the methodology that will drive the HW-SW codesign cycle to develop world class AI infrastructure at scale and make them more easily consumable by users (via improved scalability, reliability, cleaner abstractions, etc).
What you will be doing:
Develop benchmarks, end to end customer applications running at scale, instrumented for performance measurements, tracking, sampling, to measure and optimize performance of important applications and services;
Construct carefully designed experiments to analyze, study and develop critical insights into performance bottlenecks, dependencies, from an end to end perspective;
Develop ideas on how to improve the end to end system performance and usability by driving changes in the HW or SW (or both).
Collaborate with AI researchers, developers, and application service providers to understand internal developer and external customer pain points, requirements, project future needs and share best practice.
Develop the necessary modeling framework and the TCO (total cost of ownership) analysis to enable efficient exploration and sweep of the architecture and design space
Develop the methodology needed to drive the engineering analysis to Inform the architecture, design and roadmap of DGX Cloud
What we need to see:
Currently pursuing Masters or PhD in Engineering or equivalent experience (preferably, Electrical Engineering, Computer Engineering, or Computer Science)
Experience in working with large scale parallel and distributed accelerator-based system systems
Experience optimizing performance and AI workloads on large scale systems
Background with performance modeling and benchmarking at scale
Background in Computer Architecture, Networking, Storage systems, Accelerators
Familiarity with popular AI frameworks (PyTorch, TensorFlow, JAX, Megatron-LM, Tensort-LLM, VLLM) among others
Experience with AI/ML models and workloads, in particular LLMs as well as an understanding of DNNs and their use in emerging AI/ML applications and service
Proficiency in Python, C/C++
Expertise with at least one of public CSP infrastructure (GCP, AWS, Azure, OCI, …);
Ways to stand out from the crowd:
PhD in the relevant areas
Very high intellectual curiosity; Confidence to dig in as needed; Not afraid of confronting complexity; Able to pick up new areas quickly;
Proficiency in CUDA, XLA
Excellent interpersonal skills
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 148,000 USD - 235,750 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.You will also be eligible for equity and benefits.
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Technical Product Management intern role supporting NVIDIA’s Enterprise Product Group to research, prototype, and help deliver GPU-accelerated AI infrastructure and Gen AI product experiences.
NVIDIA is hiring a Senior Software Engineer to advance XR-driven teleoperation and data-collection systems for robotics using C++ and Python.
Mid-level software engineer (contractor) to build and maintain backend services, APIs and internal tooling for an IoT platform in a fully remote, US-hours environment.
OpenEvidence is hiring autonomous, high-impact engineers to own and ship production-grade systems that define the default platform for medical AI.
Pyka is hiring a Senior Embedded Software Engineer to lead firmware development, board bring-up, and HIL testing for the embedded systems that power its autonomous electric aircraft.
Experienced Salesforce Developer (Lightning) needed in NYC for a 6-month contract-to-hire role focused on Apex/LWC development, integrations, and release management.
A mission-focused engineering team seeks a DevOps Engineer (TS/SCI) to architect and operate CI/CD pipelines, infrastructure-as-code, and container platforms for secure, high-availability deployments.
Experienced Software Engineer needed to build and maintain business-critical applications using .NET, Angular, MongoDB, and related technologies in a collaborative, agile environment.
Mesh, a scaling crypto payments network, is hiring a Senior Backend Engineer to build secure, high-performance backend services and APIs using cloud-native practices.
Ascertain is seeking a Full Stack Engineer (backend-focused) to build scalable Python/FastAPI services and cloud infrastructure that power its healthcare AI platform.
Build and scale security automation and AI-driven analytics as a Senior Python and Data Analytics Developer supporting federal cybersecurity operations in a fully remote role.
Lead the design and delivery of Quizlet’s external API platform and LearnOS plugin architecture to enable secure, extensible partner integrations and agentic workflows.
Flowhub is hiring a Software Engineer II (SRE/DevOps) to own observability, reliability, and performance for key production systems across its cannabis retail platform.
Experienced Swift-focused iOS developer needed to architect, build, and maintain production-grade iOS apps for a cloud- and AI-focused consulting firm on a 6+ month remote contract.
Lead the design and implementation of security automation, data pipelines, and AI/ML-enhanced analytics using Python, JavaScript, and BI tools for a federal-focused cybersecurity team.
NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.
87 jobs