Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Engineering Manager - Rack Scale AI Systems image - Rise Careers
Job details

Engineering Manager - Rack Scale AI Systems

NVIDIA is looking for an Engineering Manager to Lead IPP's (Infrastructure, Planning and Process) Cloud Platform Team focused on Rack Scale AI Systems. IPP is a global organization within NVIDIA. This group works with various other groups within NVIDIA such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure needs. These cloud services provide almost half a million automated jobs per day on thousands of servers helping with the productivity of thousands of NVIDIA's software engineers worldwide. The cloud hosts a heterogeneous mix of machines and devices with various operating systems (Windows/Linux/Android), a multitude of hardware platforms both NVIDIA GPUs and Tegra Processors. Are you passionate about distributed infrastructure and looking for sophisticated, critical issues, ready to build the next generation of cloud services, design creative solutions, mine through data to uncover real problems and fix them? We are excited to onboard a fun-loving person like you.

What you'll be doing:

  • Build and Lead an engineering organization focused on Rack Scale systems onboarding and Bring up execution along with external and internal partner engagement.

  • Work with Engineering, Product Management, and Customer Program Management teams to define, prioritize, and implement features, infrastructure, processes, and workflows.

  • Work with NVIDIA Product Teams to understand new product requirements including HPC and AI/ML Products.

  • Collaborate with multi-functional teams, including system engineering, software engineering, mechanical/thermal engineering, operations, data center teams, external vendors, and other partners to successfully deliver a reliable and robust platform from concept to prototype to deployments.

  • Help identify potential or observed weaknesses in the current process, offer ideas for actions that can improve quality.

  • Drive overall quality of deployments and improve time to market next gen products

  • Lead the on-ground team in collecting data on SOL deployments, physical touch information, and patterns of failure.

  • Drive overall triage and recovery execution during product bring up and maintain support through product sustaining phase.

What we need to see:

  • Bachelor's or Master's Degree in Computer Science or Software Engineering, or equivalent experience.

  • 5+ years of Management experience in large, cross-matrix, and geo-dispersed technology organizations focused in/around the server and data center space—strong experiences in Operations Product Engineering with 8+ years of overall experience.

  • Strong technical skills and understanding of embedded systems, orchestration & automation systems, data centers and cloud architecture, as well as excellent communication and planning skills.

  • Deep understanding of cloud design in the areas of virtualization and global infrastructure, distributed systems, load balancing and security

  • Excellent thought process for identifying risks and developing robust mitigations

  • Strong collaborative and interpersonal skills, specifically a proven track record to effectively guide and influence within a diverse team

Ways to stand out from the crowd:

  • Experience in large scale QA environments, for product bring ups.

  • Experience with high performance or large scale computing environments, parallel computing, or CUDA.

  • Special skills in large-scale computing and cluster computing(MPI), data center design include high speed interconnect InfiniBand, Cluster Storage and Scheduling related design and/or management experience.

  • Experience with converged and hyper-converged hardware and servers.

  • Strong background on Windows & Linux administration.

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens new universes to explore, enables outstanding creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for phenomenal people like you to help us accelerate the next wave of artificial intelligence. Widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and passionate about new technologies we want you on our team!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 270,250 USD for Level 2, and 208,000 USD - 333,500 USD for Level 3.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 1, 2025.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA Glassdoor Company Review
4.6 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
NVIDIA DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of NVIDIA
NVIDIA CEO photo
Jensen Huang
Approve of CEO

Average salary estimate

$250750 / YEARLY (est.)
min
max
$168000K
$333500K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Posted 14 hours ago
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

Lead and technically drive integration of NVIDIA's generative AI stack with leading AI model developers to accelerate innovation and performance.

Photo of the Rise User
Posted 13 hours ago
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

Experienced software engineers are invited to join NVIDIA’s DGX Cloud team to build scalable orchestration systems powering advanced AI and cloud infrastructure.

Photo of the Rise User

Serve Robotics seeks a Senior Hardware Test Engineer to lead validation of hardware systems that drive their innovative delivery robots.

Photo of the Rise User
Posted 15 hours ago

KLA is looking for a Product Engineer to serve as a technical resource throughout the product lifecycle, improving serviceability and supporting semiconductor manufacturing technologies.

Photo of the Rise User

Contribute as a Senior Automation Manufacturing Engineer at Rapid Micro Biosystems by driving SCADA modernization and integrating automated production lines for groundbreaking healthcare products.

Act as the vital link between Sei's core engineering team and the developer community by providing support, content, and advocacy as a Developer Relations Engineer in NYC.

Photo of the Rise User

Contribute your drafting expertise with Walker Consultants as a Vertical Transportation Drafter, designing critical elevator and escalator systems on impactful building projects nationwide.

Photo of the Rise User

Experienced Senior Mechanical Engineer with a PE license needed at Kimley-Horn to lead MEP design and project teams on healthcare projects in Orange, CA.

Experienced Lead Conveyance Project Engineer needed in Rocklin, CA to lead conveyor system projects and manage client interactions.

Photo of the Rise User
Posted 4 hours ago

Lead innovative AI-driven legal technology development as a Senior Machine Learning Engineer at EvenUp, a pioneering company closing the justice gap.

Photo of the Rise User
Flock Safety Hybrid No location specified
Posted 24 hours ago
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Learning & Development
Equity
Paid Holidays
Paid Time-Off
WFH Reimbursements
Child Care stipend
Maternity Leave
Paternity Leave

Flock Safety is looking for a Senior NPI Engineer to lead new product introduction and manufacturing process improvements in a remote role.

Photo of the Rise User
McKesson Hybrid USA, IL, Hanover Park
Posted 23 hours ago

An entry-level role at McKesson for a biomedical technician skilled in preventive maintenance and basic equipment repairs.

Photo of the Rise User
Posted 15 hours ago

Contribute to aerospace hardware innovation as a CAD Designer I at CesiumAstro, supporting mechanical engineering with CAD modeling and documentation.

Photo of the Rise User
Applied Intuition Hybrid Washington, District of Columbia, United States
Posted 23 hours ago

Applied Intuition seeks a Forward Deployed Engineer to bridge cutting-edge vehicle intelligence technology with defense customers in operational settings.

Photo of the Rise User
Posted 15 hours ago

Pioneering AI infrastructure engineer role at Kixie to design and deploy advanced AI systems that transform sales engagement and workflows.

NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.

158 jobs
MATCH
Calculating your matching score...
BADGES
Badge ChangemakerBadge Diversity ChampionBadge Family FriendlyBadge Global CitizenBadge Work&Life Balance
CULTURE VALUES
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
BENEFITS & PERKS
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, unknown
DATE POSTED
July 29, 2025
Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!