We are seeking a Software Engineering Manager to lead the development for the Dynamo engineering team, NVIDIA’s high-performance, low-latency inference platform for serving generative AI and reasoning workloads at scale. The team accelerates deployment of cutting-edge models across diverse engines and architectures, enabling breakthroughs from real-time LLM serving to complex multi-GPU, multi-node pipelines. Ideal candidate is strong in software development, designing and creating fault-tolerant distributed systems, and has the ability to implement well thought out long term maintenance strategy.
What you'll be doing:
Mentor, grow, and develop the Dynamo engineering team and be responsible for planning and execution of projects and workflows..
Work across several teams and orgs to build platforms that use the latest developments in LLM inferencing. In this role, you will be collaborating with research and development teams and serve a large user base (software teams both internal and external to NVIDIA).
Align priorities across collaborators and define metrics for measuring the success of the product/team.
Stay updated with the latest trends in AI, ML, and infrastructure, proactively seeking opportunities to integrate advancements into NVIDIA's LLM and AI infrastructure solutions.
What we need to see:
Masters or PhD or equivalent experience in Computer Science, computer architecture, or related field.
10+ years of overall experience in developing large distributed systems.
2+ years of experience managing of AI and SW development teams.
Experience in developing and maintaining LLM or GenAI infrastructure
Excellent communication, collaboration and problem-solving skills, with a dedication to encouraging an inclusive and diverse workplace.
Hands-on experience developing large-scale distributed systems
Ways to stand out from the crowd:
Strong technical background in cloud/distributed systems.
Experience working in a globally distributed organization.
Good knowledge of CPU and/or GPU hardware architecture
Background in developing LLM inference systems.
Experience with LLM frameworks like vLLM & TRT-LLM.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most expert and passionate people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. Come help us build the real-time, efficient computing platform driving our success in the multifaceted and quickly growing field Deep Learning and Artificial Intelligence.
#LI-Hybrid
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD.You will also be eligible for equity and benefits.
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Lead technical and GTM partnerships with MLOps/GenAIOps ISVs to accelerate adoption of NVIDIA's generative AI and accelerated computing technologies.
Contribute to the design and implementation of high-performance, low-power CPUs at NVIDIA’s Hillsboro team, supporting AI, automotive, and consumer products.
Limit Break is hiring a Senior Unity Engineer to architect and implement robust, data-driven gameplay systems for a new mid-core 3D mobile title and help grow the engineering team from prototype to production.
Contribute to cutting-edge real-time 3D medical visualization and AI projects as a Junior Software Developer at a market-leading healthcare technology company.
Robust AI is hiring a firmware engineer to develop and deploy embedded systems firmware for next-generation warehouse robots at its San Carlos headquarters.
Saronic Technologies seeks a hands-on Software Engineer (Generalist) to develop perception, navigation, and control software for autonomous surface vessels supporting DoD missions.
Fully remote Software Engineer II role building scalable full‑stack applications with .NET/PHP and modern front-end and cloud tooling for a collaborative, fast-paced team.
A mid-senior SDET role focused on building and scaling automated test frameworks and integrating tests into CI/CT/CD pipelines for microservices-driven applications.
Cobot is hiring a Senior Product Engineer (3D Computer Vision) to lead architecture and end-to-end product work for ScoutMap across backend, visualization, and full-stack integration.
A remote SaaS team is hiring a Software Developer to build scalable React-based components, maintain cloud web services, and contribute to cross-functional engineering initiatives that serve thousands of users worldwide.
Lead mobile architecture and strategy for a high-growth platform as Principal Software Engineer, Mobile, driving React Native development and mentoring senior engineers across iOS and Android.
Work on a distributed engineering team enhancing a homegrown FSA/HSA payments platform as a Mid-Level Software Engineer focused on C#, .NET, modern front-end frameworks, and high-quality delivery.
A partner company of Jobgether is hiring a Senior Fullstack Product Software Engineer to lead end-to-end product development, mentor engineers, and deliver scalable, AI-enabled corporate IT solutions in a fully remote US role.
Experienced Full Stack .NET Developer needed to deliver scalable web applications using C#, ASP.NET Core, MongoDB and AWS while working remotely with cross-functional Agile teams.
NVIDIA seeks a Senior System Software Engineer to architect and optimize GPU-accelerated HPC software for genomics and healthcare applications.
NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.
195 jobs