Model-as-a-Service Tech Lead

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

We are seeking a highly qualified and hands-on Tech Lead to drive the technical vision, architecture, and implementation for our scalable, web-based platform. This critical platform enables users to configure autonomous driving scenarios and generate synthetic data at scale for model training. This is not a management role; the successful candidate will spend a large part of their time actively writing code and leading code quality initiatives. A key responsibility is to design the entire platform for maximum portability and broad adoption across the NVIDIA ecosystem. This requires ensuring all services and deployment pipelines are not tied to proprietary internal infrastructure. The Tech Lead will champion the use of web and batch processing patterns to efficiently expose our premier foundation models, driving their real-world deployment and utility. The ideal candidate will be a full-stack expert who leads by example, actively coding and mentoring engineers. They take full responsibility for building the system, its performance, and deployment in a cloud-centric environment.

What you'll be doing:

• Serve as the primary, high-impact contributor on complex features. Dedicate significant time to producing production code across the full stack, including UI, APIs, services, and infrastructure.

• Code Review Leadership & Quality Assurance: Lead the code review process, setting and implementing thorough coding standards, performance benchmarks, and architectural integrity to ensure all merged code is high-quality, maintainable, and robust.

• Architectural Ownership & Portability: Define and own the long-term technical roadmap, architecture, and design. This includes the required assurance that the deployment pipelines and services are platform-agnostic and easily deployable across the broader NVIDIA ecosystem, deliberately avoiding internal infrastructure dependencies.

• Foundation Model Deployment Strategy: Lead the strategic implementation of web services and efficient batch processing queues to seamlessly integrate and operationalize our world foundation models into the customer-facing platform.

• System Performance & Reliability: Implement and make sure standards for production-grade performance, monitoring, and fault tolerance across all services. Proactively identify and resolve systemic technical debt and scalability bottlenecks.

• Deployment & Operational Excellence: Take ultimate ownership of the CI/CD pipelines, container orchestration strategy (Kubernetes/Helm), and operational readiness, ensuring seamless scalability and reliability in production.

• Team Mentorship & Guidance: Mentor and guide the engineering team on advanced practices in full-stack development, distributed systems design, performance optimization, and clean, portable code architecture.

• Multi-functional Partnership: Act as the key technical liaison, translating complex requirements from Product Managers, ML Engineers, and Data Scientists into robust, portable, and implementable designs.

What we need to see:

This role requires a proven track record of significant experience and technical mastery:

• Minimum 12+ years of hands-on experience developing and deploying scalable full-stack web services in a cloud environment.

• Proven Tech Lead or equivalent Senior/Staff level experience with demonstrated ability to define system architecture, mentor engineers, and take end-to-end technical ownership of a major platform while remaining deeply active in coding and code reviews.

• Expert-level proficiency in designing and scaling distributed microservices architectures using gRPC and REST APIs.

• Deep expertise in modern frontend frameworks and building highly responsive, data-intensive UIs capable of managing high-frequency data flows.

• Direct experience designing and deploying containerized applications that use a GPU (e.g., NVIDIA Container Toolkit).

• Experience with MaaS (Model-as-a-Service) patterns and serving large machine learning models as high-throughput endpoints.

• Mastery of container orchestration, including Kubernetes and Helm for sophisticated, portable, multi-service production deployments.

• Proficiency in backend languages such as Python and/or Go, and TypeScript for the frontend.

• Strong practical experience with Cloud Infrastructure (AWS S3) and running complex data storage/access patterns (SQL, key-value stores).

• Expertise in CI/CD practices (GitLab, Jenkins) with a focus on automation, testing, and improving deployment velocity and stability.

• Bachelor's degree (B.S.) or equivalent experience in Computer Science, Software Engineering, Electrical Engineering, or a closely related technical field; Master's degree (M.S.) preferred

Ways to stand out from the crowd:

These skills represent a strong alignment with our specific domain challenges:

• Experience in data querying platforms such as Apache Druid, ClickHouse, or Elasticsearch.

• Familiarity with autonomous vehicle simulation environments (e.g., Carla) and synthetic data generation pipelines using foundational models.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 248,000 USD - 391,000 USD.Applications for this job will be accepted at least until November 21, 2025.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.