Senior Performance Software Engineer, Deep Learning Libraries - job 1 of 3
We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA GPUs. The team delivers high-performance code to NVIDIA’s cuDNN, cuBLAS, and TensorRTlibraries to accelerate deep learning models. The team is proud to play an integral part in enabling the breakthroughs in domains such as image classification, speech recognition, and natural language processing. Join the team that is building the underlying software used across the world to power the revolution in artificial intelligence! We’re always striving for peak GPU efficiency on current and future-generation GPUs. To get a sense of the code we write, check out our CUTLASS open-source project showcasing performant matrix multiply on NVIDIA’s Tensor Cores with CUDA. This specific position primarily deals with code lower in the deep learning software stack, right down to the GPU HW.
What you'll be doing:
Writing highly tuned compute kernels, mostly in C++ CUDA, to perform core deep learning operations (e.g. matrix multiplies, convolutions, normalizations)
Following general software engineering best practices including support for regression testing and CI/CD flows
Collaborating with teams across NVIDIA:
CUDA compiler team on generating optimal assembly code
Deep learning training and inference performance teams on which layers require optimization
Hardware and architecture teams on the programming model for new deep learning hardware features
What we need to see:
Masters or PhD degree or equivalent experience in Computer Science, Computer Engineering, Applied Math, or related field
6+ years of relevant industry experience
Demonstrated strong C++ programming and software design skills, including debugging, performance analysis, and test design
Experience with performance-oriented parallel programming, even if it’s not on GPUs (e.g. with OpenMP or pthreads)
Solid understanding of computer architecture and some experience with assembly programming
Ways to stand out from the crowd:
Tuning BLAS or deep learning library kernel code
CUDA/OpenCL GPU programming
Numerical methods and linear algebra
LLVM, TVM tensor expressions, or TensorFlow MLIR
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard working people in the world working for us. If you're creative, autonomous, and love a challenge, consider joining our Deep Learning Library team and help us build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.
You will also be eligible for equity and benefits.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
NVIDIA seeks a Verification Software Engineer to build and maintain verification tools and test automation for NVLink and InfiniBand switch operating systems.
Lead design and validation of advanced data center cooling systems and digital twins using CFD, CAD, and simulation tools to support NVIDIA's high-heat-density GPU infrastructure.
Delta Solutions & Strategies is hiring a Mid-Level Software Engineer to develop C# applications, implement socket-based protocols, and produce technical documentation in support of defense systems at the Colorado Springs corporate office.
Help design, deploy, and operate browser-based AI agents that automate financial crime compliance for major banks as a Forward Deployed Engineer at Sphinx.
Credit Genie is hiring a Staff Android Engineer to lead the architecture and development of a high-scale Kotlin Android app that delivers exceptional mobile financial experiences.
Remote Software Engineer role in California focusing on Python-based, cloud-native application development and DevOps practices.
Build and deploy scalable AI-driven healthcare applications as a remote AI Software Engineer, translating ML models into production-ready solutions across backend, frontend, and cloud environments.
Contribute to a market-leading SaaS product as a Front-end Engineer intern, building embeddable low-code widgets and interactive dashboards for global media clients.
Lead the technical strategy and hands-on development of Upstart's pricing platform, building scalable Python backend services that drive pricing, experimentation, and revenue optimization across the company.
Develop and test real-time embedded software for the F-15 Operational Flight Program at Boeing's Berkeley, MO facility, supporting Air Force and international customers.
Aura is hiring a Senior Software Engineer to be the technical leader for the D2C Growth team, crafting scalable systems and personalization that drive customer acquisition and retention.
Mindbloom seeks a Software Engineer to build scalable, AI-enabled backend infrastructure and APIs that power its remote-first psychedelic therapy platform.
Sprinter Health is hiring a Senior Software Engineer on the Logistics Optimization team to build scalable routing, scheduling, and forecasting systems that power in‑home care delivery.
Veeam is hiring a Frontend Engineer to build responsive, reusable React interfaces for its Veeam Data Cloud AI platform, combining strong frontend craft with modern AI integrations.
A remote-first Software Engineer II role on Acorns' Risk Platform to build reliable, secure microservices and APIs that protect customers and enable compliance.
NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.
217 jobs
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
