Senior DL Algorithms Engineer - Inference Performance - job 1 of 2
We are now looking for a Senior DL Algorithms Engineer! NVIDIA is seeking senior engineers who are mindful of performance analysis and optimization to help us squeeze every last clock cycle out of Deep Learning workloads. If you are unafraid to work across all layers of the hardware/software stack from GPU architecture to Deep Learning Framework to achieve peak performance, we want to hear from you! This role offers an opportunity to directly impact the hardware and software roadmap in a fast-growing technology company that leads the AI revolution.
What you will be doing:
Implement language and multimodal model inference as part of NVIDIA Inference Microservices (NIMs).
Contribute new features, fix bugs and deliver production code to TRT-LLM, NVIDIA’s open-source inference serving library.
Profile and analyze bottlenecks across the full inference stack to push the boundaries of inference performance.
Benchmark state-of-the-art offerings in various DL models inference and perform competitive analysis for NVIDIA SW/HW stack.
Collaborate heavily with other SW/HW co-design teams to enable the creation of the next generation of AI-powered services.
What we want to see:
PhD in CS, EE or CSEE or equivalent experience.
3+ years of experience.
Strong background in deep learning and neural networks, in particular inference.
Experience with performance profiling, analysis and optimization, especially for GPU-based applications.
Proficient in C++, PyTorch or equivalent frameworks.
Deep understanding of computer architecture, and familiarity with the fundamentals of GPU architecture.
Ways to stand out from the crowd:
Proven experience with processor and system-level performance optimization.
Deep understanding of modern LLM architectures.
Strong fundamentals in algorithms.
GPU programming experience (CUDA or OpenCL) is a strong plus
You will also be eligible for equity and benefits.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
NVIDIA is hiring a Global Trade Compliance Analyst to manage export control processes and support SAP GTS operations within their innovative technology company.
Drive enterprise AI adoption by architecting and optimizing scalable GPU-powered inference solutions with NVIDIA’s cutting-edge tech.
Vultron is looking for a DevOps Engineer to build and manage secure and scalable infrastructure powering cutting-edge AI solutions for government contracting.
Dewberry seeks an entry-level engineer in Raleigh to support innovative water and wastewater treatment projects across multiple sectors.
Advance enterprise AI by developing and optimizing Large Language Models at ServiceNow, shaping future work experiences.
Lead Bus Rapid Transit design projects at AECOM in Columbus, driving innovation and collaboration within a global infrastructure leader.
Toppan Packaging seeks a hands-on Process Technician I to enhance manufacturing efficiency and safety at their Franklin Park plant.
The NYC Department of Design and Construction is hiring a Junior Engineer to support infrastructure design and engineering investigations on-site in Long Island City.
HBK Engineering seeks a skilled Design Engineer in Chicago to lead civil municipal utility design projects within a collaborative and growing firm.
Innovate at OpenAI by designing and implementing motor control software solutions for next-generation robotics in a highly collaborative environment.
An entry-level Payload Launch Control Systems Engineer position focused on electronic payload systems for advanced naval platforms in Groton.
Intel seeks a Power Analysis and Optimization Engineer to innovate and optimize power consumption in advanced CPU designs within their E-Core microprocessor team.
Contribute to cutting-edge satellite data processing and national security missions as a Machine Learning Engineer at SpaceX's Starshield program.
Broadcom is hiring an experienced RTL Synthesis Engineer skilled in advanced optimization, synthesis, and verification methodologies to enhance data center connectivity solutions.
Experienced Solution Architect proficient in Java and cloud-native technologies is needed to lead modern app design and implementation for a dynamic consulting firm.
NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.
46 jobs
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
