Senior Software Engineer — AI Studio (Inference Platform)
Skills
- Fluency in Python, Go, or Rust and experience with asynchronous programming
- Strong background in distributed systems, API design, and high-throughput architectures
- Experience with Kubernetes, Ray, or similar orchestration stacks
- Familiarity with inference frameworks/back-ends (e.g., vLLM, Triton, ComfyUI, sglang)
- Proven ability using profiling and performance tools (CUDA, Triton, kernel profilers) for optimization
- Test-driven development, modern CI/CD, and observability best practices
Responsibilities
- Design and implement backend services powering model inference, routing, and scheduling
- Integrate and scale model back-ends and orchestration stacks for production workloads
- Optimize latency and throughput through performance tuning, memory management, and profiling
- Build sophisticated request-routing, load balancing, caching, and queuing logic for multi-tenant environments
- Improve observability, monitoring, and CI/CD pipelines to ensure platform reliability at scale
- Collaborate across cross-functional teams and mentor junior engineers
Education
- Bachelor's degree in Computer Science, Engineering, or related field or equivalent experience
- Advanced degree (Master's/PhD) in a relevant field preferred for research-heavy roles
Benefits
- Competitive salary and comprehensive benefits package
- Opportunities for professional growth within a fast-growing public company
- Flexible working arrangements including remote options
- Collaborative, innovation-focused environment with experienced AI and engineering teams
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Coinbase seeks a Senior Software Engineer to design, build, and operate low-latency blockchain indexing and streaming services that power the Coinbase Developer Platform.
Accenture CX seeks an experienced Senior Java Developer to build Spring Boot microservices and implement Kafka-driven, NoSQL-backed solutions for a hybrid Atlanta engagement.
SimVentions is hiring an on-site Software Developer Analyst at NAVAIR Pax River to perform software engineering, integration, and technical oversight for avionics/weapon system programs.
Experienced Mainframe Developer needed to design, develop and support COBOL/CICS enterprise applications for a global IT services client based in California City.
Experienced front-end engineer needed to lead development and ownership of cross-platform Angular-based front-end codebases with a focus on security, performance, and open-source collaboration.
Global Payments is hiring a Senior Mainframe Software Engineer in Columbus, GA to develop and support high‑availability payment systems using COBOL, IMS and DB2.
Staff Software Engineer in Austin to architect and deliver high-scale, secure payment services, web applications, and APIs for Visa's global payments network.
Lead frontend mobile engineering for a fast-growing healthcare logistics platform, building performant React Native experiences that support clinicians and patients in the field.
Aisera is hiring a Senior DevOps Engineer to design and operate secure, automated cloud infrastructure and CI/CD pipelines supporting federal customers.
A remote-first education-focused tech partner is hiring a Senior Engineer to build and maintain scalable Node.js backend services, serverless architectures, and data pipelines on AWS.
Micron Technology is hiring an Embedded Software Engineer in Boise to develop firmware and interface software for custom semiconductor test equipment and support production validation.
Senior Site Reliability Engineer needed to run and harden Featurespace's ARIC Risk Hub SaaS on cloud infrastructure, driving automation, monitoring, and operational excellence.
Senior React Developer needed to own and enhance a WebView-based ad player using TypeScript and React, working remotely with mobile SDK teams to bridge web and native experiences.
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
