Member of Technical Staff - LLM Inference
At .txt, our mission is to make AI reliable. We are the authors of outlines and outlines-core, both leading open source libraries (+10k ⭐️) for structured generation.
We raised $11.9 million, which is fueling the efforts of our global, fully remote team to create software that goes beyond simple conversation.
We support the most popular forms of structured generation through our existing products like dotjson and dotlambda, and are always working on the next innovation.
Read more about .txt and our technology on our blog.
The Role
We’re looking for an strong engineers to drive breakthroughs in LLM inference optimization with structured generation. If you thrive in fast-paced startup environments and love pushing the boundaries of how AI systems deliver structured results (think backend engineering that actually cuts latency, boosts throughput, and reduces resource costs), then we want to hear from you.
About You
Proven experience deploying inference engines like vLLM, SGLang, or TensorRT
Experience with distributed inference (multi-GPU, single node) and low-latency communication (NCCL).
Hands-on knowledge of NVIDIA GPU architecture (CUDA, CUDA cores, memory hierarchy)
Track record of improving inference performance (e.g., improving throughput by 20% through kernel optimizations)
Background in LLM MLOps (e.g., monitoring, scaling, fault tolerance for inference services).
Proficiency in Python and familiarity with (or willingness to learn) Rust
Understanding of containerization (Docker, Kubernetes) and Linux systems
Why you should join us:
🚀 Cutting-edge technology
Structured generation is still a nascent technology. Innovation is not the exception, it’s the rule.
🌐 Remote first
Work from anywhere in the world. We have a culture of written communication, and favor infrequent organic discussions over regular large team meetings.
💸 Competitive compensation and benefits
We pay market rate (adjusting for seed-stage startup) + equity options, offer health and dental insurance, and have a 401k (US Only). We’ll get you a GPU if you don’t have one already.
Location
.txt is a fully remote company. We value the importance of frequent, synchronous communication while recognizing the importance of strong written communication.
Applying
Please provide a 1-page resume in English.
Kindly, do not apply to more than one position at a time.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Reliance Matrix is hiring an API Lead to drive API strategy, architecture, and hands-on delivery for large-scale enterprise systems in a remote US role.
Lead Toast’s FinTech engineering teams to deliver secure, scalable payments and financial products that help restaurants succeed.
WindBorne Systems is hiring a Flight Team Web Developer to own and build the mission control dashboard and operational web tools that power a growing constellation of autonomous weather balloons.
Zus is hiring a Senior Software Engineer for the Costco data platform team to build and operate large-scale, secure bulk health-data services powering clinical and analytics use cases.
Lead the architecture and deployment of high-performance, real-time computer vision and multi-sensor AI systems for TP-Link's smart home products while mentoring teams and ensuring seamless edge-to-cloud integration.
Help scale Atolio’s enterprise search platform as a Senior Deployment Engineer responsible for customer onboarding, secure deployments, automation, and ongoing reliability across cloud and hybrid environments.
Dyna Robotics is hiring a Senior Software Engineer, DevOps to build and operate CI/CD, deployment automation, and monitoring for cloud services and Linux-based robotic devices at our Redwood City headquarters.
Legrand BCS in Carlsbad is hiring a Firmware Intern to help design, implement, and verify secure embedded firmware for lighting management products.
Lead the design and implementation of a cutting-edge browser agent and the AI systems that enable reliable, repeatable checkout workflows for agentic ecommerce experiences.
Platform Engineer needed to build scalable, secure core platform services and developer tooling at Plaid to support high-throughput financial infrastructure.
Help shape high-impact web experiences for Applied Intuition by building responsive, accessible, and performant customer portals and documentation systems.
Join Antimetal as a Design Engineer to build and maintain a production design system and craft high-fidelity, performant front-end experiences for AI-driven infrastructure tooling.
Experienced Cloud Infrastructure / SRE needed to architect and operate Azure API Management and Amazon API Gateway solutions, automate deployments with GitHub Runners, and enforce SRE best practices across multi-cloud environments for a mission-focused government services provider.
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
