Senior Technical Product Manager Token Factory - Inference (Remote - US)

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Technical Product Manager – Token Factory Inference in United States.

This role offers the opportunity to lead the definition, development, and delivery of highly scalable machine learning inference capabilities, focusing on production-grade systems used at scale. You will own the product roadmap for the inference platform, driving decisions that balance performance, reliability, and real-world customer needs. Working closely with engineering, research, and customer-facing teams, you will translate complex technical workflows into actionable product requirements and features. The position combines technical depth with product vision, ensuring infrastructure and tooling deliver robust, high-throughput ML inference solutions. This role is remote within the U.S. and ideal for professionals passionate about AI/ML, cloud infrastructure, and shaping the future of inference at scale.

Accountabilities:

·         Own and drive the product roadmap for inference capabilities, focusing on distributed, high-throughput ML systems.

·         Collaborate with engineering and research teams to design scalable real-time and batch inference infrastructure.

·         Act as the technical voice in customer engagements, translating ML workflows into actionable product requirements.

·         Support customer PoCs involving model deployment, inference orchestration, and optimization.

·         Deliver intuitive tools and robust infrastructure that improve latency, throughput, orchestration, and deployment efficiency.

·         Guide product adoption by ensuring solutions meet real-world inference challenges and scale effectively.

·         3–5 years of product management experience, ideally in cloud infrastructure, ML platforms, or developer tools.

·         Strong technical foundation (Computer Science or Engineering degree) with the ability to dive into ML model architectures and serving systems.

·         Experience with modern ML inference frameworks such as Triton Inference Server, vLLM, SGLang, TensorRT-LLM, Dynamo, KServe, or Ray Serve.

·         Proven track record of delivering technically complex products supporting distributed, high-throughput ML pipelines.

·         Strong communication skills and experience collaborating across engineering, research, and customer teams.

·         Ability to translate complex technical challenges into clear product requirements and drive execution.

Preferred/Bonus:

·         Deep understanding of modern ML architectures, including transformer-based models and inference characteristics.

·         Experience delivering or supporting ML solutions in production environments.

·         Knowledge of MLOps/AIOps cycles, including observability, performance optimization, and continuous ML system delivery.

·         Competitive salary: $204k–$255k OTE plus equity based on experience.

·         Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families.

·         401(k) plan with up to 4% company match and immediate vesting.

·         Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.

·         Remote work reimbursement: up to $85/month for mobile and internet.

·         Company-paid short-term, long-term, and life insurance coverage.

·         Flexible working arrangements and professional growth opportunities.

·         Dynamic, collaborative environment that encourages innovation and initiative.

Jobgether is a Talent Matching Platform that partners with companies worldwide to efficiently connect top talent with the right opportunities through AI-driven job matching.
When you apply, your profile goes through our AI-powered screening process designed to identify top talent efficiently and fairly.
🔍 Our AI evaluates your CV and LinkedIn profile thoroughly, analyzing your skills, experience and achievements.
📊 It compares your profile to the job’s core requirements and past success factors to determine your match score.
🎯 Based on this analysis, we automatically shortlist the 3 candidates with the highest match to the role.
🧠 When necessary, our human team may perform an additional manual review to ensure no strong profile is missed.
The process is transparent, skills-based, and free of bias — focusing solely on your fit for the role.
Once the shortlist is completed, we share it directly with the company that owns the job opening. The final decision and next steps (such as interviews or additional assessments) are then made by their internal hiring team.
Thank you for your interest!

#LI-CL1