Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Evals Lead image - Rise Careers
Job details

Evals Lead

About Cartesia

Our mission is to build the next generation of AI: ubiquitous, interactive intelligence that runs wherever you are. Today, not even the best models can continuously process and reason over a year-long stream of audio, video and text—1B text tokens, 10B audio tokens and 1T video tokens—let alone do this on-device.

We're pioneering the model architectures that will make this possible. Our founding team met as PhDs at the Stanford AI Lab, where we invented State Space Models or SSMs, a new primitive for training efficient, large-scale foundation models. Our team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to build and ship cutting edge models and experiences.

We're funded by leading investors at Index Ventures and Lightspeed Venture Partners, along with Factory, Conviction, A Star, General Catalyst, SV Angel, Databricks and others. We're fortunate to have the support of many amazing advisors, and 90+ angels across many industries, including the world's foremost experts in AI.

About the Role

The New Horizons Evaluations team is reimagining how we measure progress in interactive machine intelligence. As Evaluations Lead, you will design evaluation frameworks that capture not just what models know — but how they reason, remember, and interact over time. You’ll work at the intersection of research, product, and infrastructure to develop metrics, systems, and studies that define what “intelligence” means in the next generation of AI. This role is ideal for someone who combines scientific rigor with technical execution, and who’s deeply curious about how people use — and want to use — intelligent systems. Your work will shape how Cartesia builds and evaluates frontier models, ensuring that progress isn’t measured solely by static benchmarks, but by deeper qualities like understanding, naturalness, and adaptability in real-world interaction.

Your Impact

  • Identify and define key model capabilities and behaviors that matter for next-generation model evals

  • Develop and implement new evaluation pipelines with robust statistical analysis and clear reporting

  • Partner closely with model training and research teams to embed evaluation systems directly into model development loops

  • Prototype new user studies and behavioral experiments to ground evaluations in real-world use.

What You Bring

  • Experience designing or implementing evaluation frameworks for generative models (audio, text, or multimodal)

  • Strong technical and analytical skills, ability to take open-ended research ideas and translate them into production-ready systems

  • Creativity in defining novel quantitative metrics for subjective or behavioral qualities

  • Excitement for building evaluation systems that bridge research and real-world use

  • Curiosity and rigor in equal measure; motivation driven by discovering how to measure meaningful progress in intelligent behavior

Nice to Have

  • Understanding of model alignment concepts and evaluation approaches

What We Offer

🍽 Lunch, dinner, and snacks at the office

🏥 Fully covered medical, dental, and vision insurance for employees

🏦 401(k)

✈️ Relocation and immigration support

🦖 Your own personal Yoshi

Our Culture

🏢 We’re an in-person team based out of San Francisco. We love being in the office, hanging out together, and learning from each other every day.

🚢 We ship fast. All of our work is novel and cutting edge, and execution speed is paramount. We have a high bar, and we don’t sacrifice quality or design along the way.

🤝 We support each other. We have an open & inclusive culture that’s focused on giving everyone the resources they need to succeed.

Average salary estimate

$210000 / YEARLY (est.)
min
max
$170000K
$250000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Posted 5 hours ago

Cartesia seeks a Research Engineer (Synthetic Data) to design large-scale synthetic data generation and quality-control systems that accelerate next-gen multimodal AI research and production.

Photo of the Rise User
Posted 5 hours ago

Cartesia is hiring a Technical Sourcer to build deep candidate pipelines and personally engage top research and engineering talent for its foundation-model teams in San Francisco.

Radical AI is hiring a Computational Materials Scientist to lead DFT and multiscale simulations for metal alloys, enabling AI-driven materials discovery and high-throughput computational workflows.

Photo of the Rise User
Posted 5 hours ago

Cartesia seeks a Research Engineer (Synthetic Data) to design large-scale synthetic data generation and quality-control systems that accelerate next-gen multimodal AI research and production.

Photo of the Rise User

Lead the development and productionization of novel large-scale audio understanding models to enable robust, multimodal AI that reasons over long-duration audio.

Retro Hybrid Redwood City, CA
Posted 14 hours ago

Lead CMC coordination and clinical trial material planning to advance Retro’s autophagy-enhancing small-molecule programs into first-in-human studies.

Photo of the Rise User

Asimov is hiring a Senior Associate Scientist to lead lentiviral producer cell line development and viral characterization for next-generation therapeutic manufacturing.

Photo of the Rise User
Posted 8 hours ago

Experienced R&D engineer needed to lead design, testing, and implementation of medical devices and equipment at Penumbra's Alameda site.

Photo of the Rise User
Posted 23 hours ago
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

NVIDIA seeks a Senior Deep Learning Performance Architect to design, model, and analyze next-generation AI hardware and software for optimal performance, cost, and power efficiency.

Spear Bio is hiring a Scientist/Senior Scientist to lead immunoassay development and manufacturing support for its ultrasensitive SPEAR platform at the Woburn headquarters.

Photo of the Rise User
Posted 7 hours ago

Experienced R&D Specialist SME needed to lead technology evaluation, prototyping, and transition activities in support of federal programs requiring Top Secret clearance and DoD 8140 certification.

Founded in 1992, Cartesia, Inc. is a group of talented professionals providing custom solutions in the areas of engineering design automation, Web-based applications development, and Microsoft Windows-based software construction and integration. ...

10 jobs
MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, onsite
DATE POSTED
October 27, 2025
Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!