Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Senior/Staff Data Scientist - Product Experimentation & Evaluation (LLMs & AI) image - Rise Careers
Job details

Senior/Staff Data Scientist - Product Experimentation & Evaluation (LLMs & AI)

We are looking for a senior-level Data Scientist to drive experimentation, evaluation, and AI/LLM-powered product improvements. In this role, you will act as a strategic partner to product, engineering, and trust & safety teams, responsible for defining evaluation frameworks, leading experiments (A/B tests, quasi-experiments, etc.), and translating both offline and live model performance into actionable product enhancements.

The ideal candidate will have a strong track record in startup-style experimentation—moving quickly and efficiently with rigorous methods—as well as experience conducting product experimentation at scale. Proven expertise in leading and managing teams to deliver high-impact data science outcomes is highly desirable.

  • ~8-12+ years of experience in data science / ML roles, ideally with experiment design / product analytics.
  • Proven track record in both startup-style and large-scale product experimentation.
  • Experience leading teams, setting strategy, and driving execution in cross-functional environments.
  • Strong background with statistical methods, causal inference, and rigorous measurement.
  • Experience using LLMs / NLP / AI / prompt engineering or closely related field.
  • Excellent coding skills in Python (or similar), strong SQL; experience building and deploying models or analytic pipelines.
  • Ability to work in cross-functional teams, translate technical results into business or product changes.
  • Strong communication skills; ability to explain complex analyses to non-technical stakeholders.

Nice to have:

  • Experience fine-tuning or working with multiple LLM providers / APIs.
  • Experience with experiment platforms or building internal tooling for experimentation & model evaluation.
  • Experience in voice / ASR or other multi-modal data.

Working Terms:

  • Candidates must be flexible and work during US hours at least until 6 p.m. ET in the USA, which is essential for this role & must also have their own system/work setup for remote work.

Average salary estimate

$210000 / YEARLY (est.)
min
max
$160000K
$260000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Posted 5 hours ago

Stash seeks a Senior Growth Data Scientist to apply statistics, ML, and experimentation to optimize user acquisition, retention, and lifetime value across our product and marketing efforts.

Photo of the Rise User
Inclusive & Diverse
Customer-Centric
Mission Driven
Fast-Paced
Growth & Learning
Transparent & Candid
Diversity of Opinions
Work/Life Harmony
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Learning & Development
Fitness Stipend
401K Matching
Equity
Life insurance
Disability Insurance
WFH Reimbursements
Flex-Friendly
Paid Time-Off
Maternity Leave
Paternity Leave
Paid Holidays
Paid Volunteer Time
Sabbatical

Zillow's Agentic AI team is hiring a Machine Learning Engineer to design, train, evaluate, and ship agentic LLM solutions that improve user understanding and decision-making across the home search experience.

Bah Hybrid Washington, DC
Posted 9 minutes ago

Senior AI Engineer to architect and deploy robust AI/ML solutions on cloud and edge environments while leading teams and supporting classified client work.

Photo of the Rise User
ServiceNow Hybrid Building A,B,C 2225 Lawson Lane, Santa Clara, California , United States
Posted 5 hours ago
Inclusive & Diverse
Mission Driven
Rise from Within
Diversity of Opinions
Work/Life Harmony
Empathetic
Feedback Forward
Take Risks
Collaboration over Competition
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Conferences Stipend
Paid Time-Off
Maternity Leave
Equity

ServiceNow is hiring a Machine Learning Engineer to build LLM-powered, production-ready AI features that simplify enterprise workflows and scale to thousands of customers.

Photo of the Rise User
Posted 11 hours ago

HomeBuddy is hiring a Deployment-Focused Data Scientist to build and ship production ML solutions that boost lead quality, conversion, and revenue.

Photo of the Rise User
Posted 10 hours ago

An operationally focused Associate Scientist II role at AbbVie’s GCLO group, responsible for compound inventory, lab workflows, SOPs and process improvements to support R&D operations.

Photo of the Rise User
Rilla Hybrid New York City
Posted 5 hours ago

Rilla is hiring an early-stage ML Engineer to architect and deploy voice-first AI systems that extract business-critical insights from real-world conversations.

Photo of the Rise User
Posted 22 hours ago

Design and build large-scale data pipelines and platforms to power analytics and product decisions for LinkedIn's global Data Science organization.

Photo of the Rise User
RBC Hybrid New York, New York, United States of America
Posted 4 hours ago

Senior quantitative leader to design, implement and deliver interest rate and FX models, pricing and risk tools for RBC’s Flow Rates Trading and FX Forwards desk in New York.

Posted 18 hours ago

Character Biosciences is hiring a Principal Biostatistics Data Scientist to lead statistical modeling, biomarker development, and longitudinal analyses on multimodal clinical, imaging, and genomic data to support drug discovery and clinical development.

Photo of the Rise User
Posted 12 minutes ago

Senior Data Scientist at LiveRamp to design measurement frameworks, analyze large customer datasets, and translate quantitative insights into business recommendations across marketing and ad‑tech use cases.

Photo of the Rise User
Pinterest Hybrid San Francisco, CA, US; Remote, US
Posted 17 hours ago

Lead and grow a high-performance data science team to drive ads delivery, causal inference, experimentation and ML-informed decision-making across Pinterest's ads stack.

Contribute to Adobe Firefly’s GenAI Services by building optimized inference pipelines, integrating generative models into flagship products, and developing scalable ML systems for production.

people, places & tech we develop and invest in the sharing economy to build amazing places which create unforgettable memories for residents and short term visitors. we bring back to life amazing historic properties, and enable them for comfor...

5 jobs
MATCH
Calculating your matching score...
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, remote
DATE POSTED
September 24, 2025
Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!