Applied Scientist (Evaluation & Safety)
About Amigo
We build AI that puts people first. Instead of just making organizations more efficient, we ensure AI systems actually help humans thrive.
We focus on healthcare because getting things right matters most in this field. Our technology provides organizations with confidence that their AI is functioning correctly before deployment. We use advanced testing and verification to make sure these systems are reliable enough for critical decisions.
We operate globally and follow strict regulations. We've raised $6.5M from investors, including General Catalyst and GSV Ventures. Our team comes from diverse backgrounds—tech, psychology, economics, healthcare, and policy—all working together to create AI that organizations can trust and that genuinely benefits people.
About this role
As an Applied Scientist - Evaluation & Safety at Amigo, you'll build the evaluation frameworks that ensure our systems are safe and effective in healthcare environments. You'll design adversarial testing systems, create safety evaluation protocols, and build frameworks that catch potential failures before they reach patients. Your work is critical to maintaining the reliability and safety standards that healthcare organizations require.
What you'll do
Design evaluation frameworks for healthcare systems
Build adversarial testing systems that identify potential failure modes before deployment
Create safety evaluation protocols that ensure systems meet healthcare standards
Design test suites that cover edge cases, rare diseases, and complex medical scenarios
Build automated evaluation pipelines that continuously assess system performance
Collaborate with healthcare professionals to develop clinically relevant evaluation metrics
What we're looking for
Strong background in system safety and adversarial testing
Experience with bias detection and fairness testing
Knowledge of healthcare safety standards
Understanding of statistical evaluation methods
Track record of building evaluation systems for production software
Nice to have
Healthcare or regulated industry experience
Background in medical device testing or clinical trial design
Experience with formal verification or safety-critical systems
Knowledge of healthcare compliance and audit requirements
Benefits
Health & Wellness
Comprehensive health, dental, and vision insurance
Mental health support and wellness coaching
Flexible wellness stipend for fitness, therapy, or personal growth
Daily catered lunch and dinner
Growth & Development
Annual learning budget for courses, books, or conferences
Conference attendance budget for professional development
Development setup of your choice
Academic collaboration opportunities
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Lead the design and implementation of statistical confidence systems and risk models that enable safe, trustworthy AI deployments in healthcare.
SpotOn is hiring a Territory Sales Representative / Hospitality Specialist in Three Lakes, FL to prospect local restaurants and small businesses and close sales of POS, software, and payments solutions.
Lead the design and implementation of Yuzu Health’s pricing system to make real-time, explainable reimbursement decisions for members and providers.
Experienced data scientist needed to build and deploy AI/ML models for predictive maintenance and logistics forecasting in support of USAF CBM+ initiatives at Redhorse Corporation.
At Haystack News, a Senior Data Scientist will apply advanced statistical methods, causal inference, and machine learning to improve recommendations and measure product impact across our news streaming experience.
Experienced quantitative researcher sought to design and deploy ML-driven predictive features and trading signals for a fast-moving proprietary trading firm operating remotely.
Zoox's ODIN team is hiring a Senior/Staff Machine Learning Engineer to lead development and deployment of multimodal LLMs that enhance robotaxi environmental understanding and safety.
An entry-level AI/ML engineering internship with PingWind to support dataset preparation, model training, evaluation, and deployment for federal digital transformation projects.
Lead the design and implementation of statistical confidence systems and risk models that enable safe, trustworthy AI deployments in healthcare.
Quilter is hiring a Senior Scaled ML Engineer to design, train, and optimize large-scale ML models and infrastructure that automate PCB layout and circuit board design.
Brillio seeks a Data Scientist with electrical grid expertise to design, prototype, and operationalize advanced analytics for utility grid operations and planning.
Quilter is hiring a Senior ML Ops Engineer to own and scale production ML training and inference infrastructure for automated PCB layout generation.
Lead the development of human-centered behavioral and population models that help healthcare AI systems understand, predict, and optimize real-world human decision-making and outcomes.
SpringRole is the first professional reputation network powered by artificial intelligence and blockchain to eliminate fraud from user profiles. Because SpringRole is built on blockchain and uses smart contracts, it's able to verify work experienc...
456 jobs
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
