Scientific Coding Evaluator – STEM
Mercor is seeking PhD holders, doctoral candidates, and exceptional Master's graduates in STEM disciplines with strong scientific programming experience to join a high-impact AI research initiative in partnership with a leading AI lab.
This role involves evaluating and enhancing large language models (LLMs) by applying subject-matter expertise in scientific coding to rigorously assess model performance in STEM-specific programming tasks.
Key Responsibilities
- Evaluate the accuracy, logic, and domain relevance of Python-based code and reasoning generated by LLMs in tasks related to graduate-level science.
- Review outputs across physics, chemistry, biology, and other scientific domains involving numerical methods, data analysis, modeling, and simulation.
- Complete structured evaluations for each task, answering 8–10 rubric questions and providing short written comments explaining each judgment.
- Identify code correctness issues, scientific inaccuracies, and gaps in technical execution.
- Work independently using provided evaluation tools and rubrics in an asynchronous, remote setting.
You’re a strong fit if you have:
- A PhD (or are currently a PhD candidate) in Physics, Chemistry, Biology, Engineering, or a related STEM field.
- Strong experience using Python in scientific contexts (e.g. research, modeling, or applied analysis).
- Familiarity with scientific libraries such as NumPy, SciPy, pandas, or similar.
- A strong ability to critically evaluate both scientific reasoning and code implementation.
- Excellent written communication skills and attention to technical detail.
- Comfort working independently and asynchronously in a remote environment.
Role Details
- Part-time (10–20 hours/week) with flexible scheduling.
- 100% remote and asynchronous — work from anywhere, anytime.
Compensation & Legal
- Contractor position via Mercor, paid hourly.
- Competitive rates based on domain expertise, ranging from $40 to $65/hour.
- Weekly payments processed securely through Stripe Connect.
About Mercor
Mercor is a San Francisco-based company specializing in connecting elite professionals with cutting-edge AI initiatives. Our investors include Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey. We help leading AI labs accelerate progress by bringing in top-tier human expertise.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Mercor is recruiting PhD-level scientists and advanced STEM graduates to perform part-time, remote evaluations of LLM outputs in biology, physics, and chemistry for a high-impact AI research program.
Mercor is hiring passionate hobby experts to provide product recommendations and train AI models in a flexible, fully remote part-time contractor role.
Mercor seeks PhD-level biological scientists to design and evaluate advanced biology problems for a top AI lab in a flexible, remote contractor role.
Provide part-time clerical support to the Atlanta Registrar's Office, focusing on scanning, data entry, and front-line assistance while holding a Federal Work Study award.
Dandy is seeking a field-based Multi Location Group Trainer in the Boston/Northeast area to deliver hands-on clinical training and accelerate adoption of intraoral scanning and digital workflows across multi-practice clients.
Equus Workforce Solutions seeks a hands-on Work Based Learning Coordinator in Riverton, WY to manage student work experiences and develop employer partnerships that lead to meaningful placements.
Hazel Health is seeking a California-licensed Mental Health Therapist to provide part-time evening virtual therapy to K-12 students across partner school districts.
Work with McGraw Hill’s PreK–12 team to design standards-aligned math assessments and instructional supports for grades 6–12 in a remote, project-based role.
Daybreak Health is seeking a licensed Illinois LCSW/LCPC/LMFT (1099, part-time) to deliver teletherapy to students and support school-based mental health efforts.
HMH is hiring a Learning Experience Designer I to design and iterate engaging, research-based digital math experiences for K–12 learners as a member of an agile product team.
Virtual Pediatric Mental Health Intake Therapist (1099) needed to perform K-12 intakes and assessments for Hazel Health, supporting school-based mental health through telehealth.
Circle Care Services seeks an experienced, licensed BCBA to provide ABA therapy and supervise therapists across daycare, in-home, and clinic settings in Gwinnett County, GA.
Hazel Health seeks a licensed pediatric mental health intake therapist to perform virtual K-12 intakes and support transitions into care as a remote 1099 contractor.
EPIC Early Learning seeks a dependable Classroom Assistant to support preschool classroom activities, family engagement, and culturally responsive Head Start services in Yakima.
Provide evidence-based teletherapy to Wisconsin students as a part-time, remote Mental Health Therapist for Daybreak Health with flexible hours and free supervision.
We use AI to understand human ability and match talent with the opportunities they're best suited for.
76 jobs
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
