Fast Facts

College Board is seeking an experienced Engineer IV to ensure quality and reliability of assessment scoring capabilities. This fully remote or hybrid role offers the opportunity to work with a team on innovative testing strategies and automation processes in a fast-paced Agile environment.

Responsibilities: Key responsibilities include designing and maintaining test plans, developing automated testing frameworks, performing various testing types, analyzing test results, and collaborating with technical and business teams.

Skills: Candidates should possess strong analytical and problem-solving skills, proficiency in test automation and CI/CD tools, experience with AWS services, and familiarity with Agile methodology and various programming languages.

Qualifications: A Bachelor's degree in a related field and at least 5 years of professional software quality assurance experience is preferred; experience with advanced testing strategies and automation is highly valued.

Location: This is a fully remote position, with the option for hybrid work for those near College Board offices in Virginia.

Compensation: $137000 - $148000 / Annually

Engineer IV

College Board – Technology

Location: 1) This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office). OR This is a hybrid role and requires the candidate to be on-site at CB offices every Tuesday and Wednesday.

Type: This is a full-time position

About the Team 

We are a team of technologists working together to solve complex technical problems and develop innovative solutions. Embracing a culture of continuous improvement, we look for ways to incorporate new technologies in the delivery of systems that are responsible for analysis and scoring of tests of SAT/PSAT and AP programs, all with the singular purpose of providing comprehensive assessments to millions of students. We regularly collaborate while pitching and sharing our ideas to help define the future of our applications. Our team is characterized by our positive team culture, strong technical skills, focus on delivering value and our ability to have fun while being productive. 

About the Opportunity  

As an Engineer IV focused on quality, you are responsible for ensuring the quality and reliability of key scoring capabilities of College Board’s assessments through advanced testing strategies, automation frameworks and an advanced knowledge of QA best practices. Leveraging your AWS expertise, strong analytical and problem-solving skills, you will analyze complex feature requirements, automate testing processes, and drive efficiencies. Collaborating with cross-functional teams, you will contribute to improving reliability and efficiency of systems. This role is ideal for someone who thrives in a fast-paced, Agile environment and is eager to make a meaningful impact on the digital transformation of SAT, PSAT, and AP exams.

In this role, you will:

• Design, develop, implement and maintain comprehensive test plans, test cases and automated test suites
• Collaborate with product managers and developers to review requirements and ensure testability
• Design and develop automated testing frameworks for scoring products
• Maintain CI/CD pipelines with integrated automated testing
• Identify, recommend and implement tools to enhance testing efficiency
• Conduct functional, regression, performance and security testing
• Track and analyze test results, defect trends and root causes
• Ensure compliance with quality and security standards
• Collaborate with business and technical teams to translate data insights into actionable recommendations.
• Develop and participate in the review of requirements, data mappings, user stories, and other artifacts, clearly communicating to both business and technical team members.
• Assist in resolving production issues by troubleshooting and working with engineering teams to implement fixes.
• Support functional testing by validating data accuracy, system behavior, and process integrity.

About you, you have

• Bachelor’s degree in computer science, Computer Engineering, Software Engineering or equivalent preferred
• 5+ years of professional experience in enterprise-wide software quality assurance 
• Strong analytical and problem-solving skills with a keen eye for detail.
• Excellent communication and collaboration skills to work across technical and business teams.
• Understanding of Agile methodology with a willingness/ability to work in a DevOps environment.
• Strong proficiency in test automation
• Experience with CI/CD tools
• Knowledge of scripting/programming languages/tools (e.g., JavaScript, Nodejs, cucumber, etc.)
• Minimum of 1-2 years of hands-on experience working with AWS services, including Lambda, S3, Step Functions, DynamoDB, SNS, SQS, CloudWatch and more
• Proactive with a strong sense of ownership and responsibility
• Capable of analyzing, planning, designing, and owning vaguely defined issues with little supervision
• Collaborative attitude that incorporates various perspectives
• Strong problem solving and organizational skills

Additional nice to have qualifications

• Experience with TypeScript
• Any experience applying AI-driven test automation or predictive analytics for defect detection
• Hands-on experience with CI/CD and NoSQL
• Skilled at creating/generating complex test data that aligns with business rules, covering edge cases and complex scenarios.

About Our Process  

• Application review will begin immediately and will continue until the position is filled   
• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.    

All roles at College Board require:  

• A passion for expanding educational and career opportunities and mission-driven work 
• Authorization to work in the United States for any employer 
• Proficiency in Microsoft Suite Tools (or a willingness to learn) 
• Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and a comfort learning and applying new digital tools independently and proactively.  
• Clear and concise communication skills, written and verbal 
• Evidence of skills and mindsets required to live out College Board’s Operating Principles, notably: 
• A commitment to candid, timely, respectful feedback  
• A learner orientation and an openness to ideas and diverse perspectives 
• The ability to push for excellence through data-informed decision-making, iterative learning, external benchmarking and user-inputs 
• Strong problem-solving skills, including the ability to break down complex issues and identify clear paths forward 
• A track record of prioritizing high-impact work, simplifying complexity, taking initiative, and making decisions quickly with clarity of purpose 
• A habit of collaborating across differences, practicing empathy, and contributing to a culture of trust and shared success 

About Our Process   

• Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days. 
• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.    

What We Offer 

At College Board, we offer more than just a paycheck—we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation, grounded in your qualifications, experience, impact, and the market. 

A Thoughtful Approach to Compensation 

• The hiring range for this role is $137,000 to $148,000.  
• Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board. 
• We aim to make our best offer upfront—rooted in fairness, transparency, and market data. 
• We adjust salaries by location to ensure fairness, no matter where you live. 

You’ll have open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process. Check out our careers page for more. 

#LI-DC1 

#LI-REMOTE