Fast Facts

The Assessment Solution Strategist role at Pluralsight involves designing and managing assessment components to accurately measure skills and competencies, with an emphasis on quality improvement and data analysis.

Responsibilities: Key responsibilities include designing assessment blueprints, conducting data analysis for quality management, ensuring content aligns with educational goals, and collaborating with internal and external partners in assessment development.

Skills: Candidates should possess strong analytical skills, knowledge of assessment design principles, excellent writing abilities, and project management skills, alongside familiarity with LMSs and assessment tools.

Qualifications: A Bachelor’s degree in a relevant field and 3+ years of experience in assessment development are required; a Master’s degree or additional experience is preferred.

Location: This is a remote position in the USA, with some on-site requirements for applicants within 45 miles of the Westlake/Dallas, TX office.

Compensation: $67200 - $93300 / Annually

Job Description:

An Assessment Solution Strategist is responsible for the design, development, continuous health and management of all components of Pluralsight assessments. This role involves creation of assessment blueprints, prompt generation for item creation, data and item analysis, forms management, continuous quality improvement and some vendor relationship and project management.

We are seeking a detail-oriented Assessment Solution Strategist to join our team in creating high-quality assessments that accurately measure skills, knowledge, and competencies. You will craft valid, reliable, and engaging assessments that drive learning and performance outcomes. Whether it's building learning checks, certification prep, or high-integrity, criterion-referenced assessments you’ll play a key part in ensuring learners are accurately and fairly evaluated across a variety of technical and professional domains.

A successful Assessment Solution Strategist will have knowledge of and experience in executing the full life cycle of psychometrically grounded design, development and quality assurance across the entire assessment lifecycle.

Who you’re committed to being:

• You enjoy learning and are open to new ways of doing things.
• You are not afraid to be yourself, experiment, make mistakes and learn from them, ask questions, or voice your concerns.
• When communicating you are self-aware, insightful, and proactive.
• You are a team member first and individual contributor second. You are aware that high-performing teams are only as strong as their weakest link.
• You believe in continuous improvement and request frequent feedback from others.

What you’ll do:

• Design assessment blueprints and related assessment deliverables.
• Quality assessment performance management: item/test analysis, calibration, equating/scaling, reliability/validity checks.
• Data analysis and ongoing assessment monitoring and continuous quality improvement
• Ensuring that assessment content aligns with curriculum standards, learning objectives, and educational goals.
• Leverage AI to optimize processes and deliverables.
• Establish guidelines and standards for creating assessment content to maintain consistency and reliability.
• Staying updated on best practices in assessment design and research to inform assessment development.
• Documentation of processes, procedures, and decisions related to assessment design, development and continuous quality monitoring and improvement
• Design and develop valid and reliable assessments that align with learning objectives and competency frameworks.
• Monitors assessment portfolio across the assessment lifecycle
• Manage SOWs for vendor relations
• Collaborates with internal and external partners throughout the design, development, and deployment of assessments.
• Workload management, ability to handle multiple tasks and pay attention to detail
• Individual workload project management
• Staying current with assessment trends, learning science, and industry standards (e.g., AERA, APA, NCME).
• Support the development of digital assets or other collateral as related to assessment.
• As required, provides training, consultation, or guidance to team members and partners on assessment models, assessment design and development practices, and data-driven, evidence-based practices in assessment.
• Performs other related duties as assigned.
• An appetite for curiosity and rapid innovation.

Experience you’ll bring:

• Bachelor’s degree in academic, psychological or educational measurement, instructional design, psychometrics, or a related field.
• 3+ years of relevant professional designing and developing high integrity assessments or background in educational measurement.
• Strong command of assessment types, taxonomy, and principles of validity and reliability.
• Excellent writing, editing, and quality assurance skills.
• Experience working with vendors, SMEs and cross-functional teams.
• Experience learning management systems (LMSs), authoring tools, and item banks.
• Innovation driven, growth mindset.
• Candidates should have strong organizational and project management skills to effectively manage multiple assessment development projects simultaneously, meet deadlines, and coordinate with team members.
• Strong analytical skills are important for analyzing assessment data, identifying trends, and making data-driven decisions to improve assessment content and processes.
• Attention to detail is crucial for ensuring the accuracy, clarity, and consistency of assessment content.
• Previous experience in assessment development, instructional design, curriculum development measurement, or a related field is required.
• Experience with technical/IT content or certifications (e.g., AWS, Azure, Python, security).
• Background in psychometrics or data analysis using tools like Excel, R, or SPSS.
• Knowledge of accessibility and universal design for learning (UDL) standards.
• Experience with adaptive testing or automated assessment tools.
• Familiarity with Pluralsight platform and value proposition
• Experience with SaaS software (eg. ZenDesk, Asana, Confluence, and Smartsheet)

Requirements:

• Masters Degree or 3-5 years experience in assessment design, development or measurement.
• This is a remote role; however, applicants located within 45 miles of our Westlake/Dallas, TX office should expect to work on-site Tuesday through Thursday, with remote flexibility on Mondays and Fridays. This approach enables more effective collaboration, quicker decision-making, and a stronger culture, while still providing flexibility.

Why you’ll love working here:

• We’re a blended workplace, where team members work remotely or in a hybrid setup depending on their role and location
• We’re mission driven and guided by our culture pillars
• We have a strong commitment to diversity and belonging
• We cultivate a culture of trust, autonomy, and collaboration
• We’re lifelong learners and champion team member growth and advancement
• We’ve got you covered - team member benefits include competitive compensation packages, medical coverage, unlimited PTO, wellness reimbursements, Pluralsight subscription, professional development funds and more.

About us:

Pluralsight provides the only learning platform dedicated to accelerating the technology skills and capabilities of today’s tech workforce. Thousands of companies, government organizations and individuals around the world rely on Pluralsight to support critical technology skill development in areas that are crucial to innovation including artificial intelligence, cloud computing, cybersecurity, software development, and machine learning. Pluralsight provides highly curated content developed by vetted technology experts, industry leading skill assessments, and hands on, immersive learning experiences designed to help individuals skill-up faster.

Physical Requirements:

This role is primarily performed in an office or home office setting and involves standard computer-based work.

EEOC Statement & Accommodations Statement:

Bring yourself. Pluralsight is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or veteran status. We also consider qualified applicants with criminal histories, consistent with EEOC guidelines and local laws.

If you need an accommodation to apply, interview, or perform essential job functions, please visit the bottom of our website to learn how to request an accommodation. Learn more about our commitment to diversity, equity, inclusion, and belonging in our DEIB Report.

The annual US base salary range for this role is $67,200 - $93,300 USD. Actual compensation will depend on location, skills, experience, and other factors. Additional benefits and bonuses may apply.

Applications must be submitted within 90 days after the initial posting date to be considered.

Recruiting Scam Notice:

Please be aware of recruiting scams. We’ll only contact you from an @pluralsight.com email or verified channels. We never ask for sensitive personal info or payments as part of the hiring process. All openings are posted on our Careers page.

#LI-DB1

#LI-Remote