Critical Harms Intelligence Analyst (Threats of Violent Extremism, Dangerous Orgs)

The Safety Operations team is focused (okay, maybe obsessed) on scaling Roblox’s Moderation Operations and redefining our user experience through our multi-year vision and strategy execution. We’re seeking a passionate Threats of Violent Extremism (TVE) subject matter expert dedicated to finding malicious actors and supporting the development of scalable solutions to mitigate their activities. You’ll join our Critical Harms Intelligence, Investigations, and Operations (CHIIOPS) team, applying expertise to high-risk behaviors and collaborating with Safety Product and Engineering teams to improve detection and enforcement. CHIIOPS Intelligence Analysts are responsible for uncovering “unknown unknowns” of how malicious actors bypass existing systems, educate cross-functional partners on these patterns, and support proactive lead identification for automated detection system development. 

Please note: This role may review graphic, controversial, and sometimes offensive content in line with Roblox’s handling policies. This role will also require some on-call support.

You will report to the Critical Harms Intelligence, Investigations, and Operations Manager.

You Will:

• Conduct in-depth analysis of platform content to identify violative or evasive behaviors employed by TVE actors, encompassing a wide range of user-generated content types.
• Utilize both internal and open-source data to identify risk leads and gather relevant content samples for specialized moderator review, supporting analytic hypothesis testing and Machine Learning (ML) detection development.
• Deliver analytic risk assessments to cross-functional partners, highlighting gaps in current detection and enforcement processes, and collaborate with these partners to identify effective risk mitigation strategies.
• Develop comprehensive expertise in Roblox's internal and external safety policies and tools, leveraging data to drive improvements in the company's overall escalation ecosystem.

You Have

• Demonstrated subject-matter expertise in the online expression of Terrorism/Extremist behavior, with a minimum of 4 years of direct experience addressing such behavior in a user-generated content environment.
• Experience combining internal data analysis and subject-matter research to identify behavioral trends and risks and relevant content samples. 
• Experience in developing strategic project plans, roadmaps for tracking progress, and defining success and impact measures.
• Experience supporting scaled solutions for platform risks.
• Competence in data analysis and basic querying, including foundational Python or SQL knowledge.