Job Description

Threat Investigator About 10a Labs: 10a Labs' Investigations Team needs additional support to respond to critical safety incidents and conduct investigations across a range of abuse areas, including but not limited to Violence, Hate, Mental Health, CBRNE, Child Safety and more. About the Role: As a threat investigator, you will be supporting our Investigations Team and responsible for detecting and/or responding to malicious uses and abuse , investigating the activity, drafting reports based on your findings, and making recommendations. This will require experience investigating threat actors, harmful behaviors, and/or other activities; as well as a strong ability to use SQL and Python to query, transform, and understand data. You will also respond to escalations and reactive leads, including those that are not caught by our existing safety systems. Investigations involve sensitive and distressing content, including sexual, violent, or otherwise-disturbing material. This role includes serving in an on-call capacity that will involve resolving urgent escalations outside of normal work hours, occasionally including evenings and weekends. The typical on-call rotation is 7 consecutive days per month, though this may shift based on operational needs and candidates should be prepared to remain flexible. In this role, you will: Proactively detect and reacquire bad actors on our platform Investigate potentially policy-violating activity by querying internal data sources (using SQL and Python) and cross-referencing open source information Document and share investigative findings with internal stakeholders Requirements: U.S.-based, with the ability to work West Coast hours (9am - 5pm PT) Ability to be on-call that will involve resolving urgent escalations outside of normal work hours, including occasional evenings and weekends Familiarity with technical investigations, and detection pipelines, especially using SQL and Python Have at least 3+ years of experience working on related topics Ability to rapidly context switch across domains, modalities, and abuse areas Excited to work in a fast paced, ambiguous, and purposeful space with high impact across users and beyond Desired Qualities (but not required): Full professional proficiency in Arabic, Chinese, Farsi, Portuguese, Russian, or Spanish Have experience scaling and automating processes, especially with language models Familiarity using language models to scale Familiarity with one of the following topics/areas: AI safety, child safety, digital mental health, spam and fraud abuse, radicalization/persuasion/grooming; hateful activities and groups At 10a Labs, diversity is central to our mission. We welcome applications from candidates of all backgrounds and are committed to creating an inclusive, equitable work environment.

Job Tags

Similar Jobs