Kairos
Back to jobs

Incident Manager, Safeguards

On-site
AnthropicSan Francisco, CA, US / Washington, DC, US4 hours agoWebsite
ActiveHiring slowdown reported
Manager / Lead
Safeguards (Trust & Safety)

Compensation

$245,000-$285,000/yr
Apply
Share

Description

About the role

Anthropic's Safeguards team plays a critical role in ensuring our AI systems are deployed safely, responsibly, and in line with our values.

As an Incident Manager, you will manage Safeguards incidents involving our AI systems from declaration through closure. You will assess severity, bring in the right people from Legal, Communications, Policy, Threat Intelligence, Security, Engineering, and research teams, keep leadership informed, and see follow-up work through. You will also oversee the Safeguards Enforcement on-call queue on a rotating basis, and help build and scale the incident response program, including runbooks, post-incident reviews, and automation of routine work.

Important context for this role: in this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a violent, sexual, or psychologically disturbing nature. This role also includes after-hours and weekend incident coverage on a rotating basis.

Key responsibilities

  • Serve as incident commander for Safeguards incidents from declaration through closure

  • Assess what qualifies as an incident, propose severity, and coordinate responders across Legal, Communications, Policy, Threat Intelligence, Security, Engineering, and research teams

  • Keep everyone working from the same facts by tracking input from each team, establishing what is known, what has changed, and what is still open, and sending regular updates that executives and partner teams rely on

  • Make sure Legal, Communications, and Public Policy are consulted before decisions that need them, and coordinate any external notifications

  • Run post-incident reviews, assign action items to named owners, and track them through closure

  • Oversee the on-call queue during your rotation as the first responder for urgent requests and escalations to Safeguards Enforcement

  • Triage each request, resolve what you can, route the rest to the owning team, and recognize when a request is the start of an incident

  • Take part in after-hours and weekend incident coverage on a rotating basis

  • Scope and deliver projects that improve the incident response program, such as on-call automation, incident readiness, and post-incident reviews and metrics

  • Draft and maintain runbooks and standard operating procedures

  • Work with Safeguards engineers to automate or reroute requests by writing the decision rules and testing the result

  • Maintain the incident record and the metrics that show leadership how the program is performing

Minimum qualifications

  • Experience running incidents or urgent escalations from start to finish in trust and safety, security, platform integrity, crisis management, or a comparable field, and readiness to lead high-severity incidents with support

  • Hands-on experience with incidents where someone was abusing or misusing a product or platform, such as account compromise, fraud, or coordinated malicious activity

  • Ability to make clear decisions under time pressure, record your reasoning, and recognize when a decision belongs to Legal, Policy, or leadership

  • Ability to write short, accurate updates that an executive can act on and that hold up to legal and external scrutiny

  • Experience coordinating people across many functions who do not report to you, securing their commitments, and following through on them

  • Experience improving an operational process on your own initiative, and the ability to tell which steps need a person and which can be automated

  • Willingness to do hands-on queue work as a regular part of the job, and to treat it as a source of information about what is breaking

  • Ability to participate in after-hours and weekend incident coverage on a rotating basis

Preferred qualifications

  • Experience joining an incident response function early and helping write runbooks and review processes

  • Experience with incidents involving AI systems

  • Experience with the enforcement steps that follow an incident, such as account actions, law enforcement referrals, or user and customer notifications

  • Experience working with threat intelligence or security investigation teams during an incident

  • Experience with regulatory or external incident reporting and disclosure

  • Experience running an on-call rotation or support escalation queue, including setting and measuring response targets

  • Experience using AI tools to automate triage, summaries, or routine decisions, with checks on quality

  • Working knowledge of SQL or similar tools for analyzing incident and queue data

  • Experience designing and facilitating tabletop exercises

  • Genuine interest in AI safety and responsible technology development

Stack

SQL
Posted
Oct 24, 2026
Last seen
Oct 24, 2026
First seen
Oct 24, 2026

Similar roles

Browse more AI jobs