OpenAI logo
OpenAI Posted 1d ago

Model Policy Manager, Emerging AI Misuse

Location

San Francisco

Hybrid

Contract

Permanent

Full-time

Salary

$207–335k

Gross per year

Experience

Lead

Lead level

Job summary

Responsibilities

As AI systems become more capable, the same advances that expand their legitimate uses can also lower barriers to harm. Emerging misuse risks range from AI assistance with conventional weapons development and the misuse of AI-enabled robotics to fraud, impersonation, and other forms of abuse that…

  • Build and update threat models as capabilities evolve. Assess what people could plausibly do, what expertise and resources they would need, and how AI changes those barriers.
  • Define when models should help, limit assistance, or refuse in situations where the same capability has legitimate and harmful uses.
  • Turn expert safety judgment into instructions, training examples, and evaluations that teach models when to help, when to limit assistance, and when to refuse.
  • Turn threat models into evaluation scenarios and grading guidance. Analyze model outputs, red-team findings, and deployment data to identify where models enable misuse or block…
  • Partner with research, engineering, security, and product teams to apply findings to model training, deployment decisions, and monitoring.

Read the full job posting

This summary is written by Tokn from the original posting. Only the posting published by OpenAI is authoritative. Request a removal

jobs.ashbyhq.com ↗
Baseten logoBaseten

Web Engineer

$200–240k gross

PermanentHybridSan Francisco
Posted 1d ago