Posted 1d ago

OpenAI Posted 1d ago
Model Policy Manager, Emerging AI Misuse
Location
San Francisco
Hybrid
Contract
Permanent
Full-time
Salary
$207–335k
Gross per year
Experience
Lead
Lead level
Job summary
Responsibilities
As AI systems become more capable, the same advances that expand their legitimate uses can also lower barriers to harm. Emerging misuse risks range from AI assistance with conventional weapons development and the misuse of AI-enabled robotics to fraud, impersonation, and other forms of abuse that…
- Build and update threat models as capabilities evolve. Assess what people could plausibly do, what expertise and resources they would need, and how AI changes those barriers.
- Define when models should help, limit assistance, or refuse in situations where the same capability has legitimate and harmful uses.
- Turn expert safety judgment into instructions, training examples, and evaluations that teach models when to help, when to limit assistance, and when to refuse.
- Turn threat models into evaluation scenarios and grading guidance. Analyze model outputs, red-team findings, and deployment data to identify where models enable misuse or block…
- Partner with research, engineering, security, and product teams to apply findings to model training, deployment decisions, and monitoring.
Read the full job posting
This summary is written by Tokn from the original posting. Only the posting published by OpenAI is authoritative. Request a removal
Similar jobs
All Machine Learning jobs in San Francisco →Posted 1d ago
Posted 1d ago

