Research Engineer, AI Safety & Alignment

Job summary

Responsibilities

Joining us as a Research Engineer, you'll be at the forefront of tackling one of the most critical challenges in AI today: safety and alignment. Your work will be pivotal in understanding and mitigating the risks of advanced AI, conducting foundational research to make our models safer, and…

• Develop and implement novel evaluation methodologies and metrics to assess the safety and alignment of large language models.
• Research and develop cutting-edge techniques for model alignment, value learning, and interpretability.
• Conduct adversarial testing to proactively uncover potential vulnerabilities and failure modes in our models.
• Analyze and mitigate biases, toxicity, and other harmful behaviors in large language models through techniques like reinforcement learning from human feedback (RLHF) and…
• Collaborate with engineering and product teams to translate safety research into practical, scalable solutions and best practices.

What they're looking for

• Hold a PhD (or equivalent experience) in a relevant field such as Computer Science, Machine Learning, or a related discipline.
• Write clear and clean production-facing and training code
• Experience working with GPUs (training, serving, debugging)
• Experience with data pipelines and data infrastructure
• Strong understanding of modern machine learning techniques, particularly transformers and reinforcement learning, with a focus on their safety implications.

Tech stack

• Transformers
• Kubernetes
• Docker