Member of Technical Staff, Agentic Environments

Job summary

Responsibilities

At Cohere, we're pushing the boundaries of what these technologies can achieve for production environments, and we're seeking a senior engineer who understands the practical challenges of making AI systems work at scale.

• Have a deep passion for quality work.
• Enjoy tuning and optimising large LLM models.
• Comfortable working with people with different levels of software engineering skills, from beginner to more advanced.
• Comfortable diving into complex ML codebases to identify and resolve issues, ensuring the smooth operation of our systems.
• Thrive in a fast-paced, technically challenging environment, where you can contribute your innovative ideas and solutions.

What they're looking for

• Extremely strong software engineering skills.
• Value test-driven development methods, clean code, and strive to reduce technical debts at all levels.
• Proficiency in Python and related ML frameworks such as JAX, Pytorch and/or XLA/MLIR.
• Experience using and debugging large-scale distributed training strategies (memory/speed profiling).
• Experience with distributed training infrastructures (Kubernetes) and associated frameworks (Ray).

Tech stack

• Python
• JAX
• PyTorch
• Kubernetes
• Ray