Baseten logo
Baseten Posted 30+ days ago

Post-Training Research Engineer

Location

San Francisco

Hybrid

Contract

Permanent

Full-time

Salary

$200–275k

Gross per year

Experience

Not specified

What they're looking for

  • A deep understanding of modern ML techniques and tools for training transformers
  • Advanced experience in a tensor/array computation library like PyTorch, TensorFlow, Jax, or similar
  • A detailed understanding of transformer training parallelism strategies like data parallelism, sharded data parallelism, tensor parallelism, pipeline parallelism, context…
  • The experience and knowledge to profile and improve the performance of a distributed GPU program in PyTorch or a similar library
  • The ability to perform roofline analysis on a transformer training setup

Tech stack

Read the full job posting

This summary is written by Tokn from the original posting. Only the posting published by Baseten is authoritative. Request a removal

jobs.ashbyhq.com ↗

Similar jobs

All Research jobs in San Francisco →
Apply on company website