Research Intern, Inference (Winter 2027)

Job summary

Responsibilities

The Inference Research team is dedicated to building the next generation of efficient, scalable, and reliable serving systems for large foundation models, directly contributing to the mission of advancing open and transparent AI.

• Design and conduct rigorous experiments to validate hypotheses
• Communicate the plans, progress, and results of projects to the broader team
• Document findings in scientific publications and blog posts

What they're looking for

• Currently pursuing a final year of Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
• Strong knowledge of Machine Learning and Deep Learning fundamentals
• Experience with deep learning frameworks (PyTorch, JAX, etc.)
• Strong programming skills in Python
• Familiarity with Transformer architectures and recent developments in foundation models

Tech stack

• PyTorch
• JAX
• Python
• CUDA