Data Annotation Specialist, Data Science

Job summary

Responsibilities

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

• Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
• Assess agent trajectories and model capabilities for code generation, tabular and graphic manipulation, and debugging requests.
• Prompt models to complete complex data science tasks and review the accuracy of generated responses.
• Label, proofread, and improve machine-written and human-written software engineering-related outputs.
• Report quality and performance trends related to model/agent behaviour and project assignments.

What they're looking for

• Exceptional data analysis and visualization skills.
• 3+ years of relevant industry experience working on real-world data science problems and pipelines.
• Proficient knowledge and understanding of Python and industry-standard data science packages (numpy, pandas, matplotlib, sqlite, or others).
• Strong understanding of SQL syntax writing and workflows; and a deep familiarity with file/data formats, such as markdown, JSON, XML, YAML, and HTML.
• Prior experience re-writing, proofreading, and delivering feedback on code.

Tech stack

• Python
• NumPy
• Pandas
• SQL