Posted 1d ago

Harvey Posted 9d ago
Attorney, Evaluation Operations (Contract)
Location
Remote
Full remote
Contract
Freelance
Full-time
Salary
Not disclosed
Experience
3+ years
Mid-level level
Job summary
Responsibilities
Before a model, feature, or workflow reaches Harvey customers, lawyers evaluate and grade its output. The Evaluation Operations function orchestrates this process, partnering closely with Harvey's Legal Product Architect team as they scope and answer relevant research questions informing key…
- Compare different AI-generated outputs for the same legal task (e.g., a memo, a contract redline, a research answer) and evaluate output quality against a written rubric.
- Test new product features end-to-end in a pre-release environment and provide qualitative feedback based on your legal experience.
- Review and assess grading rubrics for accuracy and completion.
- Build evaluation datasets that include realistic legal queries, contract markups, and/or synthetic legal documents.
What they're looking for
- JD and an active license to practice in at least one U.S. jurisdiction.
- 3+ years of practice experience at an AmLaw 100 or comparable firm, or in an in-house legal department.
- Experience in either commercial litigation or transactional law.
- Experience using AI tools in professional or daily life.
- Clear, concise legal writing and the ability to express your reasoning in plain language.
Read the full job posting
This summary is written by Tokn from the original posting. Only the posting published by Harvey is authoritative. Request a removal
Similar jobs
All Remote AI Ops & Automation jobs →Posted 1d ago
Posted 1d ago


