# Data Annotation Specialist, Software Engineering

**Company:** [Cohere](https://hotfix.jobs/companies/cohere)
**Location:** Remote
**Role:** Data Analytics
**Salary:** CA$83k – CA$83k/yr
**Experience:** 3+ years
**Skills:** Python, Java, JavaScript, Go, SQL, API Design, Api Deployment, Code Generation, Code Debugging, Opencode, Claude Code, Codex, Cursor
**Posted:** 2026-06-17

> Evaluates and improves AI-generated software engineering outputs by testing coding capabilities, reviewing code and agent trajectories, and reporting quality trends. Requires software engineering expertise, 3–5 years of industry experience, proficiency in several programming languages, and API development experience.

## Job Description

## Responsibilities
- Evaluate the model's ability to respond to coding requests, workflows, and codebase-related questions using available tools.
- Assess agent trajectories and model capabilities for code generation and debugging requests.
- Prompt models to complete complex coding tasks and review the accuracy of generated responses.
- Label, proofread, and improve machine-written and human-written software engineering outputs.
- Report quality and performance trends related to model and agent behavior and project assignments.

## Requirements
- Subject matter expertise in software engineering, including formal study in the field.
- **3–5 years** of relevant industry experience.
- Proficiency in Python, Java, JavaScript, Go, and SQL.
- Experience designing, building, and deploying APIs.
- Ability to commit to a minimum of 16 hours per week.
- A personal laptop for the BYOD arrangement.

## Nice-to-Haves
- Experience working with code agents such as OpenCode, Claude Code, Codex, or Cursor.
- Experience evaluating agent trajectories.

## Compensation and Contract Details
- Part-time independent contractor position.
- **40 CAD/hour** contract rate.
- **12-month contract**.
- Performance incentives included.
- Remote work within Canada.
- Contractors are not eligible for employee health benefits or other employee benefits.
- Continuous work is not guaranteed; workload and compensation may fluctuate based on project needs and availability.
- The role may involve exposure to explicit, offensive, or otherwise inappropriate text content during annotation tasks.

## Similar jobs

- [Market Research Manager](https://hotfix.jobs/jobs/3da1715f-68a1-4304-9f4b-aeceaf0957c6) - PointClickCare - Mississauga, Canada - CA$86k – CA$96k/yr
- [Data Analyst — Product Analytics](https://hotfix.jobs/jobs/69894d78-1e75-403c-97eb-02d9dc7d4dca) - Virta Health - Remote - $96k – $125k/yr
- [Data Analytics Partner, People Analytics](https://hotfix.jobs/jobs/d84802a4-4c7c-476c-8772-ad8b0269319f) - Dropbox - Remote - $110k – $168k/yr
- [Model Risk Management Specialist](https://hotfix.jobs/jobs/33ebef34-dac3-4aca-8d43-1f8cbe4aab96) - Kraken - Remote
- [Data Analyst](https://hotfix.jobs/jobs/23a3fe0c-6758-4356-857f-5a868cfbf2bf) - Stripe

**Apply:** https://hotfix.jobs/jobs/9ea9b18b-4ca8-4ea3-9f6e-60a85f592eb9
**Canonical:** https://hotfix.jobs/jobs/9ea9b18b-4ca8-4ea3-9f6e-60a85f592eb9