Data Annotation Specialist, Data Science
Evaluates and improves model-generated responses to data science and coding tasks, including code review, debugging, visualization, and agent-trajectory assessment. Requires 3+ years of relevant data science experience, Python and SQL proficiency, and familiarity with common data formats.
About the job
Responsibilities
- Evaluate models’ ability to respond to coding requests, workflows, and codebase-related questions using available tools.
- Assess agent trajectories and model capabilities for code generation, tabular and graphic manipulation, and debugging requests.
- Prompt models to complete complex data science tasks and review the accuracy of generated responses.
- Label, proofread, and improve machine-written and human-written software engineering-related outputs.
- Report quality and performance trends related to model and agent behavior and project assignments.
Requirements
- At least 3 years of relevant industry experience working on real-world data science problems and pipelines.
- Exceptional data analysis and data visualization skills.
- Proficiency in Python and industry-standard data science packages such as NumPy, pandas, Matplotlib, and SQLite.
- Strong understanding of SQL syntax and workflows.
- Deep familiarity with data and file formats including Markdown, JSON, XML, YAML, and HTML.
- Prior experience rewriting, proofreading, and providing feedback on code.
- Ability to work remotely within Canada.
- Ability to commit to at least 16 hours per week.
- Bring your own laptop/device.
Nice-to-haves
- Familiarity with code agents such as OpenCode, Claude Code, or Codex.
- Experience evaluating agent trajectories.
Compensation
- Part-time independent contractor position.
- 12-month contract at a rate of 40 CAD per hour.
- Performance incentives included.
- Contractors are not eligible for employee health benefits or other employee benefits.
- Continuous work is not guaranteed, and workflow and compensation may fluctuate based on project needs.
- Work may involve exposure to explicit, offensive, or otherwise inappropriate text content during data annotation tasks.
Skills
Python, NumPy, pandas, Matplotlib, Sqlite, SQL, Markdown, JSON, Xml, Yaml, HTML, Data Visualization, Code Debugging, Code Agents
Similar jobs
Data Science jobs
Lyft
Toronto, Canada
The Data Scientist will develop and productionize algorithms for routing, travel-time estimation, and traffic detection using geospatial, behavioral, and mobility data. The role requires 3+ years of production machine learning or data science experience and strong quantitative expertise.
Lyft
Toronto, Canada
The Data Scientist will use experimentation, statistical analysis, and large-scale data to improve Lyft’s airport marketplace, identify growth opportunities, and guide product decisions. The role requires 4–6+ years of data science or analytics experience, strong SQL and Python skills, and effective cross-functional communication.
Sardine
Europe
Data Scientist builds and deploys ML models to combat fraud, collaborates with clients on risk solutions, and scales models to production. Requires 5+ years in data science, Python/SQL/Spark proficiency, and strong communication skills.
Lyft
Toronto, Canada
Design and deploy optimization algorithms and incentive systems that improve driver engagement, marketplace efficiency, and earnings. The role partners with product, engineering, and operations teams and requires Python, quantitative modeling, experimentation, and at least two years of relevant experience.
Coalition Security
United KingdomThe Senior Data Scientist develops statistical and machine learning models from insurance and cybersecurity datasets to improve underwriting, pricing, risk evaluation, and workflow automation. The role requires a quantitative bachelor's degree, 5+ years of insurance experience, advanced SQL, and Python or R expertise.