# Software Engineer, Model Evaluation and Improvement

**Company:** [Benchling](https://hotfix.jobs/companies/benchling)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $136k – $167k/yr
**Experience:** 2+ years
**Skills:** Artificial Intelligence, LLMs, Biology, Scientific Models, Model Evaluation, Model Improvement, Dataset Building, Data Infrastructure, Data Pipelines, Frontier Ai
**Posted:** 2026-08-24

> Build datasets, evaluations, and scalable data systems that improve frontier AI models on challenging biological and scientific tasks. The role partners with scientists and AI labs and requires at least two years of experience applying biology and AI, plus hands-on LLM experience.

## Job Description

## Responsibilities
- Build datasets for evaluating and improving frontier models, turning complex scientific data into high-quality tasks and environments for large language models.
- Analyze model failure modes by running experiments across frontier models to identify improvement opportunities.
- Build scalable data infrastructure and pipelines to curate, transform, and validate scientific data for model evaluation and improvement.
- Collaborate with frontier AI labs on approaches for improving models on challenging scientific tasks.
- Work with scientists to translate expert judgment into problems and evaluation criteria that distinguish strong model behavior.

## Requirements
- 2+ years of experience at the intersection of biology and AI, including evaluating or improving scientific models or LLMs for biological applications.
- Experience building with LLMs and understanding their capabilities and limitations.
- Curiosity about frontier AI and rapidly evolving model capabilities.
- Ability to work on ambiguous problems and adapt technical approaches as the field develops.
- Collaborative approach when working with engineers, scientists, and external research partners.
- Comfort in a fast-paced environment with shifting priorities and rapid experimentation.

## Work Arrangement
- In-person role in San Francisco, Monday through Friday.

## Similar jobs

- [Machine Learning Engineer II, Responsible AI](https://hotfix.jobs/jobs/ee2960a1-05aa-4e3c-a15b-59b89193517a) - Pinterest - San Francisco, CA - $139k – $286k/yr
- [Member of Technical Staff](https://hotfix.jobs/jobs/0e1f8329-245d-46ce-847a-fcd6adbaf127) - Ambral - New York, NY - $140k – $175k/yr
- [Machine Learning Engineer](https://hotfix.jobs/jobs/2c104a35-3af7-48c1-a14c-4f8f74f1341d) - Lyft - San Francisco, CA - $141k – $176k/yr
- [Software Engineer, Artificial Intelligence](https://hotfix.jobs/jobs/e86db3a8-6f72-411e-906b-fbd153b8844a) - DataVisor - Mountain View, CA - $130k – $250k/yr
- [AI Agent Engineer](https://hotfix.jobs/jobs/ebb0d727-bbcb-452b-950b-01941701f823) - Simple AI - San Francisco, CA - $120k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/677f2f4a-36fe-436c-b6d8-53dcddc01307
**Canonical:** https://hotfix.jobs/jobs/677f2f4a-36fe-436c-b6d8-53dcddc01307