Skip to content
Thinking Machines LabThinking Machines LabSan Francisco, CA

Software Engineer, Systems Generalist

Builds and scales core infrastructure for AI model training, data systems, and developer tools in a high-impact team. Requires backend proficiency (Python/Rust), experience with large-scale clusters like Kubernetes, and end-to-end project ownership.

350k – 475k/yr
On-siteDevOps / SRE

About the role

What You’ll Do

We interview generally, but during project selection we’ll take into account your interests and experience alongside organizational needs.

Example areas you may contribute to:

Core Infrastructure: Support teams that train, research, and serve AI models. Build systems for large Kubernetes clusters with GPU workloads, or infrastructure to support Tinker.

Data Infrastructure: Design and optimize data pipelines using tools like Spark and other modern data infrastructure technologies. Build scalable, reliable data infrastructure with governance best practices.

Developer Productivity: Build tooling, systems, frameworks for optimized developer environments.

Skills and Qualifications

Minimum qualifications:

  • Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
  • Proficiency in at least one backend language (Python or Rust).
  • Experience operating large-scale clusters and container orchestration systems (Kubernetes or Slurm).
  • Comfort operating across the stack and owning projects end-to-end.
  • Thrive in highly collaborative environment with cross-functional partners.
  • Bias for action and initiative across stacks and teams.

Preferred qualifications:

  • Strong debugging across application, OS, and network layers.
  • Proficiency in Python or Rust, containers, and modern CI.
  • Experience with Kubernetes, controllers/operators, or performance profiling.
  • Familiarity with GPU/ML workflows or large-scale data/eval pipelines.

Logistics

Compensation: $350,000 - $475,000 USD annual salary, depending on background, skills and experience.

Benefits: Generous health, dental, and vision benefits, unlimited PTO, paid parental leave, relocation support.

Skills

PythonRustKubernetesSlurmSparkContainersCI/CDGPUDistributed SystemsData Pipelines

Similar roles

DevOps / SRE jobs
Thinking Machines Lab

Reliability Engineer, Supercomputing

Thinking Machines LabSan Francisco, CA

Ensure reliability of large GPU supercomputing clusters by diagnosing hardware/firmware/OS issues, automating monitoring, driving firmware rollouts, and working directly with vendors.

350k – 475k/yr
On-siteDevOps / SRE
Thinking Machines Lab

Network Engineer, Supercomputing

Thinking Machines LabSan Francisco, CA

Own and debug multi-thousand-GPU network fabric (RDMA/RoCE, NVLink/NVSwitch) for large-scale AI training and inference. Requires backend language proficiency, large-scale cluster experience, and cross-stack ownership.

350k – 475k/yr
On-siteDevOps / SRE
Anthropic

Performance Engineer, Inference Systems

AnthropicSan Francisco, CA +2

Performance engineer focused on cross-layer investigations of Anthropic's inference fleet for Claude, optimizing throughput, latency, reliability, and correctness while building observability and partnering with kernel and serving teams.

350k – 850k/yr
HybridDevOps / SRE
Thinking Machines Lab

Site Reliability Engineer (SRE)

Thinking Machines LabSan Francisco, CA

Site Reliability Engineer drives end-to-end reliability for AI fine-tuning platform Tinker, including SLOs, monitoring, incident response, and multi-tenant GPU scheduling. Requires distributed systems experience, software proficiency for reliability, and production incident handling.

350k – 475k/yr
On-siteDevOps / SRE
Thinking Machines Lab

Research Engineer, Infrastructure, Training Systems

Thinking Machines LabSan Francisco, CA

Designs and optimizes distributed training systems scaling across thousands of GPUs for large AI models. Requires strong systems engineering, PyTorch/JAX expertise, and collaborative mindset to boost research productivity.

350k – 475k/yr
On-siteDevOps / SRE