Skip to content

Senior Software Engineer, Platform

150k – 300kSan Francisco, CADevOps / SREOnsite5+ YOE
Summary

Senior Software Engineer on the Platform team builds and optimizes core APIs and pipelines for document parsing using LLMs, integrates cutting-edge models, reduces latency/costs, and collaborates with ML engineers. Requires 5+ years experience with 2+ years in production LLMs and Python expertise.

About the role

Responsibilities

  • Integrating and optimizing LLM calls for structured extraction, form filling, and document understanding tasks
  • Experimenting with new techniques and output structures to improve LLM accuracy and reduce latency
  • Making improvements to API design and pre-processing algorithms (chunking, structured extraction, etc.) based on customer feedback
  • Building and improving document processing pipelines that handle everything from PDFs to spreadsheets at scale
  • Driving backend latency and costs down without sacrificing quality
  • Building internal tooling and evals to better understand/analyze failure cases
  • Working directly with the founders and customers to shape the product direction and engineering strategy

Requirements

  • 5+ years of experience building, hardening and scaling real world applications
  • 2+ years of experience integrating LLMs into production systems
  • Exceptional with Python (or deep understanding of another language)
  • Build your own tools as needed (e.g., Streamlit app to test hypotheses or create datasets)
  • Quantitative approach to building products; ability to debug, experiment, and iterate fast
  • High bar for quality; hands-on with full development lifecycle

Nice-to-Haves

  • Prior experience founding a company or building products at early stages
  • Experience with prompt engineering, fine-tuning, or building AI agents
  • Experience delivering AI-powered products at internet scale
  • Keep up with latest developments in ML/AI
Skills
PythonLLMsStreamlitAPIsDocument ProcessingPDFsSpreadsheetsPrompt EngineeringFine-tuningAI Agents
Similar roles at this salary range
All DevOps / SRE jobs →
Pindrop

Senior Manager, DevOps

Lead DevOps strategy and team to improve engineering velocity, platform reliability, and operational efficiency across multi-cloud (AWS/GCP) environments. Drive IaC, Kubernetes delivery, observability, AI-powered tooling adoption, and cross-functional collaboration.

155k – 185kUnited StatesDevOps / SRERemote6+ YOEGoAWS
Render

Software Engineer, Dev Velocity

Build internal developer platform, tooling, and automation to accelerate engineering velocity. Focus on CI/CD pipelines, test infrastructure, build systems, and metrics to help engineers ship faster and more reliably.

170k – 290kUnited StatesDevOps / SRERemote5+ YOEGoCI/CD
Okta

Senior Software Engineer, Observability

Senior engineer on the Auth0 Platform Observability team responsible for designing, building, and maintaining scalable observability infrastructure (metrics, logs, traces) using Datadog, Terraform, and OpenTelemetry.

147k – 202kBellevue, WA +3DevOps / SREHybrid5+ YOEAWSAzure
NMI

Senior MySQL Database Administrator

Senior DBA responsible for designing, maintaining, and improving MySQL database infrastructure in a high-availability SRE environment. Requires 5+ years MySQL/MariaDB experience and on-call participation.

130k – 160kUnited StatesDevOps / SRERemote5+ YOEMHAMySQL
Beacon AI

Software Engineer, Cloud Infrastructure

Build and operate AWS cloud and LLM infrastructure powering retrieval-augmented generation, vector search, and ML pipelines for aviation AI systems. Requires strong AWS depth, Python data pipelines, and production LLM experience.

135k – 260kSan Carlos, CADevOps / SREHybrid4+ YOES3AWS