Software Engineer - Member of Technical Staff (Consumption Team)
Generalist Software Engineer building backend Python APIs, marketplace orchestration, billing systems, and developer tooling for an AI GPU compute infrastructure platform. Own features end-to-end across backend, databases, frontend, and cloud integrations in a hybrid Palo Alto/SF role.
About the job
Core Responsibilities
Backend & API
- Build and maintain backend Python APIs powering reservation, bidding, billing, and usage surfaces — including usage visualization and the billing platform.
- Write and maintain database migrations, design relational schemas for complex multi-entity models (orders, allocations, grants, quotas), and optimize queries for performance.
- Own features end-to-end: from design doc through backend API, database migration, feature flag rollout, and monitoring.
Platform & Marketplace
- Design and implement orchestration primitives for flexible reservations: pause/return credits, reservation extensions, capacity algorithm updates, and the auction model connecting spot and reserved capacity.
- Contribute to operational maturity — quota systems, financial controls, fraud prevention, and inventory management automation.
Supply Integrations
- Contribute to supply-side integrations, bringing GCP, Nebius, and OCI resources under Mithril management through the Mithril API.
- Build tooling to give operators visibility into managed capacity and surface supply constraints early.
Consumption & Developer Tooling
- Build consumption tooling to help developers make better decisions: reservation calculators, bid modeling, cost dashboards, and CLI extensions.
- Work across the client frontend to ship customer-facing features including usage graphs, billing views, and reservation management UIs.
Operations
- Participate in on-call rotations, triage production incidents, and contribute to operational runbooks and automation that reduce toil over time.
Requirements
- Strong Python backend skills — built and maintained production APIs at real scale.
- Proven experience with distributed systems; comfortable with messaging systems (RabbitMQ, Kafka) and RPC methods (gRPC, protobuf, tRPC).
- Fluency with relational databases: schema design, query optimization, and migrations in production environments.
- Ability to own a feature end-to-end — from design doc through backend API, database migration, feature flag rollout, and monitoring.
- Strong debugging instincts: calm and systematic when triaging production incidents, with a bias toward durable fixes.
- Comfortable in small teams where ownership is high and process is lightweight.
Nice to Have
- Experience with marketplace and billing systems — especially variable-usage, auction-based, or complex reservation models.
- Familiarity with Kubernetes, AWS infrastructure, or cloud provider APIs (GCP, OCI, Nebius).
- Familiarity with Linux containers and container orchestration (Docker Swarm, Nomad).
- Comfort working across the stack — Python backend and TypeScript/React frontend.
- Experience with developer tools or CLIs (bonus: SkyPilot or similar frameworks).
- Proficiency with infrastructure-as-code (Terraform, Kustomize) or observability tooling (Grafana, Prometheus).
- Background in real-time systems: SSE, WebSockets, or event-driven architectures.
- Prior experience at a startup where you wore multiple hats and shipped across domains.
Benefits
- Health, dental, and vision coverage for you and your dependents
- 401k Plan with 4% company match
- 21 days of PTO & 14 company holidays; including 2 floating holidays
Salary
$170,000 - $230,000
Skills
Python, Relational Databases, Distributed Systems, Kafka, RabbitMQ, gRPC, Protobuf, Kubernetes, Terraform, TypeScript, React, AWS, GCP, Prometheus, Grafana
Similar jobs
Fullstack Engineering jobs
Arini
San Francisco, CA
Design and optimize distributed systems, workflows, and architectures for an enterprise healthcare platform. The role requires a bachelor’s degree and three years of computer-systems-related experience, with expertise in cloud infrastructure, databases, integrations, and reliability analysis.
Forus
New York, NY
Build and scale provider-growth systems spanning onboarding, activation, automation, AI agents, and experimentation. The role requires strong programming fundamentals, experience with APIs and data pipelines, and strong product judgment in a fast-growing environment.
Airtable
San Francisco, CABuild end-to-end Airtable product features with a primary backend focus, collaborating with product, design, research, and data science partners. The role requires 4+ years of full-stack web development experience and fluency in backend technologies, JavaScript, and React.
Valon
New York, NYBuild scalable software and infrastructure for a complex, regulated mortgage-servicing platform. The role requires a bachelor’s degree and at least one year of software engineering experience, with exposure to web or mobile applications, distributed systems, or infrastructure.
Forge
San Francisco, CABuild and maintain scalable customer-domain and marketplace-middleware applications, APIs, automated tests, and reliable systems using C# and .NET. The role requires at least four years of software engineering experience and emphasizes collaboration, technical documentation, and high-quality delivery.