# Member of Technical Staff

**Company:** [Fireworks AI](https://hotfix.jobs/companies/fireworks-ai)
**Location:** New York, NY
**Role:** Backend Engineering
**Salary:** $175k – $220k/yr
**Experience:** 4+ years
**Skills:** Python, C++, Go, TypeScript, Postgres, MySQL, DynamoDB, Spark, Apache Flink, Apache Kafka, AWS, GCP, Azure, Kubernetes, Docker
**Posted:** 2026-06-11

> Design and maintain large-scale backend infrastructure for distributed ML training, inference, and data pipelines at a generative AI startup. Requires 4+ years building scalable cloud systems with Python/Go/C++ and distributed data technologies.

## Job Description

## Responsibilities
- Design, develop, and maintain large-scale backend and cloud-native infrastructure to support distributed machine learning training, inference, and data processing pipelines for generative AI platform.
- Architect and build scalable, resilient backend infrastructure to support distributed training, inference, and data processing pipelines.
- Lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems.
- Design and implement core backend services with a focus on efficiency and low latency.
- Drive infrastructure optimization initiatives for compute cost, storage lifecycle management, and network performance.
- Collaborate with machine learning, DevOps, and product teams to translate research and product requirements into robust infrastructure solutions.
- Evaluate and integrate cloud-native and open-source technologies such as Kubernetes, Ray, Kubeflow, and MLFlow to enhance platform reliability.
- Own end-to-end systems from design to deployment, emphasizing reliability, fault tolerance, and operational excellence.

## Requirements
- Bachelor’s degree or equivalent in Computer Science or related field plus four (4) years of experience in software engineering or related role.
- 4 years of experience designing, building, and optimizing large-scale backend infrastructure and distributed data systems (e.g., PostgreSQL, MySQL, DynamoDB, Apache Spark, Apache Flink, Apache Kafka) in cloud environments (AWS, GCP, Azure, or equivalent), including cloud-native platforms, core infrastructure components, and optimization techniques (caching, indexing, sharding, replication, transactions, ACID).
- 4 years of experience with major server-side programming languages and frameworks (e.g., Python, C++, Go, TypeScript).
- 4 years of experience writing technical design documentation, leading cross-functional projects, and collaborating with cross-functional teams to achieve business impact.
- 3 years of experience developing and maintaining data processing and API systems, including client-server communication frameworks (e.g., gRPC, Thrift).
- 3 years of experience conducting A/B testing and scientific experimentation (e.g., Statsig, Meta Deltoid, Optimizely) to measure software impact.
- 3 years of experience conducting coding interviews and providing systematic feedback for engineering candidates.
- 2 years of experience with cloud-native tools and infrastructure, such as Docker and Kubernetes.
- 2 years of experience defining and implementing data-driven metrics to support company or team goals.

## Compensation & Benefits
- Base Pay Range: $175,000–$220,000 USD (plus equity)
- Total compensation includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package.

## Similar roles

- [Senior / Staff Backend Engineer](https://hotfix.jobs/jobs/b6ef9614-8687-4418-8af4-4ce91bbe55ca) - Hedra - San Francisco, CA - $175k – $275k/yr
- [Senior/Staff Software Engineer - Edge](https://hotfix.jobs/jobs/469ccb7c-1589-4e08-8a9b-e37ce40f9d73) - Sage - New York, NY - $175k – $230k/yr
- [Logistics Optimization - Lead Senior/Staff Software Engineer](https://hotfix.jobs/jobs/0a0442a5-2103-4728-98e2-0ad369fb7e89) - Sprinter Health - San Francisco, CA - $175k – $225k/yr
- [Staff Software Engineer, Database Systems](https://hotfix.jobs/jobs/1906be33-4603-49d4-8343-bb8635284d53) - Zilliz - Redwood City, CA - $175k – $250k/yr
- [Staff Backend Engineer](https://hotfix.jobs/jobs/c0710a69-e41d-422e-98bc-068fa8434ff7) - Grafana Labs - Remote - $175k – $210k/yr

**Apply:** https://hotfix.jobs/jobs/ddf311d9-a34c-4db2-be58-cf497536cb9c
**Canonical:** https://hotfix.jobs/jobs/ddf311d9-a34c-4db2-be58-cf497536cb9c