Skip to content
Fireworks AIFireworks AINew York, NY

Member of Technical Staff

Design and maintain large-scale backend infrastructure for distributed ML training, inference, and data pipelines at a generative AI startup. Requires 4+ years building scalable cloud systems with Python/Go/C++ and distributed data technologies.

175k – 220k/yr
On-site4+ YOEBackend Engineering

About the role

Responsibilities

  • Design, develop, and maintain large-scale backend and cloud-native infrastructure to support distributed machine learning training, inference, and data processing pipelines for generative AI platform.
  • Architect and build scalable, resilient backend infrastructure to support distributed training, inference, and data processing pipelines.
  • Lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems.
  • Design and implement core backend services with a focus on efficiency and low latency.
  • Drive infrastructure optimization initiatives for compute cost, storage lifecycle management, and network performance.
  • Collaborate with machine learning, DevOps, and product teams to translate research and product requirements into robust infrastructure solutions.
  • Evaluate and integrate cloud-native and open-source technologies such as Kubernetes, Ray, Kubeflow, and MLFlow to enhance platform reliability.
  • Own end-to-end systems from design to deployment, emphasizing reliability, fault tolerance, and operational excellence.

Requirements

  • Bachelor’s degree or equivalent in Computer Science or related field plus four (4) years of experience in software engineering or related role.
  • 4 years of experience designing, building, and optimizing large-scale backend infrastructure and distributed data systems (e.g., PostgreSQL, MySQL, DynamoDB, Apache Spark, Apache Flink, Apache Kafka) in cloud environments (AWS, GCP, Azure, or equivalent), including cloud-native platforms, core infrastructure components, and optimization techniques (caching, indexing, sharding, replication, transactions, ACID).
  • 4 years of experience with major server-side programming languages and frameworks (e.g., Python, C++, Go, TypeScript).
  • 4 years of experience writing technical design documentation, leading cross-functional projects, and collaborating with cross-functional teams to achieve business impact.
  • 3 years of experience developing and maintaining data processing and API systems, including client-server communication frameworks (e.g., gRPC, Thrift).
  • 3 years of experience conducting A/B testing and scientific experimentation (e.g., Statsig, Meta Deltoid, Optimizely) to measure software impact.
  • 3 years of experience conducting coding interviews and providing systematic feedback for engineering candidates.
  • 2 years of experience with cloud-native tools and infrastructure, such as Docker and Kubernetes.
  • 2 years of experience defining and implementing data-driven metrics to support company or team goals.

Compensation & Benefits

  • Base Pay Range: $175,000–$220,000 USD (plus equity)
  • Total compensation includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package.

Skills

PythonC++GoTypeScriptPostgresMySQLDynamoDBSparkApache FlinkApache KafkaAWSGCPAzureKubernetesDocker
Hedra

Senior / Staff Backend Engineer

HedraSan Francisco, CA

Design, build, and deploy scalable Python backend services and APIs on AWS to power creative tools, integrating with foundation models, Postgres, Redis, S3, and DynamoDB. Requires 5+ years building backend services with Python, Kubernetes/EKS, and relational databases.

175k – 275k/yr
On-site5+ YOEBackend Engineering
Sage

Senior/Staff Software Engineer - Edge

SageNew York, NY

Leads architecture and development of edge computing platform for senior living, building backend/embedded software for on-premise systems, cloud orchestration, ML models for resident location, and diagnostics. Requires 8+ years experience with Java, Linux, leading complex projects.

175k – 230k/yr
Hybrid8+ YOEBackend Engineering
Sprinter Health

Logistics Optimization - Lead Senior/Staff Software Engineer

Sprinter HealthSan Francisco, CA

Leads development of algorithms and simulations for optimizing clinician routing, scheduling, and dispatch in in-home healthcare logistics. Requires 5+ years backend/full-stack experience, proficiency in TypeScript/Python, and background in operations research or quantitative modeling.

175k – 225k/yr
Hybrid5+ YOEBackend Engineering
Zilliz

Staff Software Engineer, Database Systems

ZillizRedwood City, CA

Develops distributed database systems, core architecture, and optimizes performance for enterprise AI applications. Requires 4+ years in database systems and contributions to infrastructure software like PostgreSQL or Kafka, with a bachelor's degree.

175k – 250k/yr
Hybrid4+ YOEBackend Engineering
Grafana Labs

Staff Backend Engineer

Grafana LabsUnited States

Staff Backend Engineer building an AI-native data intelligence and context system for Grafana to enable reliable enterprise data access for AI agents. Requires strong production backend experience, practical GenAI/LLM skills, cloud-native expertise, and comfort with ambiguity on an autonomous early-stage team.

175k – 210k/yr
Remote7+ YOEBackend Engineering