Skip to content
AcryldataAcryldataPalo Alto, CA

Staff, Backend Engineer - Catalog

Leads development of DataHub's platform framework, building scalable metadata ingestion systems, APIs, event-driven processing, schema mapping, and AI asset versioning. Requires 8+ years in distributed systems, advanced Python/API expertise, and high-scale data processing experience.

225k – 300k/yr
Hybrid8+ YOEBackend Engineering

About the role

Responsibilities

  • Build scalable, fault-tolerant ingestion systems for enterprise-scale metadata
  • Develop clean, intuitive APIs for our connector ecosystem
  • Implement event-driven architectures for real-time metadata processing
  • Create schema mapping between diverse systems and DataHub's unified model
  • Design versioning systems for AI assets (training data, model weights, embeddings)

Requirements

  • 8+ years building production-grade distributed systems
  • Advanced Python and API design expertise
  • Experience with high-scale data processing or integration frameworks
  • Strong systems knowledge and distributed architecture experience
  • Proven track record solving complex technical challenges
  • Built and maintained online applications serving live traffic at scale (100+ QPS)
  • Set up monitoring and alerting for services
  • Designed indexing, storage, and data architectures to make large-scale data accessible to online services
  • Designed and scaled distributed systems
  • Hands-on experience developing in a tight loop with LLMs and applying best practices for scalable LLM development

Languages

  • One of Java/Scala/Kotlin/C#/Go (very strong nice-to-have / borderline must-have)
  • Python/TypeScript/Node.js (nice-to-have)

Technical Skills

  • AWS
  • Kubernetes/Docker
  • CI/CD deployment pipelines
  • Microservice Architecture

Nice-to-Haves

  • Experience with DataHub or similar metadata/ETL frameworks (Airflow, Airbyte, dbt)
  • Open-source contributions
  • Experience building and maintaining services that make calls to LLMs in order to serve live traffic
  • Experience fine-tuning LLM-powered applications exposed to end users
  • Early-stage startup experience

Compensation

Salary Range: $225,000 to $300,000

Skills

PythonJavaScalaKotlinGoAWSKubernetesDockerCI/CDMicroservicesAPI DesignDistributed SystemsLLMsEvent-Driven Architecture
Scribe

Staff Software Engineer, Monetization

ScribeSan Francisco, CA

Staff Engineer owns technical architecture for monetization platform including billing, pricing, entitlements, and revenue operations. Requires 10+ years experience in revenue-critical systems, strong backend skills, and leadership in high-stakes design.

225k – 250k/yr
Hybrid10+ YOEBackend Engineering
Illumio

Sr. Staff Engineer

IllumioSunnyvale, CA

Designs and builds containerized microservices in Go for a Kubernetes-based platform processing cloud telemetry for security insights. Owns full lifecycle of features, operations, mentoring, with 12+ years distributed systems and major cloud experience.

225k – 270k/yr
On-site12+ YOEBackend Engineering
Socure

Staff Backend Engineer

SocureCarson City, NV

Staff Backend Engineer leads design and implementation of scalable distributed systems to combat identity fraud, mentors engineers, and drives complex projects. Requires 8-12 years experience, bachelor's degree, and expertise in system design and performance optimization.

225k – 265k/yr
Remote8+ YOEBackend Engineering
Sleeper

Staff Software Engineer – Backend

SleeperSan Francisco, CA +3

Staff backend engineer architects scalable distributed systems for fantasy sports platform handling millions of concurrent users, builds core services for contests and real-time experiences, and mentors engineers. Requires 7+ years experience with backend languages, databases, cloud, and high-availability systems.

225k – 300k/yr
Hybrid7+ YOEBackend Engineering
Artisan

Staff Software Engineer (Backend)

ArtisanSan Francisco, CA +1

Builds backend systems powering autonomous AI employees, including high-throughput AI orchestration, platform infrastructure for sales stack replacement, and data-intensive services processing millions of signals for real-time decisions. Requires 6+ years backend experience with distributed systems and cloud-native tech.

225k – 300k/yr
On-site6+ YOEBackend Engineering