# Staff, Backend Engineer - Catalog

**Company:** [Acryldata](https://hotfix.jobs/companies/acryldata)
**Location:** Palo Alto, CA
**Role:** Backend Engineering
**Salary:** $225k – $300k/yr
**Experience:** 8+ years
**Skills:** Python, Java, Scala, Kotlin, Go, AWS, Kubernetes, Docker, CI/CD, Microservices, API Design, Distributed Systems, LLMs, Event-Driven Architecture
**Posted:** 2026-04-10

> Leads development of DataHub's platform framework, building scalable metadata ingestion systems, APIs, event-driven processing, schema mapping, and AI asset versioning. Requires 8+ years in distributed systems, advanced Python/API expertise, and high-scale data processing experience.

## Job Description

## Responsibilities

- Build scalable, fault-tolerant ingestion systems for enterprise-scale metadata
- Develop clean, intuitive APIs for our connector ecosystem
- Implement event-driven architectures for real-time metadata processing
- Create schema mapping between diverse systems and DataHub's unified model
- Design versioning systems for AI assets (training data, model weights, embeddings)

## Requirements

- 8+ years building production-grade distributed systems
- Advanced Python and API design expertise
- Experience with high-scale data processing or integration frameworks
- Strong systems knowledge and distributed architecture experience
- Proven track record solving complex technical challenges
- Built and maintained online applications serving live traffic at scale (100+ QPS)
- Set up monitoring and alerting for services
- Designed indexing, storage, and data architectures to make large-scale data accessible to online services
- Designed and scaled distributed systems
- Hands-on experience developing in a tight loop with LLMs and applying best practices for scalable LLM development

**Languages**
- One of Java/Scala/Kotlin/C#/Go (very strong nice-to-have / borderline must-have)
- Python/TypeScript/Node.js (nice-to-have)

**Technical Skills**
- AWS
- Kubernetes/Docker
- CI/CD deployment pipelines
- Microservice Architecture

## Nice-to-Haves

- Experience with DataHub or similar metadata/ETL frameworks (Airflow, Airbyte, dbt)
- Open-source contributions
- Experience building and maintaining services that make calls to LLMs in order to serve live traffic
- Experience fine-tuning LLM-powered applications exposed to end users
- Early-stage startup experience

## Compensation

Salary Range: $225,000 to $300,000

## Similar roles

- [Staff Software Engineer, Monetization](https://hotfix.jobs/jobs/7ec30f27-2bab-40a7-896c-2ed34cd9297a) - Scribe - San Francisco, CA - $225k – $250k/yr
- [Sr. Staff Engineer](https://hotfix.jobs/jobs/48579daf-fa8b-4aa4-9ffa-3700364d5a3c) - Illumio - Sunnyvale, CA - $225k – $270k/yr
- [Staff Backend Engineer](https://hotfix.jobs/jobs/9a31f75a-cef0-43ec-a0f1-0d04b2991842) - Socure - Remote - $225k – $265k/yr
- [Staff Software Engineer – Backend](https://hotfix.jobs/jobs/f6d4c7bf-0bd9-4955-95e0-637cbbdb974f) - Sleeper - San Francisco, CA - $225k – $300k/yr
- [Staff Software Engineer (Backend)](https://hotfix.jobs/jobs/2a0c0028-0e52-496b-8580-63109f5722fc) - Artisan - San Francisco, CA - $225k – $300k/yr

**Apply:** https://hotfix.jobs/jobs/1a0c8eb6-599d-4785-a193-10c6ea5f5727
**Canonical:** https://hotfix.jobs/jobs/1a0c8eb6-599d-4785-a193-10c6ea5f5727