What You Will Do
- Design and ship production pipelines on Databricks, using a medallion architecture (bronze → silver → gold / landing → curated → presentation) grounded in Data Vault 2.0 modeling patterns.
- Build and harden the curated and presentation layers—the unified domain model and the product- and reporting-facing views that drive donor lifetime value, retention, lapse risk, and campaign ROI.
- Resolve identity across products. Build and harden the matching that ties a single supporter together across CRM, Fundraising, and Volunteer—so donor lifetime value, retention, and lapse risk are computed on one trustworthy record, not three partial ones.
- Move us toward near-real-time data. Partner with our architects on Change Data Capture (Debezium on Kafka/MSK) so customers see donor activity sooner and analysts, Penny and other AI agents act on fresher signals.
- Integrate trusted external partners through clean, secure, observable pipelines.
- Make data observable. Extend our existing tracing and AI lifecycle tooling (Honeycomb, MLflow, Langfuse) into ETL, so we catch tenant-level failures before customers do.
- Partner with AI and product engineers to make sure the right data is in the right shape at the right time for Penny and the products that depend on her.
- Use AI tools (Claude Code, Cursor, or similar) daily for pipeline development, schema design, code review, and problem-solving.
- Raise the bar on engineering standards—testing, idempotency, documentation, security, and the boring rigor that keeps data trustworthy at scale. We treat data pipelines as software — code review, SemVer, CI/CD via Databricks Asset Bundles — and we hold data engineering to the same standards as our application teams.
What You Need to Succeed
Technical Depth
- Modern data platform experience: 5+ years building production data pipelines on a modern lakehouse or warehouse. Databricks w/ Unity Catalog strongly preferred; we'll consider Snowflake, BigQuery, or equivalent if your relevant data engineering skills travel.
- Identity resolution: experience matching and merging records across systems—entity resolution, dedupe/merge, or master-data "golden record" work—especially where there's no shared key to join on.
- Strong SQL and strong Python (or Scala). Comfort with PySpark is a plus.
- Data modeling fluency: working knowledge of dimensional and/or Data Vault 2.0 patterns. You can defend a schema decision and explain the trade-offs.
- Production sensibility: real experience operating pipelines in production—monitoring, alerting, and robust error handling.
- Streaming and CDC exposure: you don't have to have led that build, but you should know what's hard about moving from batch to near-real-time.
AI-Native Mindset
- Hands-on AI tool usage: you already use Claude Code, Cursor, or similar AI development environments as a daily part of how you build. You can speak to where they accelerate your work and where they don't.
- Curiosity about the frontier: you're energized by the pace of AI-driven change in how software—and data—gets built, and you bring that energy into your team.
Ownership & Partnership
- Quality-first instincts: you don't just write pipelines, you own outcomes. You build observability and testing within from day one.
- Cross-functional partnership: a track record of working well with data scientists, ML engineers, or applied-AI teams. We have a Penny to feed.
- Security and data residency awareness: our customers trust us with their donors' data. You take that seriously.
Nice to Haves But Not Required
- Transformation framework experience generally (dbt, PySpark, etc.).
- AWS (S3, IAM, networking).
- Experience with observability tools like Honeycomb, OpenTelemetry, or MLflow.
- Multi-tenant SaaS data experience.
- Background in nonprofit, fundraising, or CRM data.
Benefits
- Health + Wellness: Generous health, vision, and dental insurance options as well as HealthiestYou, a healthcare service that offers convenient, confidential access to quality doctors 24/7.
- Time Off: Competitive PTO package that includes 20 PTO days, 3 flex days, 4 optional volunteer days, 12 paid holidays, as well as paid parental leave.
- 401k: 401k match to help invest in your future.
- Equipment: Everything you need to be successful, shipped right to your door.
Compensation: The salary range for this position is $108,400 - $180,700. You may also be eligible for a discretionary bonus. Actual compensation within the range will be dependent on your skills, experience, qualifications, and location, as well as applicable employment laws.
BloomerangUnited States
