# Senior Platform Engineer (DataOps)

**Company:** [Black Canyon Consulting](https://hotfix.jobs/companies/blackcanyonconsulting)
**Location:** Bethesda, MD
**Role:** Data Engineering
**Experience:** 7+ years
**Skills:** Kubernetes, Docker, GCP, Amazon Web Services, Microsoft Azure, Apache Kafka, Google Cloud Pub/Sub, Apache Airflow, Terraform, Argo CD, Prometheus, Grafana, Hashicorp Vault, Python, Linux
**Posted:** 2026-04-09

> Builds and maintains enterprise DataOps platform using Kubernetes, cloud services, and data processing tools. Requires 7+ years experience, strong coding skills, and expertise in containerization, GCP/AWS/Azure, Kafka, and Airflow.

## Job Description

## Duties & Responsibilities

The DataOps Platforms team:
- Develops and continuously improves DataOps platform.
- Develops and maintains common tools and libraries.
- Evaluates new technologies and practices.
- Helps NCBI developers with adoption of platform.
- Ensures compliance with the Federal application security regulations and standards by providing automated solutions and compliance pipelines.
- Embraces agile development and continuous improvement.
- Encourages growth mindset and offers leadership opportunities at any level.

## Required Skills

- 7+ years of experience in the field
- Strong coding skills in at least one programming language (Python, C++, ...)
- **Kubernetes**, containerization
- **Google Cloud Platform (GCP)**, **Amazon Web Services (AWS)**, **Microsoft Azure** or equivalent cloud services
- **Apache Kafka**, **Google Cloud Pub/Sub** or equivalent
- **Apache AirFlow** or equivalent
- Experience with data processing applications and modern cloud-based data processing infrastructure
- Linux command-line skills

## Bonus Skills

- **Google Anthos**
- **Docker**
- GitOps tools: **ArgoCD** or equivalent
- Infrastructure as code tools: **Terraform** or equivalent
- GitLab, GitHub, Bitbucket, Teamcity, Artifactory, or equivalent products for management of Git source control, CI/CD pipelines and artifact lifecycle management
- Modern observability and logging tools: **Prometheus**, EFK (**ElasticSearch**, fluentd, **Kibana**), TIGK (**Telegraf**, **InfluxDB**, **Grafana**, Kapacitor), DataDog, Sensu, **Jaeger**, Sentry, OpsGenie, **PagerDuty**, **Splunk**, or equivalent
- Secret Management tools such as **Hashicorp Vault**, CyberArk, **Azure Key Vault**, **Google Cloud Secret Manager** or equivalent
- Data transfer tools: **AWS DataSync**, Aspera, **MinIO**, CloudSoda or equivalent
- **Apache Pulsar**, **RabbitMQ**, **Amazon Kinesis**, **Apache Flume**, **Apache Storm**, **Apache Spark Streaming**, **Google Cloud Pub/Sub**
- Experience with best-practice design patterns in coding and architecture
- Experience working in Agile environment

## Similar roles

- [Data Operations Lead](https://hotfix.jobs/jobs/4f8dee72-5fff-4c10-90b5-cbd0607417e6) - HappyRobot - San Francisco, CA - $180k – $240k/yr
- [Senior Software Engineer, AI Data Systems & Database Infrastructure](https://hotfix.jobs/jobs/11739793-220f-4ff1-882c-90bf341ca36c) - Ambient.ai - Redwood City, CA - $168k – $205k/yr
- [Senior Data Engineer](https://hotfix.jobs/jobs/cf45e5a5-fb7b-43fb-94e6-dff187027a77) - Vanta - Remote - $190k – $224k/yr
- [Senior Data Engineer](https://hotfix.jobs/jobs/c950f79a-6886-4ce0-9990-2627edb264f3) - Cloudflare - Austin, TX
- [Senior Data Engineer](https://hotfix.jobs/jobs/298b05d6-eba7-413d-bb1d-948ca80c669a) - Trexquant - Stamford, CT - $150k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/4234398a-c7de-4d15-93dc-d21a4f89c073
**Canonical:** https://hotfix.jobs/jobs/4234398a-c7de-4d15-93dc-d21a4f89c073