Platform Engineer (DataOps)
Builds and maintains DataOps platform using Kubernetes, cloud services, and data processing tools to support NCBI developers. Requires strong coding, cloud experience, and data infrastructure knowledge; B.S. in STEM preferred.
About the job
Duties & Responsibilities
The DataOps Platforms team:
- Develops and continuously improves DataOps platform.
- Develops and maintains common tools and libraries.
- Evaluates new technologies and practices.
- Helps NCBI developers with adoption of platform.
- Ensures compliance with the Federal application security regulations and standards by providing automated solutions and compliance pipelines.
- Embraces agile development and continuous improvement.
- Encourages growth mindset and offers leadership opportunities at any level.
Required Skills
- Strong coding skills in at least one programming language (Python, C++, etc.)
- Kubernetes, containerization
- Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure or equivalent cloud services
- Apache Kafka, Google Cloud Pub/Sub or equivalent
- Apache AirFlow or equivalent
- Experience with data processing applications and modern cloud-based data processing infrastructure
- Linux command-line skills
Bonus Skills
- Google Anthos
- Docker
- GitOps tools: ArgoCD or equivalent
- Infrastructure as code tools: Terraform or equivalent
- GitLab, GitHub, Bitbucket, Teamcity, Artifactory, or equivalent products for management of Git source control, CI/CD pipelines and artifact lifecycle management
- Modern observability and logging tools: Prometheus, EFK (ElasticSearch, fluentd, Kibana), TIGK (Telegraf, InfluxDB, Grafana, Kapacitor), DataDog, Sensu, Jaeger, Sentry, OpsGenie, PagerDuty, Splunk, or equivalent
- Secret Management tools such as Hashicorp Vault, CyberArk, Azure Key Vault, Google Cloud Secret Manager or equivalent
- Data transfer tools: AWS DataSync, Aspera, MinIO, CloudSoda or equivalent
- Apache Pulsar, RabbitMQ, Amazon Kinesis, Apache Flume, Apache Storm, Apache Spark Streaming, Google Cloud Pub/Sub
- Experience with best-practice design patterns in coding and architecture
- Experience working in Agile environment
Compensation
Targeted salary range: $115,000 - $150,000 commensurate with experience and location.
Skills
Kubernetes, Docker, GCP, Amazon Web Services, Microsoft Azure, Apache Kafka, Google Cloud Pub/Sub, Apache Airflow, Python, Terraform, Argo CD, Prometheus, Grafana, GitOps, Hashicorp Vault
Similar jobs
DevOps / SRE jobsOperates and evolves foundational networking, compute, Kubernetes, and ingress infrastructure for PagerDuty’s real-time platform. Requires 3+ years in SRE, DevOps, or platform engineering, with Linux production operations, cloud infrastructure, programming, and Infrastructure as Code experience.
Owns secure, scalable Azure infrastructure for healthcare applications, including cloud migrations, Terraform-based automation, CI/CD pipelines, monitoring, and compliance. Requires 3–5+ years of Azure experience and strong DevOps and cloud-security expertise.
Operate and scale Kong’s multi-region SaaS platform across major cloud providers, Kubernetes, and distributed data systems. The role requires strong infrastructure automation, observability, CI/CD, and production reliability experience, with participation in a global on-call rotation.
Builds and scales highly available infrastructure using AWS, Terraform, and Docker to support rapid growth and AI workloads. Collaborates with product and research teams on architectures, CI/CD, monitoring, and performance optimization.
Build and operate Mercor’s enterprise agent platform across security, routing, isolated execution, orchestration, deployment, and production scalability. The role requires 5+ years building high-scale platforms, architectural ownership, and experience with core infrastructure primitives across multiple clouds.