Platform Engineer (DataOps)
Builds and maintains DataOps platform using Kubernetes, cloud services, and data processing tools to support NCBI developers. Requires strong coding, cloud experience, and data infrastructure knowledge; B.S. in STEM preferred.
Duties & Responsibilities
The DataOps Platforms team:
- Develops and continuously improves DataOps platform.
- Develops and maintains common tools and libraries.
- Evaluates new technologies and practices.
- Helps NCBI developers with adoption of platform.
- Ensures compliance with the Federal application security regulations and standards by providing automated solutions and compliance pipelines.
- Embraces agile development and continuous improvement.
- Encourages growth mindset and offers leadership opportunities at any level.
Required Skills
- Strong coding skills in at least one programming language (Python, C++, etc.)
- Kubernetes, containerization
- Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure or equivalent cloud services
- Apache Kafka, Google Cloud Pub/Sub or equivalent
- Apache AirFlow or equivalent
- Experience with data processing applications and modern cloud-based data processing infrastructure
- Linux command-line skills
Bonus Skills
- Google Anthos
- Docker
- GitOps tools: ArgoCD or equivalent
- Infrastructure as code tools: Terraform or equivalent
- GitLab, GitHub, Bitbucket, Teamcity, Artifactory, or equivalent products for management of Git source control, CI/CD pipelines and artifact lifecycle management
- Modern observability and logging tools: Prometheus, EFK (ElasticSearch, fluentd, Kibana), TIGK (Telegraf, InfluxDB, Grafana, Kapacitor), DataDog, Sensu, Jaeger, Sentry, OpsGenie, PagerDuty, Splunk, or equivalent
- Secret Management tools such as Hashicorp Vault, CyberArk, Azure Key Vault, Google Cloud Secret Manager or equivalent
- Data transfer tools: AWS DataSync, Aspera, MinIO, CloudSoda or equivalent
- Apache Pulsar, RabbitMQ, Amazon Kinesis, Apache Flume, Apache Storm, Apache Spark Streaming, Google Cloud Pub/Sub
- Experience with best-practice design patterns in coding and architecture
- Experience working in Agile environment
Compensation
Targeted salary range: $115,000 - $150,000 commensurate with experience and location.
Senior Site Reliability Engineer
Senior SRE to operate and evolve EKS Kubernetes platform, CI/CD pipelines, and observability stack for Thunderbird's open-source infrastructure. Requires 7+ years infrastructure experience and strong production Kubernetes and IaC skills.
Distributed Systems Engineer
As a Senior/Staff Distributed Systems Engineer, you will design and evolve core control, data, and observability systems for LiveKit's platform, focusing on latency, availability, and operational simplicity. You will implement resilient architectures and build tools to enhance reliability and developer velocity.
Senior Software Engineer - Infrastructure R&D
As a Senior Software Engineer on the Environments Accelerator team, you will design and build systems to reduce operational overhead and complexity in provisioning infrastructure environments and datacenters. This role involves developing tooling for declarative environment bootstrap, dependency coordination, and infrastructure validation, while collaborating across various engineering teams.