Duties & Responsibilities

The DataOps Platforms team:

Develops and continuously improves DataOps platform.
Develops and maintains common tools and libraries.
Evaluates new technologies and practices.
Helps NCBI developers with adoption of platform.
Ensures compliance with the Federal application security regulations and standards by providing automated solutions and compliance pipelines.
Embraces agile development and continuous improvement.
Encourages growth mindset and offers leadership opportunities at any level.

Required Skills

7+ years of experience in the field
Strong coding skills in at least one programming language (Python, C++, ...)
Kubernetes, containerization
Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure or equivalent cloud services
Apache Kafka, Google Cloud Pub/Sub or equivalent
Apache AirFlow or equivalent
Experience with data processing applications and modern cloud-based data processing infrastructure
Linux command-line skills

Google Anthos
Docker
GitOps tools: ArgoCD or equivalent
Infrastructure as code tools: Terraform or equivalent
GitLab, GitHub, Bitbucket, Teamcity, Artifactory, or equivalent products for management of Git source control, CI/CD pipelines and artifact lifecycle management
Modern observability and logging tools: Prometheus, EFK (ElasticSearch, fluentd, Kibana), TIGK (Telegraf, InfluxDB, Grafana, Kapacitor), DataDog, Sensu, Jaeger, Sentry, OpsGenie, PagerDuty, Splunk, or equivalent
Secret Management tools such as Hashicorp Vault, CyberArk, Azure Key Vault, Google Cloud Secret Manager or equivalent
Data transfer tools: AWS DataSync, Aspera, MinIO, CloudSoda or equivalent
Apache Pulsar, RabbitMQ, Amazon Kinesis, Apache Flume, Apache Storm, Apache Spark Streaming, Google Cloud Pub/Sub
Experience with best-practice design patterns in coding and architecture
Experience working in Agile environment