Senior DevOps Engineer
Designs and optimizes AWS-based data infrastructure and pipelines using Airflow, Terraform, and services like DMS, Redshift, Glue, and Athena. Collaborates with data teams to ensure scalability, reliability, security, and observability; requires 7+ years in DevOps/DataOps.
Key Responsibilities
- Architect, implement, and maintain AWS-based data infrastructure leveraging DMS, Redshift, Glue, and Athena.
- Build and manage Airflow DAGs for orchestrating ETL/ELT workflows.
- Automate data migrations and integrations with AWS DMS and Glue.
- Develop and maintain Terraform modules for data infrastructure.
- Design and manage CI/CD pipelines for data workflows and infrastructure changes.
- Optimise Redshift clusters, Glue jobs, and Athena queries for performance and cost efficiency.
- Ensure reliable data delivery pipelines that power Looker dashboards and reports.
- Implement observability (logging, monitoring, alerting) for data pipelines and services.
- Enforce IAM, security policies, and compliance standards across the data ecosystem.
- Collaborate with data engineers and analysts to improve data reliability, scalability, and governance.
- Mentor junior engineers and disseminate best practices in DevOps/DataOps.
Required Skills & Experience
- 7+ years of experience in DevOps, DataOps, or Cloud Data Engineering.
- Strong hands-on expertise with AWS data services: DMS for database migrations/replication, Redshift for warehousing and performance tuning, Glue for ETL workflows, Athena for query optimization over S3.
- Strong experience with Apache Airflow for pipeline orchestration.
- Proficiency in Terraform for IaC (infrastructure as code).
- Scripting/automation expertise in Python and Bash.
- Strong CI/CD knowledge (GitLab CI, GitHub Actions, Jenkins, or ArgoCD).
- Familiarity with Looker (modeling best practices, ensuring reliable data delivery to dashboards).
- Strong experience with monitoring and observability for data platforms (Grafana, Prometheus, Datadog, ELK).
- Solid understanding of cloud security, IAM, and networking in AWS.
Nice-to-Have
- Experience with streaming data platforms (Kafka, Kinesis).
- Exposure to MLOps tools (SageMaker, ML pipelines).
- Strong SQL skills and LookML knowledge for Looker optimization.
- Prior experience leading or mentoring DevOps/DataOps engineers.
- Knowledge of cost optimization and data governance frameworks in AWS.
Senior Network Engineer
Design, deploy, and operate enterprise network infrastructure for corporate facilities and hybrid cloud environments with zero-trust architecture and compliance requirements. Requires 5+ years enterprise networking experience and ability to obtain TS/SCI clearance.
Site Reliability Engineer
Senior or Staff Site Reliability Engineer focused on continuous delivery infrastructure using Argo Workflows, ArgoCD, and Kubernetes. Owns deployment tooling, onboarding flows, and participates in 24/7 on-call. Requires 6+ years building and operating distributed systems.