Develops resilient, high-availability software for AI inference on AWS, including deployment workflows, container orchestration with Docker/Kubernetes, monitoring, and debugging. Requires Master's in CS and 18 months experience with AWS services, IaC tools, and Python.
230k – 250k
HybridDevOps / SRE
About the role
Job Duties
Design and develop software features that support system resiliency and high availability, including automated recovery mechanisms and fault-tolerant architecture across distributed environments.
Develop and maintain cloud-based deployment workflows for AI inference software using AWS tools and services to support low-latency and scalable system performance.
Develop Python-based scripts and APIs to streamline data preprocessing, inference execution, and post-processing for real-time inference tasks.
Use parallel programming techniques (e.g., multi-threading, asynchronous processing) to maximize resource efficiency on AWS compute instances.
Develop software components to support visualization and analysis of system performance metrics, enhancing the monitoring and usability of inference services.
Develop inference software in Docker containers and define Kubernetes orchestration strategies that ensure software reliability and efficient scaling.
Develop automated scripts to detect and mitigate common failure modes, improving software system reliability.
Debug issues related to model deployment, container orchestration, networking configurations, documenting steps to reproduce and root-cause defects.
Triage and resolve defects in the software service by analyzing logs, metrics, and distributed traces using tools like AWS CloudWatch, Grafana, or custom Python scripts.
Work with product management and user experience teams to define requirements for inference service interfaces, including configuration, monitoring, and event logging.
Author detailed technical documentation for infrastructure configurations, inference workflows, and APIs, ensuring clarity for internal teams and external customers.
Document and track defects, enhancements, and release notes using tools like Jira and Git, ensuring version control and traceability.
Minimum Requirements
Master’s degree or foreign equivalent in Computer Science or related field.
18 months experience as Information Security Analyst, Software Engineer, Sr. Member of Technical Staff, IT Senior Applications Engineer, or related.
Infrastructure-as-Code and deployment automation: Terraform, AWS CloudFormation, AWS CDK, Ansible.
Build and own CI/CD systems, agentic AI tooling, and developer platforms that power engineering velocity at a fast-growing healthcare AI company. Requires strong experience with modern build systems, Kubernetes, and AI-assisted development workflows.
230k – 290k
Hybrid5+ YOEDevOps / SRE
Staff Software Engineer - Infrastructure
SkydioSan Mateo, CA
Staff Infrastructure Engineer responsible for re-architecting Kubernetes infrastructure, improving continuous delivery, and making code changes across the stack to support drone platform needs.
Builds and scales developer platforms, CI/CD systems, testing infrastructure, and AI integrations to boost engineering velocity and reliability at an AI-native company. Requires 7+ years backend experience, leadership, and tools like Python, Kubernetes, and Terraform.
231k – 340k
Hybrid7+ YOEDevOps / SRE
Sr. Staff Software Engineer - Data Platform
DatabricksMountain View, CA +1
Lead the strategic vision for operational stability of Databricks' internal "Databricks-on-Databricks" environment. Transition infrastructure to an agent-driven, self-healing architecture for 99.99% availability across multi-cloud data platform services.
229k – 314k
On-site10+ YOEDevOps / SRE
Staff Software Engineer, Scaling AI Systems
AbridgeSan Francisco, CA
Staff-level engineer improving performance, stability, and scalability of AI healthcare systems. Focuses on distributed systems, Kubernetes, observability, and cloud-native tooling to support hyperscale growth.