What You'll Be Working On
- Design and operate reliable managed AI services with a focus on serving and scaling LLM workloads
- Define, measure, and improve SLIs/SLOs to ensure performance and reliability targets are met
- Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters
- Automate observability by building telemetry and performance tuning strategies for latency-sensitive services
- Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling
- Contribute to the architecture of next-generation distributed systems purpose-built for AI-first environments
What You'll Bring to the Team
- Strong software engineering background — experience building production-grade systems beyond scripting or Bash
- Demonstrated experience in distributed systems design and implementation
- SRE mindset and experience (whether or not under the SRE title) including:
- Defining and measuring SLIs/SLOs
- Building monitoring and observability systems
- Driving performance and reliability improvements
- Designing fault-tolerant systems and automated testing strategies
- Proficiency in at least one modern programming language (Python, Go, Java, C++)
- Familiarity with Kubernetes or container orchestration platforms
- Strong collaboration and communication skills
- Ability to thrive in a fast-paced, mission-driven environment
Benefits
- Industry competitive pay
- Restricted Stock Units in a fast growing, well-funded technology company
- Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
- Employer contributions to HSA accounts
- Paid Parental Leave
- Paid life insurance, short-term and long-term disability
- Teladoc
- 401(k) with a 100% match up to 4% of salary
- Generous paid time off and holiday schedule
- Cell phone reimbursement
- Tuition reimbursement
- Subscription to the Calm app
- MetLife Legal
- Company paid commuter benefit; $300 per month
Compensation: $170,000 to $205,000 (includes Restricted Stock Units). Compensation to be determined by the applicant’s education, experience, knowledge, skills, and abilities, as well as internal equity and alignment with market data.