Senior Software Engineer, AI Platform & Agents

Responsibilities

• AI Platform Engineering: Build and maintain the core infrastructure, services, and SDKs that empower the rest of the company to leverage LLMs and Agentic workflows.
• Scientific Collaboration: Partner closely with Applied Scientists and Data Scientists to translate experimental models and research into scalable, production-grade AI services.
• Data Strategy: Work with Data Engineers to design robust data pipelines that feed into RAG systems, ensuring high-quality, real-time data retrieval for AI context.
• Internal Onboarding: Act as a technical consultant and facilitator for other engineering teams, helping them successfully onboard their specific AI use cases onto the platform.
• Design & Document: Design, document, and deploy public AI interfaces that provide an exceptional developer experience for internal users.
• Operational Excellence: Collaborate with Site Reliability Engineers (SRE) to deliver AI applications in a repeatable, stable, and highly efficient software development lifecycle.
• Quality Engineering: Develop comprehensive test cases for AI models and workflows, working with QE to ensure deterministic and reliable outcomes in a non-deterministic AI landscape.

Skills and Qualifications

• Core Development: Expert-level API and service development in Python (required) and/or Go. Experience with SQL, database management
• AI Architecture: Hands-on experience building RAG pipelines, managing vector databases, and orchestrating multi-agent systems.
• Cross-Functional Fluency: Proven ability to communicate technical requirements effectively across Data Science, Data Engineering, and Product domains.
• Cloud Native Principles: Deep understanding of production-tested principles including horizontal scaling, 12-factor application design, and security principles like OWASP.
• Observability: Experience monitoring AI performance and analyzing model/software errors using tools like Sentry, DataDog, or Jaeger.
• DevOps Tools: Proficiency in container-based development with Docker and source control via Git.
• Experience: At least 5+ years of hands-on software development experience—"It’s not the years, it’s the miles."

Bonus Points

• Experience with AI orchestration frameworks (e.g., LangChain, LangGraph, LlamaIndex, LiteLLM, or CrewAI).
• Production experience with distributed, event-driven, and message-driven architectures.
• Experience building self-service "Platform-as-a-Product" for internal developers.

Compensation

Our compensation reflects the cost of labor across several US geographic markets. The US base salary for this position ranges from $136,900.00/year in our lowest geographic market up to $183,375.00/year in our highest geographic market. Consistent with applicable laws, an employee's pay within this range is based on a number of factors, which include but are not limited to relevant education, skills, job-related knowledge, qualifications, work experience, credentials, and/or geographic location. Your recruiter can share more on target salary for your location during the interview process. Coalition, Inc. reserves the right to modify this range as needed.

Perks

• 100% medical, dental and vision coverage
• Flexible PTO policy
• Annual home office stipend and WeWork access
• Mental & physical health wellness programs (One Medical, Headspace, Wellhub, and more)!
• Competitive compensation and opportunity for advancement