Senior Software Engineer, Backend (AI)

Responsibilities

• Design, build, and maintain scalable backend services and APIs for AI-powered features, writing primary production code in Python
• Design and implement complex, hierarchical Multi-Agent Systems that perform sophisticated, multi-step tasks
• Build robust frameworks to evaluate AI system quality and manage fine-tuning pipelines
• Define, deploy, and manage AI infrastructure using Terraform; scale container-based serverless solutions
• Analyze tradeoffs between model performance, latency, and cost for managed AI services
• Collaborate with frontend engineers and product designers; occasionally work in TypeScript (Node.js) to integrate AI features

Requirements

• 3–6+ years of backend or full-stack engineering experience with a track record of shipping scalable systems
• Deep expertise in Python and its ecosystem for web services and data processing
• Strong experience with Infrastructure as Code (Terraform), a major cloud platform (GCP, AWS, or Azure), and deploying containerized applications
• Ability to work in a lean, fast-paced R&D environment defining new playbooks for AI-native experiences

Nice-to-Haves

• Familiarity with managed AI services (Vertex AI, AWS Bedrock), LLMs, or building advanced AI systems
• Experience with model evaluation frameworks (RAGAs, LangSmith, DeepEval) or fine-tuning
• Experience with open-source agentic frameworks (LangGraph, CrewAI, Strands)
• Background in MLOps, data engineering, or consumer/marketplace/event-driven platforms

Benefits & Compensation

• Competitive salary: $200,000–$225,000
• 5-day onsite commitment at NYC SoHo office