Staff Software Engineer, AI & App Experience
Leads the architecture and hands-on development of LLM-powered financial assistant capabilities, including agent systems, evaluations, guardrails, and scalable backend services. Requires 8+ years of backend or full-stack experience, strong distributed-systems expertise, and production experience shipping AI features.
About the job
Responsibilities
- Set technical direction and architecture for LLM-powered member experiences, including agent architectures, prompt strategies, and orchestration patterns.
- Design, build, and scale member-facing AI capabilities from prototype through production.
- Build evaluation frameworks, observability, and guardrail systems for reliable, safe LLM-powered features.
- Develop and harden backend services and internal tooling for model routing, prompt management, agent orchestration, and evaluation pipelines.
- Use AI-assisted coding and rapid prototyping, turning effective workflows into reusable agents, evaluations, and custom tools.
- Establish quality gates and shared evaluations and guardrails for AI-assisted development.
- Calibrate AI autonomy and verification to task stakes, reversibility, and cost.
- Design experiments and A/B tests, analyze results, and make data-informed product decisions.
- Partner with product, design, data science, and risk teams.
- Provide technical design leadership, code reviews, mentorship, and participate in the on-call rotation.
Requirements
- 8+ years of backend or full-stack software development experience in production environments.
- Deep expertise in system design, distributed systems, and high-scale architectural patterns.
- Proficiency with Python or comparable frameworks and breadth across the software stack.
- Daily, hands-on fluency with LLMs, AI code assistants, and generative AI tooling.
- Experience shipping LLM-powered product features—such as agents, conversational experiences, evaluations, prompt strategies, or guardrails—at production scale.
- Experience building durable AI-enabled workflows, evaluations, rules, and tooling.
- Experience with transactional databases such as Postgres and caching systems such as Redis.
- Strong focus on maintainable, well-tested code.
- Demonstrated technical leadership, architectural decision-making, cross-functional alignment, and mentorship.
- Product mindset with a bias toward rapid shipping, measurement, and iteration.
Nice-to-haves
- Experience with agent development, fintech, or startup environments.
Compensation and Benefits
- Base salary: $223,000–$308,000 USD.
- Full-time employees are eligible for a bonus, competitive equity package, and benefits.
- Benefits include backup child, elder, and pet care.
- Near-office employees generally work four days in the office and Fridays from home; a fully remote program is also available.
Skills
Python, LLMs, Ai Code Assistants, Generative AI, Agent Architecture, Prompt Engineering, Distributed Systems, System Design, Postgres, Redis, A/B Testing, Observability, Evaluation Frameworks, Backend Services, Guardrails
Similar jobs
Fullstack Engineering jobsStaff-level individual contributor leading architecture, technical strategy, and execution for complex enterprise web applications. The role requires deep full-stack experience, strong data architecture and query-performance expertise, hands-on coding, and the ability to mentor engineers.
Leads technical direction for patient-facing mobile and web products, while shaping engagement features, architecture, and engineering practices. Requires deep consumer or healthcare product experience, technical leadership, and comfort working across the full stack.
Build and own Songkick’s systems across backend, mobile, data, and notifications while leading its technical integration with Suno. The role requires 5+ years of hands-on software engineering experience, strong API and architecture skills, and comfort in ambiguous startup environments.
Build and own full-stack internal tools, automations, and AI-agent workflows embedded with Crusoe stakeholder teams. The role requires 8+ years of production software experience, staff-level judgment, strong SQL and data modeling, and the ability to deliver reliable solutions quickly.
Leads the technical vision and implementation of large-scale payments compliance systems, including user-facing information collection, regulatory screening, and auditing controls. Requires 9+ years of experience, strong technical leadership, backend expertise, and familiarity with web architectures.