Software Engineer - AI Platform
Build AI agents, memory systems, and governance layers for a platform that lets non-engineers create enterprise software. Requires backend, LLM, and security experience.
About the job
What you will work on
- An AI memory system with short-term memory, persistent memory, and organizational knowledge graphs, plus data exploration for humans and agents.
- AI agents that generate, execute, debug, and test code, handling failures and feedback so non-engineers can ship production applications.
- A centralized governance layer where IT admins can see and control apps, workflows, users, agents, secrets, and policies.
What we look for
- Strong background in backend systems, platforms and database design.
- Experience building agentic systems, LLM applications, or orchestration frameworks.
- Experience with security, sandboxing, or isolation in distributed systems.
- Deep intuition for model behavior, evaluation, and performance tradeoffs.
- Ability to design simple abstractions over complex AI and systems problems.
Skills
Backend Systems, Platform Design, Database Design, Agentic Systems, Llm Applications, Orchestration Frameworks, Security, Sandboxing, Distributed Systems, Model Evaluation
Similar jobs
ML Engineering jobs
Anthropic
San Francisco, CABuild and optimize a high-scale LLM inference engine spanning accelerator programming, host-device coordination, and distributed systems. The role requires strong systems programming, performance analysis, and an understanding of LLM inference across compute, memory, and interconnects.
OnePay
United States
Build and operate production AI agents, automation workflows, and integrations that improve complex business processes. The role requires 5+ years of software engineering experience, modern LLM and agent-framework expertise, systems integration skills, and strong cross-functional collaboration.
Thinking Machines Lab
San Francisco, CA
Build and operate the engineering systems that support post-training research, including reinforcement learning infrastructure, sandboxed execution, data pipelines, and agent scaffolding. The role requires strong Python and systems engineering skills, project ownership, and a relevant bachelor’s degree or equivalent experience.
OpenAI
San Francisco, CA
Build research infrastructure and tooling that enables AI models to design silicon, including reinforcement learning environments, EDA integrations, evaluations, and experiment workflows. The role requires strong software engineering fundamentals and comfort working across research, tooling, and chip-design systems.
Rollstack
United StatesBuild production AI capabilities for automated slide and document generation, working across LLM applications, data analysis, and content generation. The role requires 3+ years in machine learning and NLP, advanced Python, and experience with LLM frameworks and production systems.