Software Engineer, Generative AI
Build secure, scalable generative AI services, APIs, and interfaces for enterprise customers. The role requires production Python experience, expertise with LLM applications and agentic frameworks, cloud-native architecture, and strong collaboration across engineering and product teams.
About the job
Responsibilities
- Design and develop robust, secure, and scalable generative AI services and applications using Python and modern frameworks.
- Build and optimize high-performance, low-latency APIs and microservices integrating AI models and agentic workflows.
- Make system design decisions and own architecture for core platform components from proposal through production deployment.
- Implement responsive user interfaces with React and TypeScript.
- Communicate changes, plans, and proposals across cross-functional teams.
- Collaborate with product managers, data scientists, and DevOps engineers.
- Partner with DevOps teams on continuous deployment, logging, and monitoring for distributed workloads.
Requirements
- 3–5+ years of hands-on software engineering experience, with a strong emphasis on production Python development.
- Experience building and deploying generative AI applications using LLMs, vector databases, and open-source agentic frameworks.
- Experience with microservices architecture, RESTful APIs, cloud platforms, Docker, and Kubernetes.
- Knowledge of FastAPI, Asyncio, PostgreSQL, and AI developer tools such as Claude, Cursor, or GitHub Copilot.
- Experience with enterprise architecture and technologies such as IAM, SSO, SAML, OAuth, OIDC, and RBAC.
- Collaborative mindset, proactive problem-solving, mentoring ability, and ownership of high-quality, resilient, scalable code.
Benefits
- Generous PTO and company holidays.
- Comprehensive medical and dental insurance.
- 16 weeks of paid parental leave for all parents.
- Fertility and family planning support.
- Early-detection cancer testing through Galleri.
- Competitive pension scheme and company contribution.
- Wellness, learning and development, and work-life stipends.
- Company-wide and team off-sites.
- Competitive compensation and company stock options.
Skills
Python, Generative AI, LLMs, Pinecone, Weaviate, Pgvector, Microservices, REST APIs, AWS, Docker, Kubernetes, React, TypeScript, FastAPI, Postgres
Similar jobs
ML Engineering jobs
Rollstack
United StatesBuild production AI capabilities for automated slide and document generation, working across LLM applications, data analysis, and content generation. The role requires 3+ years in machine learning and NLP, advanced Python, and experience with LLM frameworks and production systems.
OpenAI
London, United Kingdom
Build and deploy AI-powered products for digital-native customers, taking systems from experimentation through production and scale. The role requires strong Python skills, hands-on production engineering, systematic AI evaluation, and the ability to navigate reliability, security, governance, and customer impact.
Elliptic
London, United Kingdom
Build full-stack AI agent fleets, APIs, workflows, and internal services that automate complex business processes. The role requires at least five years of engineering experience, hands-on LLM framework experience, production AWS expertise, Kubernetes, and strong API and database skills.
Protege
Remote
Build the technical foundation for a new business vertical, creating reusable infrastructure and leading early customer engagements from scoping through delivery. The role requires 3+ years of engineering experience, strong Python and SQL skills, backend/data expertise, and comfort operating in ambiguity.
Build
New York, NYBuild and operate Dougie, an agentic AI system that executes workflows, evaluates its own performance, retains institutional context, and improves in production. The role requires experience deploying unattended agentic systems and engineering reliable memory, retrieval, orchestration, and feedback loops.