Software Engineer, Generative AI
Build and scale secure generative AI services and applications using Python, LLMs, and modern frameworks. Own architecture decisions from proposal through production deployment for enterprise customers.
About the job
What you'll do
- Design and develop robust, secure, and scalable generative AI services and applications using Python and modern frameworks to drive enterprise-wide transformation
- Build and optimize high-performance, low-latency APIs and microservices to integrate advanced AI models and sophisticated agentic workflows into our core platform
- Act as a whole-systems thinker by making meaningful system design decisions and owning the architecture of core platform components from initial proposal through production deployment
- Implement and maintain responsive user interfaces using technologies like React and TypeScript to deliver intuitive user experiences and bridge the gap between backend services and frontend enablement
- Drive proactivity without red tape by clearly communicating changes, plans, and proposals to cross-functional teams and collaborating closely with product managers, data scientists, and DevOps engineers
- Partner with DevOps teams to build continuous deployment, logging, and monitoring systems that ensure top-tier performance, security, and reliability across distributed workloads
What you need
- 3-5+ years of hands-on experience as a software engineer with a strong emphasis on Python development in production environments
- Proven expertise in building and deploying generative AI applications, leveraging LLMs, vector databases like Pinecone, Weaviate, or pgvector, and modern open-source agentic frameworks
- Practical experience with microservices architecture, RESTful APIs, cloud platforms such as AWS, GCP, or Azure, and containerization with Docker and Kubernetes
- Solid grasp of modern web technologies including FastAPI, Asyncio, database systems like PostgreSQL, and hands-on experience leveraging AI developer tooling like Claude, Cursor, or GitHub Copilot to accelerate your engineering workflows
- Exposure to enterprise architecture including practical experience implementing IAM, SSO, SAML, OAuth, OIDC, RBAC, robust security best practices, or building services for enterprise administration and billing systems
- A Connect mindset that thrives in collaborative settings where you actively engage with cross-functional teams and mentor other engineers, a Challenge spirit that drives you to tackle complex technical hurdles and proactively suggest innovative improvements, and an Own attitude where you take full accountability for delivering high-quality, resilient, and scalable code from conception to production
Benefits & perks (US Full-time employees)
- Generous PTO, plus company holidays
- Medical, dental, and vision coverage for you and your family
- Paid parental leave for all parents (16 weeks)
- Fertility and family planning support
- Early-detection cancer testing through Galleri
- Flexible spending account and dependent FSA options
- Health savings account for eligible plans with company contribution
- Annual work-life stipends for: Wellness stipend for gym, massage/chiropractor, personal training, etc.; Learning and development stipend
- Company-wide off-sites and team off-sites
- Competitive compensation, company stock options and 401k
Skills
Python, React, TypeScript, FastAPI, Postgres, Docker, Kubernetes, AWS, GCP, Azure, Pinecone, Weaviate, Pgvector, LLMs, REST APIs
Similar jobs
ML Engineering jobs
Coalition Security
United StatesBuild and operate LLM-powered agents that automate business workflows, integrating systems of record through MCP and validating behavior with structured evaluations. Requires 5+ years of software development experience, strong Python and SQL, and hands-on experience shipping agents to production.
Build
New York, NY
Build modular AI operations and evaluation systems that power complex real estate workflows. The role focuses on improving output quality, defining correctness with domain experts, and reducing human review while maintaining high standards.
Build
New York, NYBuild and operate Dougie, an agentic AI system that executes workflows, evaluates its own performance, retains institutional context, and improves in production. The role requires experience deploying unattended agentic systems and engineering reliable memory, retrieval, orchestration, and feedback loops.
Build
New York, NYBuild and ship production agentic AI workflows for complex real estate and built-world processes. The role combines product engineering, applied AI, customer collaboration, workflow orchestration, evaluation, and reliable user-facing experiences.
Mintlify
San Francisco, CA
Build and own customer-facing AI products from experimentation through production, including reliable agents, evaluation systems, APIs, interfaces, and infrastructure. Requires at least four years of software development experience and deep production experience with language-model systems.