Senior Software Engineer, Applied AI (Forward Deployed)
Senior forward-deployed engineer builds and deploys AI-powered workflows using LLMs and ML frameworks for client operational problems. Requires 7+ years experience in Python, data/ML systems, deployment infrastructure, and client-facing skills; hybrid in NYC area.
About the job
What You’ll Do
- Collaborate with delivery leaders to scope technical solutions to operational problems
- Identify workflow optimizations through deep engagement with customer problems and work to build into a stable and scalable solution
- Design and implement AI-powered workflows using LLMs, embedding models, retrieval systems, and automation tools
- Translate messy real-world constraints (e.g., inconsistent data, latency requirements) into elegant engineering solutions
- Iterate quickly based on real-time feedback from operators and clients
- Build reusable tooling and infrastructure that accelerates future deployments
What We Need
- 7+ years of software engineering experience, including significant time spent building data, ML, or backend systems
- Python & ML/LLM Frameworks: Deep proficiency in Python with hands-on experience using Hugging Face, LangChain, OpenAI, Pinecone, and related ecosystems
- Deployment & Infrastructure: Skilled in full-stack and API-based deployment patterns, including Docker, FastAPI, Kubernetes, and cloud environments (GCP, AWS)
- Platform Orchestration: Experienced with workflow orchestration libraries, pub/sub systems (Kafka), and schema governance
- Data Management: Expertise in data governance and operations, including Unity Catalog and policy management, cluster/job orchestration, data contracts and quality enforcement, Delta/ETL pipelines, and replay processes
- Strong product and distributed systems skills — you understand business needs and how to translate them into technical architecture
- Experience building usable systems from messy data and ambiguous requirements
- Excellent communication and client-facing skills; you’ve led conversations with technical and non-technical stakeholders alike
- Proven experience owning projects from scoping through deployment in ambiguous, high-stakes environments
- Be willing to be on-call for our customers when situations arise
- Strong engineering background demonstrated by a Bachelor’s degree in Data Science, Computer Science and related fields OR equivalent professional experience
Skills
Python, Hugging Face, LangChain, OpenAI, Pinecone, Docker, FastAPI, Kubernetes, GCP, AWS, Kafka, Unity Catalog, LLMs
Similar jobs
ML Engineering jobs
Databricks
United States
Build and productionize generative AI applications for U.S. federal customers, advise clients, and influence product direction. The role requires extensive data science and machine learning deployment experience, a graduate quantitative degree or equivalent experience, and U.S. security clearance eligibility.
Swayable
New York, NYSenior engineer developing and productizing AI, machine learning, scientific computing, and data-analysis capabilities for a high-performance analytics engine. Requires 5+ years building quantitative data-intensive software and expertise in Python, machine learning, scalable architecture, and distributed computing.
Mem0
San Francisco, CA
Own the end-to-end lifecycle of memory features for AI agents. Fine-tune models, implement research, build evaluations, and ship production systems with Engineering.
PrizePicks
United States
Build and ship production Applied AI capabilities, including agent infrastructure, RAG services, evaluation systems, and AI-powered engineering workflows. The role requires 6+ years of software engineering experience, strong backend and distributed-systems skills, and direct experience delivering LLM- or ML-powered products.
Ai2
Seattle, WA
Senior Research Engineer tailoring and deploying machine learning models for partner applications across geospatial and environmental domains. The role requires PyTorch expertise, end-to-end ML deployment experience, geospatial tools knowledge, and strong independent execution.