AI Engineer, Multimodal LLMs
Builds and optimizes multimodal LLM-based AI agents for enterprise conversations, integrating with systems via APIs and automating high-stakes workflows. Requires 3+ years in AI engineering, Python/PyTorch proficiency, and experience with LLMs or vision models.
About the job
Responsibilities
- Build, deploy, and optimize AI agents that engage in enterprise-grade conversations.
- Design & develop next-gen multimodal LLM architectures (LLMs, speech, vision, reinforcement learning).
- Explore optimal trade-offs between model quality and efficiency when translating research into practical solutions.
- Refine training paradigms for real-world applications.
- Integrate AI agents with enterprise systems via APIs, databases, and automation tools.
- Experiment rapidly to improve AI-driven interactions, response quality, and automation capabilities.
- Collaborate with cross-functional teams (engineering, research, and product) to shape Eloquent AI’s roadmap.
- Monitor and improve agents’ performance via user simulations and evaluations.
Requirements
- 3+ years of experience in software development, AI engineering, or NLP in a production environment.
- Strong proficiency in Python, with experience in frameworks like PyTorch and TensorFlow.
- Experience working with LLMs or large computer vision models, or generative AI models, including fine-tuning and inference optimization.
- Familiarity with APIs, cloud infrastructure (AWS, GCP, or Azure), and enterprise integrations.
- Ability to prototype, experiment, and iterate quickly to improve AI agents.
- Strong problem-solving skills and the ability to work closely with customers to refine AI solutions.
- Solid mathematical foundation of machine learning and deep learning techniques.
Nice-to-Haves
- Experience with prompt engineering, parameter-efficient fine-tuning (PEFT), retrieval-augmented generation (RAG), reinforcement learning for LLMs.
- Published AI research in top tier AI conferences like: NeurIPS, ACL, SIGIR, ICML and ICLR.
- Contributed to open-source NLP projects.
- Worked in a fast-paced startup environment and thrive in rapid iteration cycles.
Skills
Python, PyTorch, TensorFlow, LLMs, Fine-Tuning, Inference Optimization, AWS, GCP, Azure, Prompt Engineering, Peft, RAG, Reinforcement Learning, Computer Vision, NLP
Similar jobs
ML Engineering jobs
Thinking Machines Lab
San Francisco, CA
Build and operate the engineering systems that support post-training research, including reinforcement learning infrastructure, sandboxed execution, data pipelines, and agent scaffolding. The role requires strong Python and systems engineering skills, project ownership, and a relevant bachelor’s degree or equivalent experience.
OpenAI
San Francisco, CA
Build research infrastructure and tooling that enables AI models to design silicon, including reinforcement learning environments, EDA integrations, evaluations, and experiment workflows. The role requires strong software engineering fundamentals and comfort working across research, tooling, and chip-design systems.
Rollstack
United StatesBuild production AI capabilities for automated slide and document generation, working across LLM applications, data analysis, and content generation. The role requires 3+ years in machine learning and NLP, advanced Python, and experience with LLM frameworks and production systems.
ClickUp
United States
Build and operate large-scale ranking and retrieval systems that power search relevance, including hybrid lexical/vector search, embeddings, query understanding, and permission-aware retrieval. Requires a bachelor's degree and 5+ years of ML engineering experience in ranking or information retrieval.
PathAI
Boston, MADevelop and deploy machine learning models for biomedical research and AI products, collaborating with scientific, engineering, and product teams. Requires an advanced quantitative degree, substantial ML experience, Python proficiency, and experience bringing models into production or research applications.