Senior Software Engineer, AI Model LifeCycle
Builds and maintains platforms for fine-tuning, training, and managing LLMs including reinforcement learning pipelines and multi-node orchestration. Requires 4+ years in AI, hands-on LLM experience, and advanced degree in CS/Engineering.
About the job
What You’ll Be Working On
- Manage fine-tuning systems for large foundation models (SFT, PEFT, LoRA, adapters), including multi-node orchestration, checkpointing, failure recovery, and cost-efficient scaling.
- Implement and maintain end-to-end training pipelines for Large Language Models.
- RFT and Reinforcement learning to the fine tuning and training sections.
- Distillation and reinforcement learning pipelines (e.g., preference optimization, policy optimization, reward modeling).
- Dataset, model, and experiment management: versioning, lineage, evaluation, and reproducible fine-tuning at scale.
What You’ll Bring to the Team
- Advanced degree in Computer Science, Engineering, or a related field.
- 4-5+ years of industry experience leading and driving impactful projects in the AI Space.
- Experience in Generative AI (Large Language Models, Multimodal).
- Hands-on experience training, fine-tuning, and aligning LLMs using Reinforcement Learning and Reinforcement Fine-Tuning (RFT) techniques.
- Proactive and collaborative approach with the ability to work autonomously.
- Passion for building cutting-edge AI products and solving challenging technical problems.
Bonus Points:
- Proficiency in Golang or Python for large-scale, production-level services and PyTorch.
- Contributions to open-source AI projects such as vLLM or similar frameworks.
- Performance optimizations on GPU systems and inference frameworks.
Compensation
Compensation will be paid in the range of up to $172,425 - $230,945 + Bonus. Restricted Stock Units are included in all offers. Compensation to be determined by the applicant's knowledge, education, and abilities, as well as internal equity and alignment with market data.
Skills
PyTorch, LLMs, Reinforcement Learning, Fine-Tuning, Peft, Lora, Sft, Rft, vLLM, Go, Python, GPU, Multi-Node Orchestration, Dataset Versioning
Similar jobs
ML Engineering jobs
Instacart
United StatesBuild and deploy machine learning systems that apply economic theory, econometrics, and causal inference to marketplace problems. The role requires advanced training in economics, strong Python and data skills, and production ML experience for senior-level hires.
Everlaw
Oakland, CA
Builds and operates AI platform capabilities including RAG pipelines, semantic retrieval, agentic orchestration, and LLM integrations to power legal tech products. Requires 4+ years in distributed cloud systems, AI/ML experience, and proficiency in modern programming languages.
Ai2
Seattle, WA
Senior Research Engineer tailoring and deploying machine learning models for partner applications across geospatial and environmental domains. The role requires PyTorch expertise, end-to-end ML deployment experience, geospatial tools knowledge, and strong independent execution.
Beacon Biosignals
United States
The Senior Algorithm Engineer leads development and production deployment of machine and deep learning algorithms for biosignal and medical-device applications. The role requires 5+ years of industry experience, DSP and statistics expertise, PyTorch proficiency, and familiarity with regulated health or similar domains.
Swayable
New York, NYSenior engineer developing and productizing AI, machine learning, scientific computing, and data-analysis capabilities for a high-performance analytics engine. Requires 5+ years building quantitative data-intensive software and expertise in Python, machine learning, scalable architecture, and distributed computing.