Develops and deploys techniques to enhance LLM inference efficiency, focusing on architecture optimization, decoding algorithms, and GPU acceleration. Requires PhD in ML, expertise in LLM optimization, strong software skills, and top-tier publications.
Salary not listed
RemoteML Engineering
About the role
Responsibilities
Develop, prototype, and deploy techniques that improve LLM inference efficiency in production.
Explore breakthroughs across model execution stack, including model architecture and MoE routing optimization.
Implement decoding and inference-time algorithm improvements.
Perform software/hardware co-design for GPU acceleration.
Optimize performance without compromising model quality.
Requirements
PhD in Machine Learning or related field.
Deep understanding of LLM architecture and optimization under resource constraints.
Significant experience with model efficiency techniques.
Strong software engineering skills.
Experience in fast-paced, high-ambiguity startup environment.
Publications at top-tier conferences (ICLR, ACL, NeurIPS).
Passion for mentoring others.
Nice-to-Haves
Appetite for working in startups (encouraged even if not perfect fit).
Build and optimize the RL training framework and infrastructure for large-scale workloads at SpaceXAI, from ablations to production runs. Requires experience with distributed systems and proficiency in Python, JAX, Rust, or C++.
180k – 440k/yr
On-site5+ YOEML Engineering
Staff Software Engineer, AI & App Experience
ChimeNew York, NY +1
Staff Software Engineer building and scaling Jade, Chime's LLM-powered AI financial assistant. Sets technical direction for agent systems, evals, and guardrails while staying hands-on with prototyping, backend services, and cross-functional product delivery. Requires 8+ years production experience, deep AI/LLM fluency, and technical leadership.
Build and own validation pipelines, CI/CD infrastructure, and platform integrations to launch frontier models and inference features reliably across AWS, GCP, and Azure. Requires strong large-scale distributed systems experience and track record improving release velocity.
320k – 485k/yr
Hybrid7+ YOEML Engineering
Senior Staff Software Engineer, Legal Automation
CoinbaseUnited States
Senior Staff Software Engineer building an AI agent platform and automated workflows to transform Coinbase's Legal organization. Architect production-grade LLM and multi-agent systems that replace manual legal processes such as agreement redlining and governance.
254k – 299k/yr
Remote12+ YOEML Engineering
Staff Machine Learning Engineer, Computer Vision
PinterestSan Francisco, CA
Staff Machine Learning Engineer developing state-of-the-art visual encoders and multimodal models at Pinterest Labs. Prototype visual reasoning tools, train billion-scale models on rich visual-text data, ship to production for recommender systems and VLMs, publish research, and mentor juniors. Requires strong CV/ML background, publications, and PhD or equivalent.