Build and productionize vision-language models for document understanding at LlamaIndex. Focus on training, fine-tuning, synthetic data, benchmarking, and turning research prototypes into accurate, low-latency production systems for real-world PDFs, tables, and enterprise docs. Requires 3+ years ML engineering/applied research experience with strong PyTorch skills.
180k – 250k
Hybrid3+ YOEML Engineering
About the role
Responsibilities
Develop and train vision-language models for document processing and document understanding.
Build data pipelines for data curation, synthetic data generation, labeling, and benchmark creation.
Evaluate base models and perform post-training or fine-tuning to hit specific performance targets.
Improve model accuracy, latency, and cost-effectiveness across real-world document workflows.
Design and maintain benchmarks to measure extraction quality, layout understanding, OCR performance, reasoning accuracy, and end-to-end system reliability.
Work with messy real-world documents, including PDFs, scanned documents, tables, charts, forms, and multi-page enterprise documents.
Collaborate with engineering to move successful research prototypes into production.
Work directly with customers when needed to translate product requirements into benchmarks, experiments, and model improvements.
Stay close to the latest research in vision-language models, document AI, post-training, synthetic data, and agentic systems.
Use modern AI coding workflows and tools to move quickly.
Requirements
3–7 years of experience in machine learning engineering, applied research, or research engineering.
Strong ML foundation, including hands-on experience benchmarking and training models.
Strong Python skills and comfort with modern ML tooling, especially PyTorch.
Experience with computer vision, vision-language models, NLP, document AI, OCR, extraction, or agentic AI systems.
Ability to build experiments, evaluate results, and iterate quickly toward measurable performance improvements.
Strong engineering judgment and ability to write clean, production-quality code.
Comfort working in a fast-paced startup environment with high ownership and limited structure.
Adaptable, scrappy, and self-directed — someone who can figure things out without waiting to be told.
Strong technical writing and communication skills.
Nice-to-Haves
Prior startup experience, especially at an early-stage or high-growth AI company.
Experience as a founder or early startup engineer.
Experience building or improving document processing systems.
Experience with synthetic data generation, post-training, fine-tuning, or benchmark design.
Familiarity with tools such as vLLM, Pydantic, uv, ruff, mypy, Claude Code, Cursor, or similar modern AI engineering workflows.
Experience with open-source AI infrastructure or developer tools.
Skills
PyTorchPythonVision-Language ModelsComputer VisionDocument AiOcrNLPSynthetic Data GenerationFine-TuningBenchmarkingvLLM
Build and optimize the RL training framework and infrastructure for large-scale workloads at SpaceXAI, from ablations to production runs. Requires experience with distributed systems and proficiency in Python, JAX, Rust, or C++.
180k – 440k
On-site5+ YOEML Engineering
Member of Technical Staff, Inference
xAIPalo Alto, CA
Build and optimize the high-performance inference platform serving Grok at massive scale. Design distributed serving infrastructure, low-level GPU optimizations, quantization, speculative decoding, and CI/CD for production reliability and low latency.
180k – 440k
On-site5+ YOEML Engineering
Member of Technical Staff
Black Forest LabsSan Francisco, CA
Research Engineer embedded in large-scale multimodal model training at Black Forest Labs (creators of FLUX). Own performance, stability, and low-precision optimizations for production training runs; profile, debug distributed systems, implement GPU kernels, and partner with researchers to ship frontier generative models.
180k – 290k
Hybrid7+ YOEML Engineering
Member of Technical Staff - X Search
xAIPalo Alto, CA
Develops and operates large-scale search engine infrastructure, including retrieval algorithms, indexing, and ML ranking models integrated with Grok AI. Requires experience with search systems, vector databases, and production ML in Python, Go, or Rust.
180k – 440k
On-siteML Engineering
Member of Technical Staff - Post-Training and RL
xAIPalo Alto, CA
Develops advanced post-training and reinforcement learning techniques like RLHF/DPO and reward modeling to enhance AI model reasoning, truthfulness, and real-world capabilities at xAI. Seeks passionate AI enthusiasts obsessed with truth-seeking models; prior experience preferred but not required.