Skip to content
KastleKastleSan Francisco, CA

Staff AI Engineer

Builds and deploys fine-tuned LLMs and AI agents for real-time voice interactions in consumer lending, ensuring compliance and scalability. Requires 2+ years production ML/AI experience with Python, PyTorch/TensorFlow, and LLM frameworks.

180k – 250k/yr
On-siteML Engineering

About the role

What You'll Do

  • AI Model Integration: Fine-tune and deploy LLMs for real-time voice-based borrower interactions
  • Prompt Engineering: Design and iterate on prompt strategies to optimize AI performance and compliance
  • Evaluate LLMs and AI Agents: Build high quality evals using our proprietary datasets to benchmark AI agent performance and run experiments
  • Custom AI Solutions: Train and implement domain-specific AI models for consumer lending
  • Scalability & Compliance: Ensure AI solutions meet regulatory standards (FDCPA, RESPA, TILA) and scale efficiently
  • Data Pipelines & APIs: Build robust AI-driven workflows that integrate seamlessly with loan servicing platforms
  • Continuous Optimization: Monitor performance metrics and continuously improve agent quality and borrower experience

What We're Looking For

  • 2+ years building and deploying ML/AI systems in production environments
  • Strong proficiency in Python and deep learning frameworks (TensorFlow, PyTorch)
  • Experience with LLM orchestration frameworks (LangChain, LlamaIndex, or similar)
  • Track record of shipping AI products that real users depend on
  • Strong product mindset and ability to translate business requirements into AI solutions
  • Excellent communication skills to collaborate across product, engineering, and compliance teams

Skills

PythonPyTorchTensorFlowLangChainLlamaindexLLMsPrompt EngineeringMachine LearningDeep LearningAI Agents

Similar roles

ML Engineering jobs
xAI

Member of Technical Staff

xAIPalo Alto, CA

Build and optimize the RL training framework and infrastructure for large-scale workloads at SpaceXAI, from ablations to production runs. Requires experience with distributed systems and proficiency in Python, JAX, Rust, or C++.

180k – 440k/yr
On-site5+ YOEML Engineering
LlamaIndex

Member of Technical Staff, Applied Research

LlamaIndexSan Francisco, CA

Build and productionize vision-language models for document understanding at LlamaIndex. Focus on training, fine-tuning, synthetic data, benchmarking, and turning research prototypes into accurate, low-latency production systems for real-world PDFs, tables, and enterprise docs. Requires 3+ years ML engineering/applied research experience with strong PyTorch skills.

180k – 250k/yr
Hybrid3+ YOEML Engineering
xAI

Member of Technical Staff, Inference

xAIPalo Alto, CA

Build and optimize the high-performance inference platform serving Grok at massive scale. Design distributed serving infrastructure, low-level GPU optimizations, quantization, speculative decoding, and CI/CD for production reliability and low latency.

180k – 440k/yr
On-site5+ YOEML Engineering
Black Forest Labs

Member of Technical Staff

Black Forest LabsSan Francisco, CA

Research Engineer embedded in large-scale multimodal model training at Black Forest Labs (creators of FLUX). Own performance, stability, and low-precision optimizations for production training runs; profile, debug distributed systems, implement GPU kernels, and partner with researchers to ship frontier generative models.

180k – 290k/yr
Hybrid7+ YOEML Engineering
xAI

Member of Technical Staff - X Search

xAIPalo Alto, CA

Develops and operates large-scale search engine infrastructure, including retrieval algorithms, indexing, and ML ranking models integrated with Grok AI. Requires experience with search systems, vector databases, and production ML in Python, Go, or Rust.

180k – 440k/yr
On-siteML Engineering