Skip to content
PalantirPalantirSeattle, WA

Software Engineer

Develop and deploy LLM agents and multi-agent systems to edge hardware for tactical defense applications, interfacing with sensors, effectors, and drones. Requires 5+ years software engineering experience, strong skills in PyTorch, LangChain, and languages like Rust/Python/C++, plus security clearance eligibility.

Salary not listed
Hybrid5+ YOEML Engineering

About the role

Core Responsibilities

  • Train and fine-tune edge-capable LLMs for tactical defense applications
  • Optimize model performance for various edge hardware (GPU, CPU, and specialized accelerator) platforms
  • Design and implement multi-agent systems for various mission scenarios
  • Interface LLM agents with sensors, effectors, and drone systems
  • Benchmark and evaluate agent capabilities, performance, and reliability
  • Engineer scalable, reliable, and fail-safe systems capable of functioning in high-stakes environments

What We Value

  • Proven experience in AI model development, training, and fine-tuning
  • Experience building LLM agent systems using direct LLM API calls, or frameworks such as LangChain
  • Experience optimizing AI models and runtime performance for edge hardware
  • Familiarity with edge AI optimization tools including Ollama, Mojo, TVM, TF Lite, and vLLM
  • Experience working in the defense sector, especially with weapon and UxV systems, is highly desirable
  • Ability to manage complexity, optimize for performance, and think critically under pressure
  • Experience deploying and maintaining robust production systems

What We Require

  • 5+ years of professional software development experience
  • 2+ years of experience contributing to the system design or architecture (architecture, design patterns, reliability and scaling) of new and existing systems
  • Experience building and deploying LLMs and LLM agents using modern frameworks such as PyTorch, HuggingFace Transformers, LangChain, and vLLM
  • Strong proficiency in Rust, Python, or C++
  • Bachelor's/Master's/PhD in Computer Science, Physics, Mathematics, or related fields
  • Active US Security clearance or eligibility and willingness to obtain a US Security clearance

Skills

PyTorchhugging face transformersLangChainvLLMRustPythonC++ollamamojotvmtensorflow liteLLMsedge aimulti-agent systems

Similar roles

ML Engineering jobs
Twilio

Machine Learning Engineer

TwilioUnited States

Build, deploy, and operate scalable ML systems for real-time applications like anomaly detection, recommendations, and agentic AI at Twilio. Requires 5+ years production ML experience, strong Python/Java/SQL skills, and MLOps expertise.

156k – 229k/yr
Remote5+ YOEML Engineering
Zoox

Machine Learning Engineer

ZooxFoster City, CA

Develop deep learning models using imitation and reinforcement learning for autonomous driving agents and planning. Requires advanced degree plus experience with RL, transformers, and production ML pipelines.

189k – 270k/yr
Hybrid5+ YOEML Engineering
Siftstack

Software Engineer, Backend

SiftstackSan Francisco, CA +1

Build and operate dependable agentic AI systems that analyze large-scale hardware telemetry for aerospace and defense teams. Design tools, execution environments, distributed job systems on Kubernetes, and evaluation frameworks while owning the product end-to-end and speaking directly with customers.

200k – 250k/yr
Hybrid3+ YOEML Engineering
Otter

Software Engineer, AI Agent & LLM

OtterMountain View, CA

Build and improve AI agent experiences and conversational knowledge engine for Otter AI Chat. Focus on quality evaluation, infrastructure for orchestration/tracing, diagnosing failures across the stack, and driving measurable improvements in AI systems from traces and feedback. Requires 3+ years AI/ML engineering, strong backend/distributed systems skills, and experience shipping LLM-powered products.

155k – 185k/yr
Hybrid3+ YOEML Engineering
xAI

Software Engineer

xAIPalo Alto, CA

Build and own a mission-critical research platform for evaluating AI model capabilities and behaviors at xAI. Design instruments, datasets, grading schemes, and infrastructure to measure, diagnose, and improve models while shipping delightful internal tools.

175k – 275k/yr
On-site3+ YOEML Engineering