Senior Staff Software Engineer, Serving

Responsibilities

• Design, build, and operate high-throughput, low-latency services that process bid requests, execute bidding logic, and respond to ad exchanges in real time.
• Improve the performance, scalability, and reliability of systems processing millions of requests per second under strict latency constraints.
• Develop and optimize GPU-powered inference services using TensorRT.
• Profile inference pipelines and eliminate bottlenecks in GPU utilization, batching, memory access, serialization, networking, and request handling.
• Partner with machine learning engineers to productionize model architectures and features.
• Design and operate large feature-store fleets providing low-latency access to real-time and precomputed features.
• Develop benchmarking and performance-analysis tools for comparing models, analyzing latency and throughput trade-offs, and identifying regressions.
• Improve experimentation tooling for offline training runs, candidate-model evaluation, and model leaderboards.
• Own changes through design, implementation, testing, deployment, observability, capacity planning, incident response, and optimization.

Requirements

• Strong computer science fundamentals, including data structures, algorithms, and system architecture.
• 10+ years of industry experience.
• Master's degree or higher in Computer Science, or equivalent work experience.

Nice to Have

• Experience with Go.

Compensation

• Base salary ranges vary by location:
  • SF Bay Area, NYC, and Los Angeles/Orange County: $255,000–$310,000
  • Seattle/Olympia, Austin, San Diego, Santa Barbara, and Boston: $234,000–$285,000
  • All other cities and towns in approved states: $219,000–$266,000
• Compensation also includes equity and benefits, which may include medical coverage, wellness stipends, and other benefits based on country of residence.