Staff Software Engineer - AI

Responsibilities

• Work on the design, development, and deployment of large-scale AI systems and services, including models, pipelines, product experiences and infrastructure.
• Help drive the technical strategy and roadmap for AI feature development, focusing on scalability, repeatability, reliability, and performance.
• Mentor and guide other engineers in best practices and productionizing AI technologies.
• Collaborate with Product and Data Science teams to translate business problems into technical requirements and deliver high-impact AI solutions (combining LLMs, Vector Databases, ML and other technology in novel ways).
• Look for opportunities to embed AI as a repeatable mechanism in daily workflows by integrating experimentation into real work, and continuously refining its use with sound judgment and validation.
• Be a leader in AI safety, ensuring AI-enabled products are aligned with our values and mission.

Requirements

• Bachelor’s degree in Computer Science, Data Science, or a related technical field, or equivalent experience.
• 10+ years of professional software engineering experience, with at least 3 years focused on building and scaling production AI/ML systems.
• Expertise in building scalable backend systems.
• Deep knowledge of MLOps practices, cloud infrastructure (AWS/GCP/Azure), and CI/CD pipelines for machine learning models and the common inference APIs/SDKs and frameworks.
• Experience with modern AI technologies, including Large Language Models (LLMs) and their various architectures, methods such as RAG, vector databases, and the common AI stack including TensorFlow/Keras, PyTorch, Transformers, etc.
• A strong curiosity for exploring new technologies, including AI.

Added Bonuses

• A history of engaging in AI development, from the early ML/NN (YOLO, Darknet) to the LLM era.
• Experience in monitoring and debugging production AI systems (inference, evals, judging, benchmarks) including cost and performance optimizations.
• Interest or experience in edge/on-device inference (MLX, JAX, transformers on TPU/NPU, etc.).
• Interest, experience or experimentation in training/fine-tuning transformer/diffusion models, dataset curation and captioning, etc.

Compensation

• Base salary: $169,000 to $211,000 upon hire (varies based on experience, skills, certifications, and education).
• Full-time employees eligible for common share options with vesting schedule and potential annual bonus of 10% based on company performance.