Principal Software Engineer builds scalable backend systems for AI/ML operations, deploys production ML models, and collaborates with clients on use case discovery and AI solutions. Requires 8+ years experience in ML engineering, Python, cloud platforms, and client-facing work.
250k – 366k/yr
Hybrid8+ YOEBackend Engineering
About the role
What You’ll Do
As part of the Forward Deployed Engineering team, contribute during rapid growth by scaling models, improving platform performance, building backend systems, supporting client-facing deployments, and enabling smoother workflows for machine learning solutions.
Develop and maintain AI/ML systems: Build robust, scalable backend systems that support machine learning operations and data processing pipelines.
Cloud operations and management: Oversee and optimize cloud infrastructure to ensure efficient deployment and operation of ML models.
Problem solving: Independently explore and address complex problem spaces to improve system capabilities and performance without extensive guidance.
Cross-functional collaboration: Work closely with ML engineers and data scientists to integrate advanced ML technologies, ensuring seamless operations across various platforms.
Client engagement: Collaborate directly with clients, working embedded with client teams to support use case discovery, product development, and AI deployment.
Innovation and R&D: Actively participate in research and development of new tools that can enhance AI capabilities and workflows.
What We Need
8+ years of software engineering experience, with a strong focus on ML engineering and deploying machine learning models in production.
Extensive experience in full-stack development, particularly in backend environments that support AI/ML workloads.
Prior experience working directly with clients in use case discovery, product development, and leading client engagements.
Technical Expertise:
Strong proficiency in Python, with deep expertise in LLMs, AI Agents, and ML model development.
Experience designing and deploying scalable ML systems, such as retrieval-augmented generation (RAG) pipelines and production-grade AI applications.
Extensive experience with cloud platforms (AWS, GCP, Azure) and operational best practices for ML workloads.
Familiarity with Kubernetes and other container management tools.
Ability to write well-structured, organized code and automated unit/E2E tests.
Comfortable with polyglot persistence models (SQL vs. NoSQL).
ML Operations: Experience with MLOps frameworks and best practices; familiarity with DevOps principles as applied to machine learning models, including model versioning, monitoring, and lifecycle management.
Problem solving: Ability to operate independently in unstructured environments, demonstrating a proactive and investigative approach to tackling challenges.
Communication: Excellent communication skills, with the ability to collaborate effectively in dynamic, cross-functional teams, including data scientists, researchers, and software engineers.
Leads design and implementation of core money infrastructure including pricing, billing, payments, and monetization for Replit's platform. Requires 8+ years backend experience, expertise in financial systems like subscriptions or usage-based billing.
250k – 340k/yr
Hybrid8+ YOEBackend Engineering
Principal Software Development Engineer Person & Trust Platform
IdmeMountain View, CA
Principal engineer owning data model strategy, API contracts, and architecture for ID.me's foundational Person, Trust, and Inspection Catalog systems that determine identity and confidence scoring. Requires 10+ years experience with deep expertise in graph data modeling and source-of-truth APIs.
243k – 307k/yr
On-site10+ YOEBackend Engineering
Principal Software Engineer I - Metadata
SnowflakeMenlo Park, CA
Designs and builds fault-tolerant, scalable distributed systems for Snowflake's metadata, Snowgrid, and data sharing features. Requires 15+ years experience, strong CS fundamentals, Java fluency, and ability to mentor juniors while solving performance and scale challenges.
264k – 380k/yr
On-site15+ YOEBackend Engineering
Principal Software Engineer - Snowflake Intelligence
SnowflakeMenlo Park, CA
Leads technical vision and architecture for Snowflake Intelligence, tackling agentic reasoning, NL-to-SQL, and enterprise RAG. Requires 10+ years software engineering with 3+ years LLM deployment at scale, deep AI expertise, and principal-level impact.
264k – 380k/yr
On-site10+ YOEBackend Engineering
Principal Software Engineer I - Snowhouse Foundation
SnowflakeMenlo Park, CA
Leads design and implementation of highly available distributed platforms and pipelines for Snowflake's petabyte-scale data warehouse. Requires 15+ years in distributed systems and data infrastructure, with cloud expertise in AWS, Azure, GCP.