Senior Data Scientist, Applied AI
Senior Data Scientist building and improving production LLM agents, workflows, and internal AI applications for Rippling's GTM teams (Sales, RevOps, Customer Success). Combines applied AI development, full-stack engineering, data pipelines, ML experimentation, and evaluation infrastructure.
About the job
What you will do
- Build, launch, and improve AI agents, workflows, and internal applications used by Rippling’s GTM teams.
- Design new agent workflows involving retrieval, tool use, structured context, multi-step reasoning, and human-in-the-loop review.
- Own full-stack feature development for internal AI products, from Python/FastAPI backend services and APIs to Next.js/TypeScript frontend experiences.
- Create SQL/Python pipelines that assemble trusted business context from GTM, product, account, and activity data.
- Apply core data science and ML techniques, including experimentation, predictive modeling, segmentation, forecasting, and product analytics, to identify opportunities, improve GTM workflows, and power AI product features.
- Build and improve the model and agent evaluation infrastructure used to measure quality, catch regressions, and guide iteration, including offline evals, golden datasets, regression tests, human review workflows, and LLM-as-judge evaluation patterns.
- Analyze production traces, usage patterns, latency, token cost, and quality signals using tools such as LangSmith or similar observability platforms.
- Debug and resolve issues across prompts, retrieval, context assembly, tool calls, integrations, latency, and system performance.
- Partner with RevOps, Sales, Customer Success, and Data Science leaders to turn analytical insights and operational pain points into shipped AI product features.
- Establish practical standards for AI quality, safety, monitoring, evaluation, and iteration across Rippling’s internal AI product suite.
What you will need
- 3–6 years of experience across data science, applied ML, software engineering, data engineering, or applied AI, including 2+ years of hands-on data science or applied ML work and 1–2 years building or operating production LLM-powered applications.
- Experience in a data science or applied ML role, including building models, designing analyses or experiments, working with business/product data, and translating findings into product or operational impact.
- Strong Python skills, with experience owning backend services, APIs, or production AI/data systems. Experience with FastAPI or an equivalent backend framework is a plus.
- Hands-on experience building production LLM systems, including prompt design, retrieval-augmented generation, tool/function calling, context management, agent orchestration, evaluation, and runtime quality controls.
- Strong SQL skills for data analysis, debugging, and building reliable data/context pipelines.
- Experience analyzing usage, quality, or performance data and using those insights to improve product or system behavior.
- Comfortable owning end-to-end workstreams in ambiguous, fast-moving environments, from problem framing through production launch and iteration.
Nice to have
- Experience with AI evaluation or observability tools such as LangSmith, Braintrust, Langfuse, Arize, or similar.
- Background in experimentation, product analytics, or GTM analytics.
- Experience with Next.js, TypeScript, or other modern frontend frameworks.
- Experience building internal tools or AI products for Sales, Customer Success, RevOps, Support, or other B2B SaaS teams.
- Strong product judgment and ability to communicate technical tradeoffs to non-technical partners.
Skills
Python, SQL, FastAPI, Next.js, TypeScript, LLMs, RAG, Langsmith, Machine Learning, Data Science, Predictive Modeling, Experimentation
Similar jobs
ML Engineering jobs
Apartment List
United StatesBuild marketplace search and ranking features while supporting MLOps infrastructure, model deployment, feature stores, and real-time data pipelines. The role requires 5+ years of software engineering or MLOps experience, backend or full-stack expertise, and familiarity with cloud and machine learning tooling.
Axle
United States
Build and operate agentic AI systems for rare disease research, including typed workflows, evaluation, observability, and production deployment. The role requires a bachelor’s degree or equivalent experience, 5+ years building production systems, and 2+ years shipping LLM-powered applications.
6sense
United States
Build and deploy secure enterprise AI agents, integrations, and automated workflows that improve internal productivity and business operations. The role requires at least five years of enterprise, software, automation, or IT systems engineering experience, plus hands-on workflow and LLM application development.
Blee
San Francisco, CA
Designs and ships production multi-agent compliance systems, including LLM pipelines, model training, evaluation, monitoring, and explainability. Requires 5+ years of applied AI/ML engineering experience, strong Python, and experience deploying production ML systems.
Censys
United StatesBuild and deploy production machine-learning models and data systems that classify and enrich Internet telemetry for internal platforms and customer-facing products. The role requires 5+ years of applied ML, data science, or software engineering experience, plus strong Python or Go skills.