Skip to content
RillaRillaNew York, NY

Software Engineer, Applied AI

Builds AI systems for voice-first interfaces, audio intelligence pipelines, and real-world conversation analysis using Python/TypeScript and ML tools like PyTorch/OpenAI. Deploys production LLM systems with customer focus in NYC office.

200k – 300k/yr
On-siteML Engineering

About the role

Responsibilities

  • Architect and ship AI-powered systems for voice-first interfaces, enabling natural speech commands.
  • Build search engines to uncover insights from unstructured voice data.
  • Develop audio intelligence pipelines for real-world conversations.
  • Work across the full AI lifecycle: data acquisition, real-time inference, and user-facing chat interfaces.
  • Shape the foundations of the AI stack and invent new techniques, tooling, and models.

Requirements

  • Experience building and deploying AI/LLM systems in production.
  • Familiarity with eval frameworks, agent tooling, and prompt engineering.
  • Comfort working directly with customers to understand needs and solve real-world problems.

Technologies We Use

  • Python, TypeScript, FastAPI
  • PyTorch, OpenAI APIs, Baseten, LiteLLM
  • AWS, LiveKit, PostgreSQL, Redis, S3

Compensation

  • Estimated salary range: $200,000 - $300,000/year
  • Incentive Stock Options, sign-on bonus, and other incentives possible
  • Benefits: Medical/dental/vision, meals, gym, commuter, relocation, flexible PTO, stipends

Skills

PythonTypeScriptFastAPIPyTorchOpenai ApisBasetenLitellmAWSLivekitPostgres

Similar roles

ML Engineering jobs
Console

Research Engineer

ConsoleSan Francisco, CA

Research Engineer building self-improving AI agent systems at Console. Develop eval/optimization loops, fine-tune specialist models, and improve agent reasoning over enterprise context using production data to drive measurable gains in quality, latency, and reliability.

200k – 350k/yr
On-siteML Engineering
Kepler

Machine Learning Engineer

KeplerNew York, NY

Build and own ML models, fine-tuning, evaluation harnesses, and routing for Kepler's AI agent harness in finance. Requires 5+ years production software experience and shipped ML systems focused on correctness, evals, and real-world reliability.

200k – 280k/yr
On-site5+ YOEML Engineering
AfterQuery

Machine Learning Engineer

AfterQuerySan Francisco, CA

Build production ML systems for measuring, predicting, and scaling data quality for frontier AI models. Requires 3-6 years experience in applied ML or related production systems (ranking, recommendations, data quality, fraud) plus strong software engineering skills.

200k – 300k/yr
On-site3+ YOEML Engineering
Tennr

Machine-Learning Operations Engineer

TennrNew York, NY

Founding ML Operations Engineer building scalable training, inference, and evaluation pipelines for proprietary VLMs and LLMs in healthcare. Requires 5+ years production ML infrastructure experience, strong Python/TypeScript skills, and ownership in a fast-paced startup.

200k – 230k/yr
On-site5+ YOEML Engineering
Glean

Machine Learning Engineer, Enterprise Brain

GleanMountain View, CA

Machine Learning Engineer building the Enterprise Brain - a proactive AI system for task detection, automation, reasoning, planning and personalization using LLMs, RL, fine-tuning, and advanced ranking on top of enterprise and personal knowledge graphs. Requires 3+ years ML experience, strong production ML skills, and expertise in evaluation/benchmarking.

200k – 300k/yr
Hybrid3+ YOEML Engineering