Skip to content
AnaraAnaraSan Francisco, CA

Software Engineer, Backend

Builds scalable backend infrastructure for AI-powered research tools, focusing on RAG pipelines, LLMs, agent architectures, prompt engineering, and performance optimization. Requires hands-on experience scaling products and working in fast-paced startups.

150k – 200k/yr
On-siteEntry levelBackend Engineering

About the role

Responsibilities

  • Designing and building scalable infrastructure for AI-powered research tools.
  • Collaborating closely with the engineering team on our RAG pipeline, continuously improving response quality, latency and robustness.
  • Establishing best practices for prompt engineering and deployment of new models and workflows.
  • Monitoring and optimizing system performance and costs, making pragmatic tradeoffs to keep us lean and moving fast.
  • Owning the design and automation of eval pipelines to continuously measure, benchmark and improve AI agent quality and reliability.

Requirements

  • Quick, scrappy and first and foremost a builder.
  • Blend excellent engineering with a taste for models and design.
  • Worked on back end agent behaviors and have hands-on experience with LLMs, RAG, and agent architectures.
  • Have independently built and scaled a product to at least a few thousand users (e.g. a side project or open-source project).
  • Have worked in a high-growth, fast-paced environment (ideally another startup) and can drive things forward with relatively little oversight.

Compensation

  • $150K - $200K
  • 0.50% - 1.00% equity

Skills

LLMsRAGAgent ArchitecturesPrompt EngineeringKubernetesPythonScalable InfrastructureEval PipelinesMonitoringAi Pipelines

Similar roles

Backend Engineering jobs
Sprig

Software Engineer, AI Team

SprigSan Francisco, CA

Build and maintain backend systems and AI inference pipelines that process large-scale user feedback into actionable product insights. Requires 2+ years of production software experience and willingness to work primarily in TypeScript.

150k – 230k/yr
Hybrid2+ YOEBackend Engineering
Garner Health

Software Engineer II

Garner HealthNew York, NY

Software Engineer II builds, optimizes, and maintains AI-powered software systems analyzing medical records, focusing on distributed event-driven architectures in healthcare. Requires 2+ years experience, HIPAA familiarity, and generalist mindset in AWS/Kubernetes environment.

150k – 170k/yr
Hybrid2+ YOEBackend Engineering
Applied Intuition

Software Engineer - Kafka

Applied IntuitionSunnyvale, CA

Builds large-scale data platforms for AI and autonomy, processing petabytes of sensor data using distributed systems like Kafka and Spark. Requires 2+ years backend experience and bachelor's in CS.

153k – 222k/yr
On-site2+ YOEBackend Engineering
Nuro

Software Engineer, Routing

NuroMountain View, CA

Builds and scales backend systems and onboard modules for autonomous vehicle routing, optimizing algorithms, road network graphs, and deployment pipelines. Requires 2+ years experience with C++, databases, RPC frameworks, and cloud providers.

145k – 219k/yr
On-site2+ YOEBackend Engineering
Snowflake

Software Engineer - Backend

SnowflakeMenlo Park, CA

Build backend services and distributed platforms at scale for Snowflake's Data Cloud, enabling secure data sharing. Requires 2-5 years experience, strong CS fundamentals, and fluency in Java, Python, C++, or SQL.

157k – 230k/yr
On-site2+ YOEBackend Engineering