Skip to content

Software Engineer, Backend

Builds scalable backend infrastructure for AI-powered research tools, focusing on RAG pipelines, LLMs, agent architectures, prompt engineering, and performance optimization. Requires hands-on experience scaling products and working in fast-paced startups.

150k – 200kSan Francisco, CABackend EngineeringOnsiteEntry level

About the role

Responsibilities

  • Designing and building scalable infrastructure for AI-powered research tools.
  • Collaborating closely with the engineering team on our RAG pipeline, continuously improving response quality, latency and robustness.
  • Establishing best practices for prompt engineering and deployment of new models and workflows.
  • Monitoring and optimizing system performance and costs, making pragmatic tradeoffs to keep us lean and moving fast.
  • Owning the design and automation of eval pipelines to continuously measure, benchmark and improve AI agent quality and reliability.

Requirements

  • Quick, scrappy and first and foremost a builder.
  • Blend excellent engineering with a taste for models and design.
  • Worked on back end agent behaviors and have hands-on experience with LLMs, RAG, and agent architectures.
  • Have independently built and scaled a product to at least a few thousand users (e.g. a side project or open-source project).
  • Have worked in a high-growth, fast-paced environment (ideally another startup) and can drive things forward with relatively little oversight.

Compensation

  • $150K - $200K
  • 0.50% - 1.00% equity

Skills

LLMsRAGAgent ArchitecturesPrompt EngineeringKubernetesPythonScalable InfrastructureEval PipelinesMonitoringAi Pipelines

Software Engineer, AI Team

Build and maintain backend systems and AI inference pipelines that process large-scale user feedback into actionable product insights. Requires 2+ years of production software experience and willingness to work primarily in TypeScript.

150k – 230kSan Francisco, CABackend EngineeringHybrid2+ YOEAWSSQL

Software Engineer II, Segment Personalization

Builds and improves backend personalization systems handling billions of events for AI-driven customer experiences, owning features in product catalog, segmentation, and data ingestion. Requires 2-4 years backend experience with distributed systems and databases.

150k – 190kNew York, NY +1Backend EngineeringRemote2+ YOEAI ToolsAlgorithms

Software Engineer

Backend-focused Software Engineer building scalable Java microservices on GCP for a consumer fintech platform. Requires 2+ years experience, JVM backend skills, and a CS or related degree.

150k – 200kNew York, NYBackend EngineeringOn-site2+ YOEJvmGCP

Software Engineer II

Software Engineer II builds, optimizes, and maintains AI-powered software systems analyzing medical records, focusing on distributed event-driven architectures in healthcare. Requires 2+ years experience, HIPAA familiarity, and generalist mindset in AWS/Kubernetes environment.

150k – 170kNew York, NYBackend EngineeringHybrid2+ YOEAIAWS

Software Engineer II, Backend

Build and scale backend systems for credit decisioning, risk management, and financial infrastructure at Brex. Requires 2+ years backend experience and 1+ year in fintech or regulated industries.

152k – 190kSeattle, WABackend EngineeringHybrid2+ YOEJavaKafka