# Senior Backend Engineer - AI Agents

**Company:** [Level AI](https://hotfix.jobs/companies/level-ai)
**Location:** Noida, India, Bengaluru, India
**Role:** Backend Engineering
**Experience:** 5+ years
**Skills:** Python, Rest, gRPC, Microservices, SQL, NoSQL, Docker, Kubernetes, AWS, GCP, Azure, Distributed Systems, LLMs, RAG, Vector Databases
**Posted:** 2024-11-10

> Builds scalable, low-latency backend systems and orchestration frameworks for production AI agents in real-time enterprise environments. Requires 5+ years of backend, distributed systems, or platform engineering experience, with strong API, cloud, and microservices expertise.

## Job Description

## Responsibilities
- Design and build scalable backend systems powering real-time AI Agents in enterprise environments.
- Develop agent orchestration frameworks for multi-step reasoning, tool usage, and decisioning workflows.
- Build systems for agent memory, context management, and state persistence across interactions.
- Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools and services.
- Implement evaluation frameworks to measure agent performance, accuracy, and reliability.
- Enable continuous improvement loops from feedback through retraining and deployment.
- Design and manage event-driven, asynchronous workflows for complex agent tasks.
- Optimize systems for high throughput, low latency, and cost-efficient inference at scale.
- Build and maintain REST and gRPC APIs and service layers for agent capabilities.
- Partner with Applied AI and ML teams to productionize models and agent behaviors.
- Collaborate with Product and Solutions teams to translate customer workflows into agentic systems.
- Drive best practices in observability, monitoring, safety, and guardrails for AI systems.
- Contribute to architecture decisions for scaling multi-tenant, enterprise-grade AI platforms.

## Requirements
- 5+ years of experience in backend engineering, distributed systems, or platform engineering.
- Strong experience building high-scale, production-grade backend systems.
- Experience designing systems for real-time processing, streaming, or event-driven architectures.
- Strong understanding of API design, including REST and gRPC, and microservices architectures.
- Experience with SQL and NoSQL databases and data modeling for high-scale systems.
- Hands-on experience with Docker, Kubernetes, and cloud platforms such as AWS, Google Cloud, or Azure.
- Strong fundamentals in system design, concurrency, and performance optimization.

## Nice-to-Haves
- Experience working with LLMs, conversational AI, or AI-powered products in production.
- Familiarity with agent frameworks, tool calling, or multi-step reasoning systems.
- Experience building or integrating RAG pipelines, vector databases, or retrieval systems.
- Exposure to offline or online evaluation systems and A/B testing for AI systems.
- Understanding of prompting strategies, context windows, and model behavior optimization.
- Experience with real-time decisioning systems or workflow orchestration engines.

## Similar jobs

- [Senior Software Engineer](https://hotfix.jobs/jobs/f3dc0a4c-161f-41e3-8f0f-7f6f1bed0ae0) - ZoomInfo - Bengaluru, India
- [Senior Software Engineer](https://hotfix.jobs/jobs/424fec72-c653-4cf7-b981-4ab7dd3a98ff) - CommandLink - Remote
- [Senior Software Engineer](https://hotfix.jobs/jobs/b53f9259-9cbf-43e5-af97-1c6801417742) - Navan - Bengaluru, India
- [Senior Software Engineer, Backend (Money Movement)](https://hotfix.jobs/jobs/8afb425b-fe94-4b6b-8b26-f8dde0de4f58) - Phantom - Remote
- [Senior Software Engineer - Tax Payments](https://hotfix.jobs/jobs/6ad915bc-1d3e-467f-a4ee-9103658c634e) - Rippling - Bengaluru, India

**Apply:** https://hotfix.jobs/jobs/3f39a739-7d1c-4daf-9a04-c4b7409fb7dd
**Canonical:** https://hotfix.jobs/jobs/3f39a739-7d1c-4daf-9a04-c4b7409fb7dd