Senior Software Engineer - Data + AI Observability
Leads development of customer-facing observability products and scalable data infrastructure for AI and data workloads. The role requires 6+ years of production software engineering experience, cloud and distributed-systems expertise, platform development skills, and strong cross-functional leadership.
About the job
Responsibilities
- Develop systems that provide customers with a reliable, timely interface for observing their Databricks environments.
- Enable framework teams to publish data to customers.
- Lead major milestones on the observability roadmap and contribute to long-term product vision and requirements.
- Lead technical development from requirements refinement through execution, operation, and iteration with product and partner teams.
- Mentor engineers in product contributions and career growth.
- Optimize the scalability and cost of large data pipelines to reduce customer costs and create new product opportunities.
- Drive integration with tools and services in the broader data warehousing ecosystem.
Requirements
- 6+ years of production-level experience with Java, Scala, Python, C++, or a similar language.
- Experience with cloud technologies such as AWS, Azure, GCP, Docker, and Kubernetes.
- Experience architecting, developing, deploying, and operating components of large-scale distributed systems.
- Strong software engineering maturity, including security, correctness, engineering excellence, and operational excellence.
- A platform mindset, including building platforms for other software teams and reducing adoption friction.
- Strong cross-functional collaboration skills for working with internal and external platform customers.
Benefits
- Comprehensive benefits and perks are offered, with region-specific details available from Databricks.
Skills
Java, Scala, Python, C++, AWS, Azure, GCP, Docker, Kubernetes, Distributed Systems, Data Pipelines, Observability, DevOps, Finops, Aiops
Similar jobs
Backend Engineering jobs
ZoomInfo
Bengaluru, India
Leads the architecture and scaling of distributed backend systems for AI-powered talent search, matching, and agentic workflows. Requires 7+ years of backend experience, strong cloud and data expertise, and proficiency in a modern object-oriented language.
CommandLink
United StatesSenior individual contributor responsible for designing, building, operating, and improving large-scale backend services, APIs, and telemetry pipelines in Go and Python. The role requires production systems ownership, distributed-systems expertise, incident leadership, mentoring, and technical design leadership.
Navan
Bengaluru, India
Senior backend software engineer building and scaling Java and Spring Boot services for a global expense management platform. The role requires 4–6 years of experience with distributed systems, cloud platforms, production ownership, and AI-driven development.
Phantom
Remote
Senior backend engineer designing scalable services and APIs that connect Phantom Cash to blockchain networks. The role requires Node.js/NestJS, REST API, event-driven, and distributed-systems expertise, with blockchain or fintech experience preferred.
Rippling
Bengaluru, India
Senior software engineer responsible for designing reliable, distributed tax remittance systems operating globally across currencies, agencies, and compliance requirements. Requires 6+ years of programming experience and strong backend architecture and distributed-systems expertise, with Python, Django, React, MongoDB, and AWS preferred.