Principal Software Engineer II - Metadata
Designs, develops, and supports fault-tolerant scalable distributed metadata systems at petabyte scale. Requires 15+ years experience in large-scale services, deep database internals expertise, strong CS fundamentals, and Java fluency.
About the job
Responsibilities
- Solve real business needs at large scale by applying software engineering and analytical problem solving skills.
- Design, develop and support fault-tolerant scalable distributed systems for Metadata.
- Create and own architecture and design, influence our product roadmap, and identify new projects.
- Analyze fault-tolerance and high availability issues, performance and scale challenges, and solve them.
- Mentor and grow junior engineers.
- Understand trade-offs between consistency, performance and costs to build solutions which can meet the demands of rapidly growing services.
- Ensure operational readiness of the services and meet the commitments to our customers regarding durability, availability and performance.
Requirements
- 15+ years of industry experience designing, building and supporting large scale distributed services.
- Deep and broad expertise in a variety of database systems internals including metadata management, clustering, compaction, catalogs, storage and replication.
- Strong computer science fundamentals including data structures, algorithms, and distributed systems.
- Excellent understanding of systems infrastructure product development and concepts including multi-threading, memory management, networking and storage, performance, reliability and scalability.
- Fluency in Java or other similar procedural object-oriented language is preferred.
- Track record of identifying and implementing creative solutions to complex problems at the cloud scale.
- Ability to work effectively across engineering teams in multiple locations.
- BS in Computer Science; Advanced degree preferred.
Skills
Java, Distributed Systems, Data Structures, Algorithms, Multi-Threading, Memory Management, Networking, Storage Systems, Metadata Management, Database Internals
Similar jobs
Fullstack Engineering jobs
Vitalize
San Francisco, CA
Principal Engineer owning the decision engine that powers explainable staffing recommendations and hospital operations automation. The role requires deep TypeScript expertise, full-stack experience, strong systems thinking, and comfort working directly with clinical customers.
OpenAI
San Francisco, CA
Build and lead the technical direction of full-stack, AI-powered enterprise workflows, spanning user surfaces, backend services, integrations, permissions, and evaluations. Requires 10+ years of production software experience, strong product judgment, and hands-on expertise across distributed systems and enterprise integrations.
Rad AI
San Francisco, CA
Leads the technical vision and architecture for Rad AI’s reporting product, partnering with executive leadership to deliver scalable, high-impact systems. The role requires principal-level technical leadership, expertise in software architecture, and experience delivering complex systems with significant business impact.
Anthropic
San Francisco, CAStaff-level full-stack engineer building feedback interfaces, backend services, and data pipelines that supply reinforcement-learning training data. The role requires production TypeScript/React and Python experience, strong project ownership, and collaboration with RL researchers.
Anthropic
San Francisco, CABuild and own Anthropic’s AI-native education platform, including backend infrastructure, adaptive learning systems, credentialing, integrations, and enterprise readiness. The role requires strong full-stack skills with backend depth and at least seven years of software engineering experience.