Engineering Manager
Lead a globally distributed team of 10-11 engineers responsible for DataHub's Ingestion platform and 100+ connectors. Own architecture for high-scale metadata ingestion, AI agents for onboarding/troubleshooting, platform reliability, and cross-functional strategy in a fast-growing open-source data/AI company.
About the job
What you’ll own
Platform Architecture: Lead the evolution of our ingestion framework to handle high-throughput ingestion of structured and unstructured metadata at enterprise scale. Evolve the Remote Executor platform that lets ingestion run securely in customer environments.
AI-driven time-to-Value: Spearhead the development of intelligent, agent-based solutions. Onboarding agents that speed up new customer ramp, and troubleshooting agents that enable self-service resolution of integration failures.
Cross team Partnership: Work with Product to set the strategy, and with Customer Support, Customer Success and Sales to resolve customer issues and improve stability.
Platform health: Drive down technical debt and invest in developer productivity and long-term reliability.
What success looks like
- Expanded Reach: A broader, deeper connector ecosystem, built through internal engineering plus community and third-party contributions.
- Reliability: Fewer failures and faster resolution through proactive investment in platform stability.
- Execution velocity: Strong delivery without sacrificing team health or morale.
What we’re looking for
- Proven experience leading engineering teams in data infrastructure, platform, ingestion, or integration-heavy environments.
- Strong technical depth in distributed systems, cloud infrastructure, and scalable backend architecture.
- Experience managing globally distributed teams across time zones.
- Ability to work closely with founders, product, and cross-functional leaders.
- Comfort balancing strategy, execution, customer issues, and team development.
- Strong judgment, communication, and ownership.
Bonus if you have
- Experience with connectors, integrations, ETL, or metadata systems.
- Background building or scaling developer platforms, SDKs, or remote execution infrastructure.
- Experience at a fast-growing startup or high-scale data platform company.
- Familiarity with Python-based ingestion systems and cloud-native execution.
Skills
Distributed Systems, Cloud Infrastructure, Backend Architecture, Python, ETL, Metadata Systems, Integrations, Connectors
Similar jobs
Engineering Management jobs
OpenAI
San Francisco, CA
Leads the engineering team responsible for ChatGPT Search Infrastructure, setting technical direction for scalable, low-latency search platforms and integrations. Requires experience managing senior engineers and deep expertise in distributed systems, online serving, experimentation, and AI-powered products.
Applied Intuition
Ann Arbor, MI
Leads and mentors a software engineering team building reliable, high-performance simulation products, while guiding technical execution, prioritization, and hiring. Requires a bachelor’s degree, programming experience in C++, Python, or Java, people-management experience, and eligibility for a US Government security clearance.
Scale AI
Washington, DC
Leads and codes alongside a team building secure, cloud-native AI model inference infrastructure for public-sector customers. Requires engineering people-management experience, strong hands-on software development skills, and an active Secret clearance with eligibility for TS/SCI.
Genius AI
New York, NYLeads a platform engineering team responsible for shared systems, identity, permissions, session management, and messaging infrastructure. The manager owns delivery and architecture, develops engineers, embeds AI into development workflows, and partners closely with Product and Design.
Permitflow
New York, NY
Leads and grows an engineering team building new products from initial market hypothesis through commercial launch. The role requires at least five years of software engineering experience, engineering leadership, strong architecture judgment, and comfort operating in ambiguous 0-to-1 environments.