Senior Software Engineer - Build
Build AI-powered data products and the context layer behind search, retrieval, and code generation. The role requires 5+ years of software engineering experience with Python or Go and involves applied AI, information retrieval, and cross-functional product development.
About the job
Responsibilities
- Design and build intelligent systems for AI-driven data engineering, including data modeling, semantic search, retrieval, and code generation.
- Develop components for Astronomer’s global data context layer.
- Experiment with LLMs, embeddings, vector databases, and advanced retrieval techniques to create developer tools.
- Translate applied research and early AI concepts into product experiences in collaboration with R&D and product teams.
- Solve information retrieval and search challenges at global scale.
- Influence technical vision and architecture for AI-driven data products.
- Contribute to open-source projects and represent Astronomer through technical talks and publications.
Requirements
- 5–8 years of software engineering experience with Python or Go.
- Empathy for users and interest in improving data professionals’ workflows.
- Familiarity with early-stage product development and comfort working amid ambiguity.
- Experience with LLMs, vector databases, embeddings, or other applied AI areas, or strong interest in developing these skills.
- Creative, experimental mindset and ability to validate hypotheses through iteration.
- Strong collaboration and communication skills, including the ability to explain complex systems to technical and non-technical audiences.
- Ability to work effectively in a fast-moving, research-driven environment.
Nice to Have
- Experience with AI systems for data, developer tools, or machine learning infrastructure.
- Familiarity with Apache Airflow or other orchestration tools.
- Contributions to open-source projects.
- Experience in search, information retrieval, or large-scale data infrastructure.
- Experience in early-stage startups or R&D organizations.
- Experience building agentic systems on frontier models.
Compensation
- Estimated total compensation: $210,000–$250,000, depending on leveling and geography.
- Equity component and comprehensive benefits package.
Skills
Python, Go, LLMs, Vector Databases, Embeddings, Information Retrieval, Semantic Search, Apache Airflow, Data Infrastructure, Agentic Systems
Similar jobs
Fullstack Engineering jobs
Valon
New York, NYBuild scalable software and infrastructure for a complex, regulated mortgage-servicing platform. The role requires 4+ years of software engineering experience, strong cross-functional communication, and experience with scalable applications or distributed systems.
Liftoff
United States
Build end-to-end generative AI products for Liftoff’s demand-side advertising business, including agentic workflows, reliable production systems, and customer-facing interfaces. The role requires a bachelor’s degree, 8 years of relevant experience, and strong Python skills with TypeScript and React experience.
Notion
San Francisco, CABuild and scale Notion’s developer platform, including APIs, MCP tools, and integration infrastructure that connect external apps, data, and workflows. The role requires 7+ years of production software experience and strong TypeScript fluency across backend and frontend systems.
Formation Bio
New York, NYSenior individual contributor owning a major part of a clinical-trial execution platform, including regulated software, clinical-system integrations, and AI-native workflows. Requires 7+ years building production software, clinical-trial experience, cloud and distributed-systems expertise, and familiarity with validated delivery.
Watershed
New York, NY
Build full-stack software that turns climate and carbon data into actionable intelligence for financial institution customers. The role requires 6+ years of software engineering experience, scalable product development skills, and preferably Node.js or data-pipeline experience.