Data Engineer
Build and optimize scalable data infrastructure and ETL/ELT pipelines supporting a Search API. The role requires 3+ years of data engineering experience, Python, SQL and NoSQL expertise, AWS experience, and a quantitative bachelor's degree.
About the job
Responsibilities
- Design, build, and maintain efficient and reliable ETL/ELT pipelines for data warehousing.
- Develop and improve data infrastructure.
- Ensure data quality, integrity, and security across data platforms.
- Optimize data systems for performance and scalability.
- Troubleshoot and resolve data pipeline and data infrastructure issues.
- Collaborate with cross-functional teams to understand data needs and deliver solutions.
Requirements
- Bachelor's degree in Computer Science, Statistics, Engineering, or a related quantitative field.
- 3+ years of professional experience as a Data Engineer or in a similar data infrastructure role.
- Proficiency in Python.
- Solid experience with relational databases and SQL, as well as NoSQL databases.
- Experience with AWS and its data services.
- Experience building and optimizing data pipelines and data architectures.
Nice-to-haves
- Experience with MongoDB, Snowflake, Redis, Amazon S3 General Purpose, or Amazon S3 Express One Zone.
- Experience with big data technologies.
- Experience with Airflow.
- Familiarity with containerization and orchestration tools such as Docker and Kubernetes.
- Experience at a company focused on API services or search technology.
- Knowledge of data governance and data security best practices.
Skills
Python, SQL, NoSQL, AWS, ETL, ELT, Data Warehousing, MongoDB, Snowflake, Redis, Amazon S3, Airflow, Docker, Kubernetes, Big Data
Similar jobs
Data Engineering jobsOwn the systems that ingest, standardize, validate, and operationalize data signals for Vanta’s EPD organization. The role suits a hands-on builder who has recently shipped working tools or pipelines, uses AI-assisted development, and helps teammates grow technically.
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.
Senior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.