Data Engineer - OESIS Framework
Build scalable data ingestion, normalization, storage, and orchestration pipelines for multi-tenant device compliance data from endpoint-management platforms. The role requires 3+ years of data engineering experience, strong SQL and Python, database expertise, and experience with APIs and pipeline orchestration.
About the job
Responsibilities
- Build scalable ingestion pipelines for large volumes of device and compliance data from Endpoint Device Management Platforms, including CrowdStrike, Intune, and JAMF.
- Support full bulk synchronization and incremental/delta synchronization.
- Design normalized compliance data schemas that map heterogeneous vendor models into a common internal representation.
- Build and tune relational, NoSQL, or warehouse storage for high-volume, multi-tenant compliance data and efficient downstream queries.
- Implement caching, deduplication, and delta-sync logic while respecting vendor rate limits and query quotas.
- Build ETL/ELT orchestration for scheduled and event-driven synchronization, with pipeline monitoring and failure alerting.
- Collaborate with Integration and Auth Engineers on API response handling and token expiration during queries.
Requirements
- 3+ years of data engineering experience, including ETL/ELT pipeline design, data modeling, and large-scale ingestion.
- Strong SQL skills and hands-on experience with relational databases such as Postgres or MySQL, plus NoSQL or columnar stores.
- Experience with orchestration tools such as Airflow, Dagster, or Prefect, and/or streaming platforms such as Kafka or Kinesis.
- Experience handling REST API pagination, bulk or batch queries, and rate-limited data collection at scale.
- Experience normalizing heterogeneous schemas from multiple external data sources into a unified model.
- Strong Python or equivalent programming experience for pipeline development.
- Understanding of multi-tenant data isolation and compliance requirements, including SOC 2 and GDPR.
Nice to Have
- Experience with security or compliance data, including device posture, PCI-DSS, SOX, HIPAA, vulnerability, or patch-management data.
- Experience with time-series or event-driven data models for compliance state changes.
- Familiarity with CrowdStrike, Intune, JAMF, or cloud-based device-management frameworks.
- Familiarity with Zero Trust Network Access and device posture or compliance.
Skills
Python, SQL, ETL, ELT, Postgres, MySQL, NoSQL, Airflow, Dagster, Prefect, Kafka, Kinesis, REST APIs, Data Modeling, Crowdstrike
Similar jobs
Data Engineering jobs
Vanta
Remote
Own the systems that ingest, standardize, validate, and operationalize data signals for Vanta’s EPD organization. The role suits a hands-on builder who has recently shipped working tools or pipelines, uses AI-assisted development, and helps teammates grow technically.
Alpaca
Remote
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
Thyme Care
Remote
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Vanta
Remote
Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.
Vanta
Remote
Senior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.