Data Engineer
Build and operate Databricks-based data products and pipelines that produce and distribute declared and modeled audience segments. The role requires strong Python, SQL, Spark, and distributed-processing expertise, plus experience with Databricks data engineering features and modern AI-assisted development.
About the job
Responsibilities
- Build and maintain Databricks tables, views, jobs, pipelines, and orchestration using Fluent’s data model and architecture standards.
- Build and operate pipelines that create and deliver syndicated and custom audience segments from survey-based and ML-driven methodologies.
- Support delivery and performance reporting for segments distributed through LiveRamp, TruAudience (TransUnion), and Lotame.
- Investigate real-time processing and operational workloads using Spark Structured Streaming and Lakeflow Declarative Pipelines.
- Maintain a high-quality codebase with testing, CI/CD, data observability, metadata standards, naming conventions, and compliant consumer-data handling.
- Apply AI-assisted development tools such as Claude Code to accelerate development, testing, and documentation.
- Translate business requests into functional engineering requirements in partnership with Data Engineering, Data Science, and commercial stakeholders.
- Share knowledge through brown bags and technical talks, and communicate architecture, execution plans, releases, and training.
Requirements
- Bachelor’s or master’s degree in computer science or a related field.
- 4+ years of industry experience in data engineering, including SQL, Python, Spark, and distributed processing.
- 2+ years of experience with Databricks data engineering and data warehousing features, including Jobs & Workflows, Notebooks, Unity Catalog, and Delta Lake.
- Strong foundation in database design, data structures, and algorithms.
- Experience using AI coding assistants such as Claude Code or GitHub Copilot.
Nice to Have
- Familiarity with Databricks technologies including Genie, Lakebase, AI/BI Dashboards, and Databricks Apps.
- Experience in digital marketing, ad tech, media, advertising, audience or identity data, consumer segmentation, or data marketplaces such as LiveRamp, TransUnion, and Lotame.
Compensation and Benefits
- Salary range: $80,000–$90,000 CAD base salary.
- Health, dental, and vision insurance.
- Pre-tax savings plans and transit/parking programs.
- 401(k) with competitive employer match.
- Career and professional growth opportunities.
- Educational, social, volunteer, and philanthropic activities.
Skills
Databricks, Python, SQL, Spark, Distributed Processing, Jobs & Workflows, Unity Catalog, Delta Lake, Spark Structured Streaming, Lakeflow Declarative Pipelines, CI/CD, Claude Code, Github Copilot, Data Observability, Database Design
Similar jobs
Data Engineering jobs
Instacart
Canada
Build and own trusted marketing analytics data models and pipelines supporting attribution, paid marketing, SEO, and retailer marketing. The role requires 3+ years of analytics or data engineering experience, strong SQL and dimensional modeling skills, and hands-on experience with dbt, Snowflake, and Airflow.
Vanta
Remote
Own the systems that ingest, standardize, validate, and operationalize data signals for Vanta’s EPD organization. The role suits a hands-on builder who has recently shipped working tools or pipelines, uses AI-assisted development, and helps teammates grow technically.
Cohere
New York, NY
Build production-grade data processing systems and performant datasets that support AI-driven customer experiences and company-wide analytics. The role requires 5+ years of data engineering experience, strong Python and SQL skills, and expertise with distributed processing frameworks and modern analytics tooling.
Twilio
Ontario, CanadaThe Senior Data and AI Specialist will build agentic AI solutions, automated Python workflows, and analytics products across telecommunications data. The role requires at least five years of experience with SQL, data automation, BI tools, LLM agents, and data governance.
Twilio
United StatesBuilds agentic AI, automated data workflows, and BI solutions for complex telecommunications datasets. The role requires 5+ years of technical data and automation experience, strong SQL and Python skills, and expertise in data governance and LLM-based tools.