Big Data Engineer IV
Builds and owns large-scale data processing systems and pipelines for an advertising platform handling billions of requests and over 1 PB of daily data. Requires extensive Java or Scala experience, Big Data expertise, cloud and warehouse proficiency, and a bachelor's degree.
About the job
Responsibilities
- Design large-scale data processing systems.
- Work with Product to drive requirements and own projects end-to-end.
- Analyze and improve application efficiency, scalability, and stability.
- Architect, create, and deliver features for an enterprise data platform handling billions of ad requests daily and more than 1 PB of data daily.
- Identify unnecessary complexity and remove it.
- Develop scalable, modular applications in an Agile/Scrum environment.
Requirements
- 8+ years of experience with Java or Scala development; Python is a plus.
- 3+ years of experience developing Big Data systems.
- Experience building complex data pipelines, including SQL-based transformations with dbt or Dataform.
- Experience with large-scale distributed processing frameworks such as Apache Spark.
- Expertise with BigQuery or other data warehouses, including performance tuning and monitoring.
- Familiarity with Airflow, including extending it with new data pipelines and troubleshooting operational issues.
- Cloud experience with Google Cloud Platform or AWS, Kubernetes, and Docker.
- Understanding of CI/CD, automated testing, monitoring, and DevOps practices.
- Strong knowledge of algorithms, data structures, and platforms.
- Experience with database system design, relational databases, and/or NoSQL.
- Bachelor's degree in computer science, physics, or a related field; a master's degree is a plus.
- Fluency in Polish and English.
- Good written and oral communication skills.
- Experience working in digital media, marketing technology, or advertising technology is a plus.
- Ability to independently identify and act on areas for improvement.
Compensation and Benefits
- Employment contract: 23,375–26,125 PLN gross per month.
- B2B contract: 186–208 PLN net per hour.
- Annual performance bonus.
- Tax-deductible system through copyright protection: 75%.
- Private health care for employees and families.
- Private life and travel insurance.
- MultiKafeteria program.
- LinkedIn Learning access and technical workshops.
- Holiday allowance.
- Pension scheme through PZU.
- Additional paid day off.
- Free parking.
- Peer-to-peer recognition platform.
- Monthly work-from-home allowance and a one-time home-office setup payment.
- Support for personal milestone celebrations.
Skills
Java, Scala, Python, Spark, SQL, dbt, Dataform, BigQuery, Airflow, GCP, AWS, Kubernetes, Docker, CI/CD, NoSQL
Similar jobs
Data Engineering jobsSenior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
Own the systems that ingest, standardize, validate, and operationalize data signals for Vanta’s EPD organization. The role suits a hands-on builder who has recently shipped working tools or pipelines, uses AI-assisted development, and helps teammates grow technically.