Senior Big Data Engineer — Remote, Cloud & Pipelines

Visa Hunt; Poland; On-site; PLN 261,000 - 292,000; Full time

Benefits offered by this job

Annual performance bonus

Private health care for you and your家

Pension scheme

Job summary

OpenX is seeking a senior data platform engineer to design and deliver large-scale data processing systems for a high-scale ad marketplace. You will work with distributed teams to architect and implement data pipelines, ensuring performance, scalability and reliability across billions of ad requests daily.

You will partner with Product to drive requirements, own the project end-to-end, and continuously improve data workflows using Spark, Airflow and modern cloud data stacks.

Qualifications

• 8+ years experience in Java, Scala or Python development
• 3+ years of experience in Big Data systems development
• Experience building complex data pipelines using SQL-based transformations (dbt/Dataform) and Spark
• Expertise with BigQuery or other data warehouses with performance tuning
• Knowledge of Airflow for data pipelines
• Cloud experience with GCP or AWS, Kubernetes and Docker
• Understanding of CI/CD, automated testing, monitoring and DevOps practices
• Fluency in algorithms, data structures and platforms
• Experience with RDBMS and NoSQL databases
• Bachelor’s degree in relevant field; Master’s preferred
• Communicative Polish and English

Responsibilities

• Design large-scale data processing systems
• Own end-to-end project requirements with Product
• Analyze and improve efficiency, scalability and stability of applications
• Eliminate unnecessary complexity and bottlenecks
• Collaborate with distributed teams to deliver features and improvements

Skills

Java

Scala

Python

Big Data

SQL

dbt

Dataform

Apache Spark

Airflow

GCP

AWS

Kubernetes

Docker

CI/CD

Polish

English

Education

Bachelor's degree in computer science, physics, or related field

Master's degree

Tools

dbt

Dataform

Airflow

BigQuery

GCP

AWS

Kubernetes

Docker

Job description

OpenX is seeking a senior data platform engineer to design and deliver large-scale data processing systems for a high-scale ad marketplace. You will work with distributed teams to architect and implement data pipelines, ensuring performance, scalability and reliability across billions of ad requests daily.

You will partner with Product to drive requirements, own the project end-to-end, and continuously improve data workflows using Spark, Airflow and modern cloud data stacks.