Remote Senior Data Engineer: Scale Big Data & AI Pipelines

Varwise; Remote; PLN 100,000 - 130,000; Full time

Job summary

A leading Adtech company is seeking a Remote Senior Data Engineer to manage and scale data processing systems and maintain a complex data lake. Candidates should have 8+ years of software engineering experience, particularly in big data and Scala-based systems. This role emphasizes building reliable data pipelines and optimizing large-scale data solutions. The ideal applicant has strong knowledge of AWS, Spark, and experience with both SQL and NoSQL databases. This is a fully remote position open to candidates worldwide.

Qualifications

• 8+ years of professional software engineering experience, focusing on data engineering in big data environments.
• 4+ years developing and delivering Scala-based systems, familiarity with Python, and at least one other language.
• Proficiency using Spark (PySpark) or TensorFlow.
• Hands-on experience developing data solutions on a major cloud platform.

Responsibilities

• Create and maintain scalable distributed data processing systems.
• Become a core maintainer of the data lake.
• Ensure data pipelines run 24/7.
• Lead technical discussions to improve tools or projects.

Skills

Data engineering

Big data environments

Distributed systems

Scala

Python

Machine Learning

AWS

Spark

Database management

ETL processes

Education

Bachelor’s degree in Computer Science or related discipline

Tools

AWS

Spark (PySpark)

Databricks

Kubeflow

SageMaker

PostgreSQL

Cassandra

Job description

A leading Adtech company is seeking a Remote Senior Data Engineer to manage and scale data processing systems and maintain a complex data lake. Candidates should have 8+ years of software engineering experience, particularly in big data and Scala-based systems. This role emphasizes building reliable data pipelines and optimizing large-scale data solutions. The ideal applicant has strong knowledge of AWS, Spark, and experience with both SQL and NoSQL databases. This is a fully remote position open to candidates worldwide.