Remote Senior Data Engineer — Spark, APIs & Data Pipelines

Provectus IT, Inc.; Remote; PLN 120,000 - 180,000; Full time

Job summary

A leading AI consultancy is looking for a talented Data Engineer to join their dynamic team. This position involves collaborating with clients to understand their data needs and constructing robust data pipelines using technologies like Python, Spark, and AWS. The role is remote with flexible working hours. Ideal candidates should have a strong background in data engineering and be equipped to handle both real-time and batch data flows. A comprehensive private medical insurance plan and a range of benefits are offered.

Benefits

Comprehensive private medical insurance

Paid sick leave and vacations

Flexibility in work hours

Career development programs

Qualifications

• Experience with real-time and batch data flow management.
• Proficient in using AWS and related technologies.
• Upper-Intermediate English skills required.

Responsibilities

• Collaborate with clients to understand their IT environments.
• Manage large volumes of varied data sets.
• Work with ML Engineers to create resilient data pipelines.
• Design and maintain ETL/ELT data pipelines.

Skills

Data Engineering

Machine Learning

Python

SQL

AWS

Spark

Apache Kafka

ETL

Infrastructure as Code

Tools

Airflow

dbt

Terraform

AWS CloudFormation

Job description

A leading AI consultancy is looking for a talented Data Engineer to join their dynamic team. This position involves collaborating with clients to understand their data needs and constructing robust data pipelines using technologies like Python, Spark, and AWS. The role is remote with flexible working hours. Ideal candidates should have a strong background in data engineering and be equipped to handle both real-time and batch data flows. A comprehensive private medical insurance plan and a range of benefits are offered.