Remote Data Architect: ETL, Spark & Cloud Data Pipelines

Pivotal Solutions; Poland; Remote; PLN 180,000 - 240,000; Full time

Job summary

Pivotal Solutions is seeking an experienced ETL Developer for a remote position. You will architect and implement robust ETL pipelines using Spark, Airflow, and AWS Glue, aligning with client specifications while ensuring data quality and automation.

Responsibilities include analyzing data to determine pre-processing steps, leveraging SQL across MS SQL Server and Redshift, and applying cloud infrastructure skills in AWS/Azure/GCP. Strong communication and ownership are essential.

Qualifications

• Bachelor’s degree in computer science, information technology, or a related field.

Responsibilities

• Strong verbal/written communication & facilitation skills. Ability to take a requirement document, work through any ambiguity and follow through to implementation independently.
• Strong analytical and problem-solving abilities.
• Strong work ethic, sense of ownership and a team player.
• Architect and design robust ETL processes using tools like Spark, Airflow, AWS Glue etc. to desired client specifications.
• Ability to analyze the data to identify the necessary pre-processing steps for the automated ETL processes.
• Solid understanding of SQL using databases like MS SQL Server, Redshift, etc.
• Experience in Cloud Infrastructure (AWS, Azure, GCP).
• Delivering the data pipeline with Quality and automated testing.

Skills

Communication

Analytical thinking

Problem solving

Ownership

Team player

SQL

Data analysis

Education

Bachelor’s degree in computer science / information technology

Tools

Spark

Airflow

AWS Glue

Databricks

Job description

Pivotal Solutions is seeking an experienced ETL Developer for a remote position. You will architect and implement robust ETL pipelines using Spark, Airflow, and AWS Glue, aligning with client specifications while ensuring data quality and automation.

Responsibilities include analyzing data to determine pre-processing steps, leveraging SQL across MS SQL Server and Redshift, and applying cloud infrastructure skills in AWS/Azure/GCP. Strong communication and ownership are essential.