Data Engineer (Airflow / Snowflake)

emagine; Polska; Remote; PLN 182,000 - 259,000; Full time

Job summary

emagine is seeking a skilled Data Engineer specializing in Apache Airflow and Snowflake. The ideal candidate will design, build, and maintain data pipelines with a focus on performance optimization and data quality.

Proficiency in Python, SQL, and cloud storage solutions is essential. Responsibilities include creating Airflow DAGs loading data into Snowflake and S3, building pipelines from APIs/databases/files, modeling with dbt, and tuning SQL for cost efficiency.

Qualifications

• 3+ years of experience as a Data Engineer.
• Strong Apache Airflow knowledge: operators, sensors, TaskFlow, XCom, pools, backfills, idempotent DAGs.
• Strong Python skills with clean, testable code and pytest.
• Advanced SQL knowledge including window functions, CTEs, and optimization.
• Snowflake experience with warehouses, stages, external volumes, COPY INTO.
• dbt models, tests, macros, snapshots, and incremental models.
• AWS S3 data lake organization, partitioning, formats (Parquet, JSON, CSV), and IAM.
• Git and CI/CD experience.
• English at B2 level or higher.
• Nice to have: Docker, Kubernetes, Open table formats (Iceberg/Delta Lake), data quality/observability tools like Great Expectations or Soda, Dimensional modeling (Kimball).

Responsibilities

• Design, build, and maintain Apache Airflow DAGs in Python that load data into the Data Lake (S3) and Snowflake.
• Build pipelines that ingest data from APIs, databases, and files.
• Model and transform data with dbt.
• Tune SQL queries and Snowflake performance and cost.
• Set up monitoring, alerting, and error handling for pipelines.
• Protect data quality through testing and validation, and keep documentation current.

Skills

Data engineering

Airflow

Python

SQL

English

Tools

Snowflake

dbt

AWS S3

Git

CI/CD

Job description

Industry

IT

Rate

up to 160 pln/h net + VAT, B2B

Location

100% remote

About role:

We are seeking a skilled and experienced Data Engineer specializing in Apache Airflow and Snowflake. The ideal candidate will have a strong background in designing and maintaining data pipelines, with a focus on performance optimization and data quality. Essential skills include proficiency in Python and SQL, alongside hands-on experience with data modeling and cloud data storage solutions.

Main Responsibilities:

• Design, build, and maintain Apache Airflow DAGs in Python that load data into the Data Lake (S3) and Snowflake.
• Build pipelines that ingest data from APIs, databases, and files.
• Model and transform data with dbt.
• Tune SQL queries and Snowflake performance and cost.
• Set up monitoring, alerting, and error handling for pipelines.
• Protect data quality through testing and validation, and keep documentation current.

Key Requirements:

• 3+ years of experience as a Data Engineer.
• Apache Airflow: strong knowledge of operators, sensors, hooks, TaskFlow API, XCom, pools, backfills, and idempotent DAG design.
• Python: strong skills, with clean, testable code and pytest.
• SQL: advanced level, including window functions, CTEs, and query optimization.
• Snowflake: hands-on experience with warehouses, stages, external volumes, COPY INTO.
• dbt: models, tests, macros, snapshots, and incremental models.
• AWS S3: Data Lake organization, partitioning, file formats (Parquet, JSON, CSV), and IAM policies.
• Git and CI/CD experience.
• English at B2 level or higher.

Nice to Have

• Docker and Kubernetes.
• Open table formats: Apache Iceberg or Delta Lake.
• Data quality and observability tools such as Great Expectations or Soda.
• Dimensional modeling (Kimball).