Data Lakehouse Engineer

Natobotics; Województwo małopolskie; Hybrid; PLN 212,494 - 297,492; Full time

Job summary

A technology solutions company is seeking an AWS Data Lake Engineer to design, build, and maintain scalable data lake solutions. The ideal candidate should have strong experience in AWS data services, cloud architecture, and proficiency in Python and PySpark. Key responsibilities include optimizing data pipelines, managing Apache Iceberg tables, and developing CI/CD pipelines using Terraform. This role involves ensuring data quality, security, and orchestrating automated processes.

Qualifications

• Strong experience with AWS data services and cloud architecture.
• Proficiency in Python and PySpark.
• Hands-on experience with Apache Iceberg.
• Experience with CI/CD tools and Infrastructure as Code (Terraform).
• Knowledge of data quality, data security, and workflow orchestration.

Responsibilities

• Design and develop data lake solutions using AWS services.
• Build and optimize data pipelines using Python and PySpark.
• Implement and manage Apache Iceberg tables.
• Develop and maintain CI/CD pipelines using Terraform.
• Ensure data quality, security, and governance.
• Orchestrate workflows and automate data processing tasks.

Skills

AWS data services

Python

PySpark

Apache Iceberg

CI/CD tools

Terraform

Data quality

Data security

Workflow orchestration

Job description

Job Summary

We are seeking a skilled AWS Data Lake Engineer to design, build, and maintain scalable data lake solutions on AWS. The ideal candidate will have strong experience in cloud‑based data engineering, big data processing, and modern data architecture.

📍 Location: Nenagh/Dublin (Ireland)

📍 Location: Warsaw (Poland)

Key Responsibilities

• Design and develop data lake solutions using AWS services such as IAM, Lambda, EKS, S3, EMR, and MWAA
• Build and optimize data pipelines using Python and PySpark
• Implement and manage Apache Iceberg tables for efficient data storage and querying
• Develop and maintain CI/CD pipelines and infrastructure using Terraform
• Ensure data quality, security, and governance across the platform
• Orchestrate workflows and automate data processing tasks

Required Skills

• Strong experience with AWS data services and cloud architecture
• Proficiency in Python and PySpark
• Hands‑on experience with Apache Iceberg
• Experience with CI/CD tools and Infrastructure as Code (Terraform)
• Knowledge of data quality, data security, and workflow orchestration