Remote AWS Lakehouse Data Engineer for AI/ML Pipelines

Delan Associates, Inc; United States; Remote; USD 140,000 - 180,000; Full time

Job summary

Delan Associates, Inc. is seeking an AWS Lakehouse Data Engineer to design, build, and operate a cloud-native data platform on AWS that powers AI/ML, analytics, reporting, and visualization.

You will implement a lakehouse on S3 with Iceberg and open formats, enabling scalable data pipelines and governance. The role emphasizes automation, CI/CD, cost efficiency, and secure data handling, with remote work options and collaboration across data, analytics, security, and cloud teams.

Qualifications

• Bachelor's degree in Engineering, IT, CS, Data Engineering, or related field, or 4 years of equivalent practical experience.
• Minimum 6 years of relevant experience.
• Strong experience implementing AWS-native data lake/lakehouse architectures using S3 and AWS services.

Responsibilities

• Build and operate batch and streaming data pipelines from APIs, databases, files, and streams.
• Develop ETL/ELT pipelines in Python and PySpark for analytics-ready datasets.
• Implement CDC, data contracts, schema validation, and reusable transformation frameworks.
• Improve reliability with automated tests, orchestration, monitoring, and runbooks.
• Deliver an AWS-native lakehouse on S3 using Apache Iceberg and open formats.

Skills

Python

PySpark

ETL/ELT

SQL

Apache Iceberg

AWS services

Data governance

CI/CD

Education

Bachelor's degree or equivalent

4 years practical experience

Tools

AWS Glue

Amazon Athena

Amazon EMR

AWS Lake Formation

Amazon Redshift

Job description

Delan Associates, Inc. is seeking an AWS Lakehouse Data Engineer to design, build, and operate a cloud-native data platform on AWS that powers AI/ML, analytics, reporting, and visualization.

You will implement a lakehouse on S3 with Iceberg and open formats, enabling scalable data pipelines and governance. The role emphasizes automation, CI/CD, cost efficiency, and secure data handling, with remote work options and collaboration across data, analytics, security, and cloud teams.