AWS Lakehouse Data Engineer for AI/ML Analytics

Dovel Technologies, Inc; Northern (KY); Hybrid; USD 113,000 - 188,000; Full time

Benefits offered by this job

Medical Insurance

401(k) Retirement Plan

Tuition Reimbursement

Employee Referral Program

Flexible Benefits

Job summary

Guidehouse is seeking an AWS Lakehouse Data Engineer to design, implement, and operate a cloud-native data platform powering AI/ML, analytics, reporting, and visualization on AWS.

You will build a Delta Lakehouse on Amazon S3 using Apache Iceberg and open formats, implement batch and streaming ETL in Python/PySpark, enforce governance and security, and drive CI/CD across environments.

Qualifications

• Hands-on experience designing and operating AWS-native lakehouse architectures on S3.
• Experience with data lake governance, metadata management, and security.

Responsibilities

• Build and Operate Data Pipelines (Batch and Streaming) using Python and PySpark.
• Design and implement a Delta Lakehouse Data Platform on S3 with Iceberg and open formats.
• Implement data governance, metadata management, and access controls across environments.
• Automate AWS provisioning with IaC and enhance CI/CD for data pipelines.
• Collaborate with data, analytics, security, and cloud teams; maintain architecture docs and runbooks.

Skills

Python

PySpark

AWS

Data Engineering

Delta Lake

ETL/ELT

SQL

Governance

Education

Bachelor's degree in Computer Science, Engineering, or related field

8+ years practical experience

Tools

Apache Iceberg

Apache Parquet

AWS Glue

Amazon Athena

KMS

AWS Lake Formation

Amazon Redshift

Job description

Guidehouse is seeking an AWS Lakehouse Data Engineer to design, implement, and operate a cloud-native data platform powering AI/ML, analytics, reporting, and visualization on AWS.

You will build a Delta Lakehouse on Amazon S3 using Apache Iceberg and open formats, implement batch and streaming ETL in Python/PySpark, enforce governance and security, and drive CI/CD across environments.