AWS Data Engineering Lead — ELT Pipelines & Data Lakes

ENGIE North America Inc.; Houston (TX); Hybrid; USD 117,300 - 179,860; Full time

Benefits offered by this job

Hybrid work policy

Competitive bonus plan

Medical/dental/vision insurance

Job summary

ENGIE North America Inc. seeks an AWS Data Engineering Advisor to build production‑grade data pipelines on AWS, integrate AI agents into workflows, and ensure secure, scalable data delivery.

You will design and maintain ETL/ELT processes, ingestion from Snowflake/APIs into S3 data lakes, and streaming with Kinesis, while ensuring data quality and governance. You will collaborate with analytics, platform, and business teams, deploying containerized workloads with AWS Batch and ECS, maintaining

Qualifications

• Bachelor’s degree in computer science, information technology, MIS, or related field, or equivalent experience.
• 7+ years of data engineering experience with strong AWS depth.
• Strong Python skills for data engineering and pipeline development.
• Hands-on with S3, Glue, Athena, IAM, Secrets Manager and CloudWatch.
• Experience with Spark/PySpark and large-scale data processing.
• Proficient in SQL for analytical workloads and Parquet-based lake design.
• Experience with Docker and orchestration on AWS Batch and ECS.

Responsibilities

• Build and maintain robust ETL/ELT pipelines in Python on AWS.
• Develop ingestion workflows from external systems into S3-based data lake zones.
• Implement and optimize data processing with AWS Glue, Athena, and Parquet/Iceberg patterns.
• Create and maintain streaming data workflows using Amazon Kinesis.
• Manage schema validation, data quality checks, and metadata consistency.
• Build reusable utility libraries for AWS interactions (Sessions, Secrets Manager, S3, Athena, Glue).
• Implement config-driven pipeline execution and operational controls using DynamoDB.
• Own deployment and runtime operations for containerized workloads on AWS Batch and ECS with ECR.
• Ensure observability with structured logs, run summaries, retry logic, and alerts.
• Partner with analytics, platform, and business teams to deliver reliable datasets and SLA-backed pipelines.

Skills

Python

S3

Glue

Athena

IAM

Secrets Manager

CloudWatch

Spark PySpark

SQL

Parquet

Docker

Kinesis

CI/CD

Education

Bachelor’s degree in CS/IT or related field

Tools

Docker

AWS Batch

ECS

ECR

Job description

ENGIE North America Inc. seeks an AWS Data Engineering Advisor to build production‑grade data pipelines on AWS, integrate AI agents into workflows, and ensure secure, scalable data delivery.

You will design and maintain ETL/ELT processes, ingestion from Snowflake/APIs into S3 data lakes, and streaming with Kinesis, while ensuring data quality and governance. You will collaborate with analytics, platform, and business teams, deploying containerized workloads with AWS Batch and ECS, maintaining