AWS Data Engineer: Cloud Data Pipelines & IaC

Valiant Technologies LLC; Chicago (IL); On-site; USD 98,000 - 139,000; Full time

Job summary

Valiant Technologies LLC in Chicago, IL is seeking an experienced AWS Data Engineer to design, develop, and maintain scalable cloud-based data pipelines using AWS services, Terraform, and Python. You will contribute to DevOps practices, CI/CD, and IaC while delivering robust ETL/ELT solutions.

The role requires hands-on AWS expertise with S3, Glue, Redshift, EMR and strong scripting in Python, plus experience with Terraform and data pipeline orchestration in a collaborative team environment.

Qualifications

• Strong hands-on experience with AWS data services.
• Proficient Python programming and scripting skills.
• Experience with Terraform and Infrastructure as Code (IaC).
• DevOps and CI/CD pipeline experience.
• Experience developing and maintaining ETL/ELT data pipelines.
• Knowledge of AWS cloud architecture, monitoring, and troubleshooting.

Responsibilities

• Design, develop, and maintain scalable cloud-based data pipelines.
• Build and optimize ETL/ELT processes.
• Implement IaC with Terraform.
• Manage CI/CD pipelines and DevOps practices.
• Work with AWS services like S3, Glue, Redshift, EMR.
• Monitor, troubleshoot, and optimize cloud data architectures.

Skills

AWS

Python

Terraform

CI/CD

ETL/ELT

Git

Docker

Tools

S3/Glue/Redshift

EMR

Job description

Valiant Technologies LLC in Chicago, IL is seeking an experienced AWS Data Engineer to design, develop, and maintain scalable cloud-based data pipelines using AWS services, Terraform, and Python. You will contribute to DevOps practices, CI/CD, and IaC while delivering robust ETL/ELT solutions.

The role requires hands-on AWS expertise with S3, Glue, Redshift, EMR and strong scripting in Python, plus experience with Terraform and data pipeline orchestration in a collaborative team environment.