Data Engineer - AWS Glue & Scalable Data Pipelines

Applied Resource Group; Atlanta (GA); On-site; USD 110,000 - 130,000; Full time

Job summary

A technology resource management firm is looking for a skilled Data Engineer with expertise in AWS Glue to design and develop scalable data pipelines in the AWS cloud. In this role, you will build and optimize ETL processes using AWS Glue and PySpark, integrate data into Amazon Redshift, and collaborate with analytics teams to ensure high data quality. The ideal candidate has strong programming skills and experience with large datasets, making it essential to have hands-on knowledge of AWS data architecture and ETL practices.

Qualifications

• 3+ years of experience in Data Engineering or similar role.
• Hands-on experience with AWS Glue for ETL development.
• Strong programming skills in Python and PySpark.

Responsibilities

• Design, develop, and maintain ETL pipelines using AWS Glue.
• Build scalable data solutions within the AWS cloud ecosystem.
• Integrate data from multiple sources into Amazon Redshift.

Skills

AWS Glue

Python

PySpark

Amazon Redshift

ETL processes

Data Engineering

Tools

AWS

Airflow

Job description

A technology resource management firm is looking for a skilled Data Engineer with expertise in AWS Glue to design and develop scalable data pipelines in the AWS cloud. In this role, you will build and optimize ETL processes using AWS Glue and PySpark, integrate data into Amazon Redshift, and collaborate with analytics teams to ensure high data quality. The ideal candidate has strong programming skills and experience with large datasets, making it essential to have hands-on knowledge of AWS data architecture and ETL practices.