Senior AWS Data Engineer - Spark, Redshift & Pipelines

Tech Mirrors

Atlanta (GA)

On-site

USD 140,000 - 190,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Tech Mirrors in Atlanta, GA seeks an AWS Data Engineer with 10+ years of Python and big data experience. You will build scalable pipelines using Hadoop/EMR, Spark, Hive, and AWS services like Lambda, EventBridge, Step Functions, Redshift, S3, and Glue to turn raw data into actionable insights.

The role emphasizes API-driven data access, SQL, data transformation, analysis, and visualization, plus CI/CD practices.

Qualifications

10+ years hands-on Python development for big data applications.
Extensive experience with Hadoop/EMR, Spark, and Hive.
Strong development experience with AWS services such as Lambda, EventBridge, Step Functions, Redshift, S3, and Glue.
Hands-on experience in API calls, SQL queries, data manipulation/transformation, analysis and visualization.
Strong data analysis/mining capabilities and ability to extract insights from large datasets.
CI/CD pipeline experience and implementing best practices.
Familiar with GitLab and Terraform tooling.

Responsibilities

Collaborate with analytics and data science teams to translate requirements into data pipelines.
Design scalable data processing workflows and ensure reliability at scale.
Mentor junior engineers and drive best practices in data engineering and CI/CD.