Senior AWS Data Engineer - Cloud Data Pipelines Leader

Fourways Consulting; Atlanta (GA); On-site; USD 150,000 - 190,000; Full time

Job summary

Fourways Consulting seeks a senior AWS Data Engineer in Atlanta, GA to own end-to-end data pipelines and data lake architectures. You will deploy scalable data platforms, collaborate with architects, data scientists, and stakeholders, and drive performance and security across the analytics stack.

The role emphasizes Terraform-based IaC, GitLab CI/CD, and robust data governance, with in-person interviews required in Atlanta. A decade plus of data engineering leadership is expected.

Qualifications

• 10+ years of Big Data Engineering, data platform architecture, or software engineering.

Responsibilities

• Architect, develop, and optimize robust, scalable end-to-end big data pipelines and ETL/ELT workflows across AWS cloud environments.
• Build and maintain distributed, high-volume data processing jobs utilizing Apache Spark, PySpark, Hadoop, and Hive on AWS EMR.
• Design and implement serverless data ingestion and transformation pipelines utilizing AWS Glue, AWS Lambda, Amazon S3, and Amazon EventBridge.
• Model, optimize, and manage enterprise cloud data warehouses and analytical databases utilizing Amazon Redshift and advanced SQL tuning.
• Develop, secure, and deploy high-performance RESTful APIs to facilitate seamless data integration between enterprise applications and analytical platforms.
• Automate, manage, and maintain cloud infrastructure-as-code (IaC) provisioning across AWS environments using Terraform.
• Establish, streamline, and govern automated continuous integration and continuous delivery (CI/CD) pipelines utilizing GitLab CI/CD.
• Enforce comprehensive data governance, pipeline observability, data quality validation frameworks, and enterprise encryption standards.

Skills

Python

AWS

Spark

ETL/ELT

SQL

REST APIs

IaC

GitLab CI/CD

Tools

AWS EMR

AWS Glue

S3

Redshift

Hive

PySpark

Job description

Fourways Consulting seeks a senior AWS Data Engineer in Atlanta, GA to own end-to-end data pipelines and data lake architectures. You will deploy scalable data platforms, collaborate with architects, data scientists, and stakeholders, and drive performance and security across the analytics stack.

The role emphasizes Terraform-based IaC, GitLab CI/CD, and robust data governance, with in-person interviews required in Atlanta. A decade plus of data engineering leadership is expected.