AWS Data Engineer | Fourways Consulting | Atlanta, GA

Fourways Consulting; Atlanta (GA); On-site; USD 150,000 - 190,000; Full time

Job summary

Fourways Consulting seeks a senior AWS Data Engineer in Atlanta, GA to own end-to-end data pipelines and data lake architectures. You will deploy scalable data platforms, collaborate with architects, data scientists, and stakeholders, and drive performance and security across the analytics stack.

The role emphasizes Terraform-based IaC, GitLab CI/CD, and robust data governance, with in-person interviews required in Atlanta. A decade plus of data engineering leadership is expected.

Qualifications

• 10+ years of Big Data Engineering, data platform architecture, or software engineering.

Responsibilities

• Architect, develop, and optimize robust, scalable end-to-end big data pipelines and ETL/ELT workflows across AWS cloud environments.
• Build and maintain distributed, high-volume data processing jobs utilizing Apache Spark, PySpark, Hadoop, and Hive on AWS EMR.
• Design and implement serverless data ingestion and transformation pipelines utilizing AWS Glue, AWS Lambda, Amazon S3, and Amazon EventBridge.
• Model, optimize, and manage enterprise cloud data warehouses and analytical databases utilizing Amazon Redshift and advanced SQL tuning.
• Develop, secure, and deploy high-performance RESTful APIs to facilitate seamless data integration between enterprise applications and analytical platforms.
• Automate, manage, and maintain cloud infrastructure-as-code (IaC) provisioning across AWS environments using Terraform.
• Establish, streamline, and govern automated continuous integration and continuous delivery (CI/CD) pipelines utilizing GitLab CI/CD.
• Enforce comprehensive data governance, pipeline observability, data quality validation frameworks, and enterprise encryption standards.

Skills

Python

AWS

Spark

ETL/ELT

SQL

REST APIs

IaC

GitLab CI/CD

Tools

AWS EMR

AWS Glue

S3

Redshift

Hive

PySpark

Job description

Position Summary

Fourways Consulting is actively seeking 10 experienced, senior-level AWS Data Engineers to drive enterprise-scale big data engineering initiatives in Atlanta, Georgia. In this high-impact technical role, you will take ownership of architecting, deploying, and optimizing robust, high-throughput cloud data pipelines, distributed analytics engines, and mission-critical data lake environments across Amazon Web Services. With over a decade of dedicated professional engineering experience, you will bridge scalable distributed processing with modern data warehousing and infrastructure-as-code automation. This position represents an outstanding full-time career opportunity for accomplished data engineering leaders to transform raw enterprise datasets into actionable analytical assets within a dynamic technology consulting landscape.

Detailed Job Description

As an AWS Data Engineer with Fourways Consulting in Atlanta, GA, you will serve as a technical subject matter expert responsible for the end-to-end design, implementation, and performance optimization of modern big data architectures. Collaborating closely with cross-functional teams of software architects, data scientists, machine learning engineers, and executive business stakeholders, you will build and govern scalable data pipelines that process petabyte-scale structured and unstructured datasets with low latency and high availability.

Your core technical mandate spans engineering distributed data processing workflows utilizing Apache Spark, Hadoop, and Hive, and orchestrating native AWS serverless and managed services including AWS EMR, AWS Glue, AWS Lambda, Amazon S3, and Amazon Redshift. You will design, develop, and secure high-performance RESTful APIs for real-time and batch data delivery, write optimized SQL queries, and automate cloud infrastructure provisioning using Terraform. Additionally, you will establish disciplined CI/CD deployment pipelines utilizing GitLab, enforce automated data quality monitoring, and implement stringent data security, encryption, and governance protocols. This role requires exceptional analytical problem-solving skills, deep cloud architecture acumen, and full readiness to complete a mandatory in-person interview in Atlanta, GA.

Key Responsibilities

• Architect, develop, and optimize robust, scalable end-to-end big data pipelines and ETL/ELT workflows across AWS cloud environments.
• Build and maintain distributed, high-volume data processing jobs utilizing Apache Spark, PySpark, Hadoop, and Hive on AWS EMR.
• Design and implement serverless data ingestion and transformation pipelines utilizing AWS Glue, AWS Lambda, Amazon S3, and Amazon EventBridge.
• Model, optimize, and manage enterprise cloud data warehouses and analytical databases utilizing Amazon Redshift and advanced SQL tuning.
• Develop, secure, and deploy high-performance RESTful APIs to facilitate seamless data integration between enterprise applications and analytical platforms.
• Automate, manage, and maintain cloud infrastructure-as-code (IaC) provisioning across AWS environments using Terraform.
• Establish, streamline, and govern automated continuous integration and continuous delivery (CI/CD) pipelines utilizing GitLab CI/CD.
• Enforce comprehensive data governance, pipeline observability, data quality validation frameworks, and enterprise encryption standards.

Required Qualifications & Skills

• Minimum 10+ years of dedicated professional experience in Big Data Engineering, Data Platform Architecture, or Software Engineering.
• Advanced programming and scripting proficiency in Python for complex data transformations, automation, and distributed systems integration.
• Extensive hands-on technical architecture and engineering experience with core AWS big data services: EMR, Lambda, Glue, S3, and Redshift.
• Deep technical expertise in Apache Spark, PySpark, Hadoop ecosystem, and Apache Hive for distributed batch and streaming data processing.
• Expertise in relational and analytical database modeling, advanced SQL development, index tuning, and performance profiling.
• Proven experience designing, building, testing, and deploying secure enterprise-grade RESTful APIs for data delivery.
• Hands-on expertise implementing Infrastructure as Code (IaC) utilizing Terraform for automated AWS cloud deployments.
• Demonstrated mastery of GitLab CI/CD pipelines, Git version control, automated testing, and agile software development workflows.

Nice-to-Have Skills

• Recognized AWS cloud certifications such as AWS Certified Data Engineer - Associate, AWS Certified Solutions Architect, or AWS Certified Big Data - Specialty.
• Experience building real-time data streaming architectures utilizing Apache Kafka, Amazon Kinesis, or Apache Flink.
• Working familiarity with modern orchestration tools such as Apache Airflow, AWS Step Functions, or Dagster.
• Knowledge of modern cloud data lakehouse formats such as Apache Iceberg, Delta Lake, or Apache Hudi.
• Current physical residence in or near Atlanta, Georgia, with immediate availability for local technical evaluation.

Application Information

• Employer / Recruiting Agency: Fourways Consulting
• Position: AWS Data Engineer (10 Openings Available)
• Job Location: Atlanta, GA
• Employment Type: Full Time
• Experience Level: 10+ Years Experience
• Interview Requirement: Final round in-person interview required in Atlanta, GA
• Core Technology Stack: Python, AWS (EMR, Lambda, Glue, S3, Redshift), Spark, Hadoop, Hive, SQL, API Development, Terraform, GitLab CI/CD