AWS Data Engineer

Impetus; Atlanta (GA); On-site; USD 110,000 - 170,000; Full time

Job summary

Impetus Technologies is seeking a data engineer with hands-on AWS experience to design, develop, and manage batch and streaming ETL/ELT pipelines for enterprise workloads. You will collaborate with customers and large distributed teams to deliver scalable data solutions.

Responsibilities include building data lakes and warehouses with S3/Redshift/Athena, ensuring data quality, security, and governance, and staying current with new AWS technologies to drive improvements for Fortune 500 clients.

Qualifications

• Strong experience with AWS cloud services (S3, Glue, Redshift, EMR, Kinesis, Lambda, DynamoDB, RDS, Athena, SNS, SQS).
• Proficiency in SQL, Python and PySpark.
• Knowledge of data modeling, schema design, and performance tuning.
• Familiarity with CI/CD pipelines and DevOps practices tools (Terraform, CloudFormation).
• Experience with security best practices (IAM, encryption, compliance).

Responsibilities

• Design, develop, and maintain batch and streaming ETL/ELT pipelines using AWS services (Glue, Lambda, Step Functions, etc.).
• Implement data ingestion frameworks from diverse sources (APIs, databases, streaming platforms).
• Ensure data quality, governance, and security across all pipelines.
• Build and optimize data lakes and warehouses leveraging Amazon S3, Redshift, Athena, and Lake Formation.
• Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets.
• Monitor and troubleshoot data workflows, ensuring high availability and performance.
• Stay updated with emerging AWS technologies and recommend improvements.

Skills

AWS

Python

PySpark

SparkSQL

Tools

Terraform

CloudFormation

Job description

This is a Fulltime role and we are not looking for C2C candidates.

Skill set - #AWS #Python, #PySpark, #SparkSQL

Position Summary:

We are looking for candidates with hands on experience with AWS, and Data Engineering Technologies and ability to work with directly with customer and large distributed teams

Job Description

• Design, develop, and maintain batch and streaming ETL/ELT pipelines using AWS services (Glue, Lambda, Step Functions, etc.).
• Implement data ingestion frameworks from diverse sources (APIs, databases, streaming platforms).
• Ensure data quality, governance, and security across all pipelines.
• Build and optimize data lakes and warehouses leveraging Amazon S3, Redshift, Athena, and Lake Formation.
• Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets.
• Monitor and troubleshoot data workflows, ensuring high availability and performance.
• Stay updated with emerging AWS technologies and recommend improvements.

Required Skills & Qualifications

• Strong experience with AWS cloud services: S3, Glue, Redshift, EMR, Kinesis, Lambda, DynamoDB, RDS, Athena, SNS. SQS.
• Proficiency in SQL, Python and PySpark
• Knowledge of data modeling, schema design, and performance tuning.
• Familiarity with CI/CD pipelines and DevOps practices tool (Terraform, CloudFormation).
• Experience with security best practices (IAM, encryption, compliance).

About Impetus

• Impetus Technologies is a digital engineering company.
• We deliver expert services and products in cloud data engineering and analytics space to help large enterprises in their digital transformation journey /goals. Enabling an intelligent, data-driven future for our customers.
• We solve Analytics, AI (Artificial Intelligence), and Cloud puzzle for fortune 500 companies to help drive innovation and growth for them.
• Headquartered in Los Gatos, California, with offshore development centers. We also have office in Canada.