Senior Python Data Engineer - AWS ETL & Data Lakes

MACHINE LEARNING TECHNOLOGIES LLC; Atlanta (GA); On-site; USD 120,000 - 160,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Python Developer in Atlanta, GA to design and deliver robust AWS-based data engineering solutions for analytics and data product use cases. You will work on ETL pipelines, data lakes, and API integrations, collaborating with stakeholders and mentoring junior team members.

The role requires strong Python, PySpark, SQL, and extensive AWS experience across Glue, Redshift, S3, Lambda, and more. On-site in Atlanta with a 12-month+ extension potential.

Qualifications

• 6+ years of software development experience, with 5–8+ years on the appropriate platform.
• Solid IT background and experience.
• Experience as an application developer on projects similar in scope and responsibility.
• Strong expertise in Python, PySpark, and SQL.
• Experience with AWS services such as Glue, Redshift, RDS, Lambda, Step Functions, SNS, SQS, S3, Athena, EMR, CloudWatch, and CloudTrail.

Responsibilities

• Design, build, and maintain scalable ETL and data pipelines using Python, PySpark, and AWS services.
• Develop and manage workflows using Glue, Lambda, and Step Functions.
• Build event-driven integrations using SNS, SQS, and related AWS services.
• Design and optimize data lake and warehouse solutions using S3, Athena, and Redshift.
• Write and tune high-performance SQL for complex transformations and reporting.
• Design and implement data validation, monitoring, logging, alerting, and error-handling frameworks.
• Design and support API-based and JSON-based integrations across internal and external systems.
• Troubleshoot operational issues, identify root causes, and implement corrective actions.
• Contribute to documentation, deployment automation, and engineering best practices.
• Collaborate with stakeholders and mentor junior team members where needed.

Skills

Python

PySpark

SQL

AWS

ETL

Data pipelines

Tools

Glue

Lambda

Step Functions

SNS

SQS

S3

Athena

Redshift

EMR

CloudWatch

CloudTrail

RDS

Job description

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Python Developer in Atlanta, GA to design and deliver robust AWS-based data engineering solutions for analytics and data product use cases. You will work on ETL pipelines, data lakes, and API integrations, collaborating with stakeholders and mentoring junior team members.

The role requires strong Python, PySpark, SQL, and extensive AWS experience across Glue, Redshift, S3, Lambda, and more. On-site in Atlanta with a 12-month+ extension potential.