Senior Python Data Engineer - AWS ETL & Data Lakes

Machine Learning Technologies, LLC; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

Machine Learning Technologies, LLC is seeking a Python Developer to design and deliver robust AWS-based data engineering solutions for analytics and data product use cases. You will build ETL pipelines, manage data lakes and warehouses, and collaborate with stakeholders while mentoring junior team members in a fast-paced environment.

The role requires 6–10 years of software development experience with strong Python, PySpark, and SQL skills and extensive AWS services exposure.

Qualifications

• 6 to 10 years of software development experience.
• Strong Python, PySpark and SQL skills.
• Significant AWS experience (Glue, Redshift, Lambda, S3, etc.).
• Experience building ETL pipelines and data lakes/warehouses.
• API/JSON integration and cloud-based data integration patterns.

Responsibilities

• Design and maintain scalable ETL pipelines using Python and AWS.
• Develop workflows with Glue, Lambda, and Step Functions.
• Build event-driven integrations using SNS and SQS.
• Design data lakes and warehouses with S3, Athena, and Redshift.
• Write high-performance SQL for transformations and reporting.
• Implement data validation, monitoring, and error handling.
• Support API/JSON integrations across systems.
• Troubleshoot issues and drive corrective actions.
• Contribute to documentation and deployment automation.
• Mentor junior team members.

Skills

Python

PySpark

SQL

AWS

ETL

Data pipelines

APIs/JSON

GitLab

CI/CD

Terraform

Tools

Glue

Redshift

S3

Athena

EMR

CloudWatch

CloudTrail

RDS

SNS

SQS

Job description

Machine Learning Technologies, LLC is seeking a Python Developer to design and deliver robust AWS-based data engineering solutions for analytics and data product use cases. You will build ETL pipelines, manage data lakes and warehouses, and collaborate with stakeholders while mentoring junior team members in a fast-paced environment.

The role requires 6–10 years of software development experience with strong Python, PySpark, and SQL skills and extensive AWS services exposure.