Senior AWS Glue ETL Engineer - Cloud Data Modernization

MACHINE LEARNING TECHNOLOGIES LLC; Town of Florida (NY); On-site; USD 100,000 - 150,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Palm Beach Gardens, FL is seeking a Sr. AWS Glue ETL Developer to support a major mainframe modernization initiative in a DevOps environment.

The role focuses on re-engineering batch jobs to ETL processes using cloud-native tools and building scalable data pipelines. You will drive design, development, and testing of Glue ETL PySpark jobs, coordinate with mainframe resources, and ensure smooth deployments with CodeCommit, CodePipeline, and CloudFormation.

Qualifications

• 8–12 years of relevant ETL development experience.
• Strong AWS experience with AWS Glue Studio.
• Proficiency in PySpark/Python and PostgreSQL.
• Experience with DevOps practices and CI/CD tooling.
• Bachelor’s degree required; Master’s preferred.

Responsibilities

• Re-engineer mainframe batch jobs to ETL processes using cloud-native tools like AWS Glue.
• Design and implement Glue jobs and data pipelines with PySpark, SQL, and Lambda/Step Functions.
• Collaborate with architecture and infrastructure teams to meet requirements and ensure performance.
• Develop and test end-to-end solutions; support deployments and higher-environment testing.
• Leverage CodeCommit, CodeBuild, CodePipeline for automated deployments and version control.

Skills

ETL development

AWS Glue

PySpark/Python

PostgreSQL

DevOps practices

AWS CloudFormation

Education

Bachelor's degree

Master's degree

Tools

AWS Glue Studio

CodeCommit

CodeBuild

CodePipeline

JIRA

Confluence

AWS CloudFormation

Linux Bash

Job description

MACHINE LEARNING TECHNOLOGIES LLC in Palm Beach Gardens, FL is seeking a Sr. AWS Glue ETL Developer to support a major mainframe modernization initiative in a DevOps environment.

The role focuses on re-engineering batch jobs to ETL processes using cloud-native tools and building scalable data pipelines. You will drive design, development, and testing of Glue ETL PySpark jobs, coordinate with mainframe resources, and ensure smooth deployments with CodeCommit, CodePipeline, and CloudFormation.