Senior AWS Glue ETL Engineer for Data Modernization

MACHINE LEARNING TECHNOLOGIES LLC; Town of Florida (NY); On-site; USD 83,000 - 124,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Sr. AWS Glue ETL Developer to modernize mainframe systems using cloud-native ETL processes and AWS services. You will drive end-to-end delivery across design, development, testing, and deployment in a DevOps framework.

The role emphasizes re-engineering batch jobs to ETL workflows, leveraging Glue PySpark, Lambda, and Step Functions, while coordinating with architecture and infra teams to ensure scalable solutions.

Qualifications

• Experience in SDLC with strong ETL development.
• Experience with AWS and mainly AWS Glue Studio.
• Proficient in PySpark/Python.
• Experience with PostgreSQL relational databases.
• Fast-paced development environment with delivery focus.
• Proficient with version control (CodeCommit/CodeBuild/CodePipeline).
• Experience with Jira for issue tracking.
• Bachelor’s with 8–12 years or Master’s with 6–10 years of relevant experience.

Responsibilities

• Re-engineer mainframe batch jobs to ETL processes, preferably with AWS Glue.
• Use serverless cloud services to extract, transform, and load large datasets.
• Coordinate with mainframe resources to clarify requirements.
• Design Glue jobs with performance considerations and end-to-end testing.
• Document design specs and align with architecture and lead developer.
• Coordinate infra needs with architecture and infrastructure teams.
• Develop Glue ETL PySpark jobs with SQL, Lambda, Step Functions, API calls.
• Develop and integrate custom software for automated deployment.
• Utilize CodeCommit, CodeBuild, CodePipeline, and CloudFormation.
• Communicate project data to team and maintain cohesion.
• Utilize Jira and Confluence to track activities.
• Apply best practices and create innovative customer solutions.

Skills

ETL development

AWS Glue

PySpark/Python

PostgreSQL

AWS (general)

CodeCommit/CodeBuild/CodePipeline

Jira/Confluence

Education

Bachelor’s degree with 8-12 years experience or Master’s with 6-10 years experience

Tools

AWS Glue Studio

CloudFormation

CodeCommit/CodeBuild/CodePipeline

JIRA

Confluence

Lambda

Step Functions

Job description

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Sr. AWS Glue ETL Developer to modernize mainframe systems using cloud-native ETL processes and AWS services. You will drive end-to-end delivery across design, development, testing, and deployment in a DevOps framework.

The role emphasizes re-engineering batch jobs to ETL workflows, leveraging Glue PySpark, Lambda, and Step Functions, while coordinating with architecture and infra teams to ensure scalable solutions.