Senior AWS Glue ETL Architect for Mainframe Modernization

Valiant Technologies LLC; Florida; Presencial; USD 120.000 - 180.000; Jornada completa

Descripción de la vacante

VALIANT TECHNOLOGIES LLC in Florida is seeking a Sr. AWS Glue ETL Developer to support a major mainframe systems modernization initiative for a federal customer.

You will drive end-to-end SDLC activities, from architecture and design to deployment and testing, within a DevOps framework. Responsibilities include re-engineering batch jobs to ETL processes using AWS Glue, building PySpark-based pipelines, and coordinating with mainframe teams to ensure requirements are met.

Formación

• Experience in the software development lifecycle with strong ETL development experience.
• Working experience with Amazon Web Services (AWS) and primarily on AWS Glue Studio.
• Experience with PySpark/Python
• Experience with PostgreSQL
• Fast-paced development environment with drive to completion.
• Version control systems (CodeCommit, CodeBuild, CodePipeline)
• Issue/problem tracking systems (Jira)
• Bachelor’s with 8-12 years of prior relevant experience or Master’s with 6-10 years of prior relevant experience

Responsabilidades

• Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue.
• Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing.
• Coordinate closely with mainframe resources to ensure requirements and specifications are clearly understood.
• Design Glue jobs to meet requirements, consider performance where applicable, code per standards, and perform end-to-end testing.
• Document the design specifications and contribute to implementation plan then work with the architecture team and lead developer to review the design and the code.
• Effectively coordinate the infrastructure/service needs working with the architecture and infrastructure teams.
• Implement overall solution comprising of Glue ETL PySpark jobs including SQL queries, Lambda, Step Functions, REST API calls.
• Develop and integrate custom developed software solutions to leverage automated deployment technologies.
• Use industry leading DevOps tools such as CodeCommit, CodeBuild, CodePipeline and AWS CloudFormation.
• Communicate key project data to team members and infrastructure team cohesion and effectiveness.
• Leverage Atlassian tool suite like JIRA and Confluence to track activities.
• Identify and apply best practices and standard operating procedures.
• Create innovative solutions to meet the technical needs of customers.

Conocimientos

PySpark

Python

AWS Glue

ETL Development

PostgreSQL

Jira

CodeCommit

CodeBuild

CodePipeline

AWS CloudFormation

Educación

Bachelor’s degree or higher (8-12 years for BA)

Master’s degree or higher (6-10 years for MS)

Herramientas

CloudFormation

Jira/Confluence

Descripción del empleo

VALIANT TECHNOLOGIES LLC in Florida is seeking a Sr. AWS Glue ETL Developer to support a major mainframe systems modernization initiative for a federal customer.

You will drive end-to-end SDLC activities, from architecture and design to deployment and testing, within a DevOps framework. Responsibilities include re-engineering batch jobs to ETL processes using AWS Glue, building PySpark-based pipelines, and coordinating with mainframe teams to ensure requirements are met.