Senior AWS Glue ETL Engineer | Data Modernization

Cloud Analytics Technologies, LLC; Florida; Presencial; USD 110.000 - 160.000; Jornada completa

Descripción de la vacante

CLOUD ANALYTICS TECHNOLOGIES LLC is seeking a Senior AWS Glue ETL Developer to support a major modernization initiative for a federal customer. The role involves re-engineering mainframe batch jobs to cloud-native ETL processes, leveraging AWS Glue, and delivering end-to-end data integration solutions in a DevOps framework.

You will design and implement Glue ETL PySpark jobs, use serverless services for large-scale data processing, and collaborate across architecture, infrastructure, and

Formación

• Experience in SDLC with strong ETL development background.
• Proficient with AWS and AWS Glue Studio.
• Proficient in PySpark/Python.
• Experience with PostgreSQL or equivalent RDBMS.
• Experience in fast-paced development environments.
• Familiar with version control (CodeCommit, CodeBuild, CodePipeline).
• Familiar with issue tracking (Jira).
• Bachelor’s degree with 8–12 years or Master’s with 6–10 years of relevant experience.

Responsabilidades

• Re-engineer batch jobs to ETL processes, preferably using Cloud-Native tools like AWS Glue.
• Leverage serverless services to extract, transform, and load large datasets.
• Coordinate with mainframe resources to align requirements.
• Design Glue jobs for performance and adhere to standards; conduct end-to-end testing.
• Document design specifications and contribute to implementation planning with architecture team.
• Coordinate infrastructure/service needs with architecture and infrastructure teams.
• Develop Glue ETL PySpark jobs including SQL, Lambda, Step Functions, REST API calls.
• Develop and integrate custom software with automated deployment technologies.
• Use CodeCommit, CodeBuild, CodePipeline, and AWS CloudFormation for deployment.
• Communicate project data to team and infrastructure for cohesion.
• Utilize Jira and Confluence to track activities.
• Identify best practices and SOPs; create innovative solutions for customers.

Conocimientos

ETL development

Cloud experience

Python/PySpark

Fast-paced development

Educación

Bachelor's degree

Master's degree

Herramientas

AWS Glue Studio

PostgreSQL

CodeCommit

CodeBuild

CodePipeline

Jira

Confluence

Linux Bash scripting

Descripción del empleo

CLOUD ANALYTICS TECHNOLOGIES LLC is seeking a Senior AWS Glue ETL Developer to support a major modernization initiative for a federal customer. The role involves re-engineering mainframe batch jobs to cloud-native ETL processes, leveraging AWS Glue, and delivering end-to-end data integration solutions in a DevOps framework.

You will design and implement Glue ETL PySpark jobs, use serverless services for large-scale data processing, and collaborate across architecture, infrastructure, and