Sr. AWS Glue ETL Developer

Cloud Analytics Technologies, LLC; Florida; On-site; USD 110,000 - 160,000; Full time

Job summary

CLOUD ANALYTICS TECHNOLOGIES LLC is seeking a Senior AWS Glue ETL Developer to support a major modernization initiative for a federal customer. The role involves re-engineering mainframe batch jobs to cloud-native ETL processes, leveraging AWS Glue, and delivering end-to-end data integration solutions in a DevOps framework.

You will design and implement Glue ETL PySpark jobs, use serverless services for large-scale data processing, and collaborate across architecture, infrastructure, and

Qualifications

• Experience in SDLC with strong ETL development background.
• Proficient with AWS and AWS Glue Studio.
• Proficient in PySpark/Python.
• Experience with PostgreSQL or equivalent RDBMS.
• Experience in fast-paced development environments.
• Familiar with version control (CodeCommit, CodeBuild, CodePipeline).
• Familiar with issue tracking (Jira).
• Bachelor’s degree with 8–12 years or Master’s with 6–10 years of relevant experience.

Responsibilities

• Re-engineer batch jobs to ETL processes, preferably using Cloud-Native tools like AWS Glue.
• Leverage serverless services to extract, transform, and load large datasets.
• Coordinate with mainframe resources to align requirements.
• Design Glue jobs for performance and adhere to standards; conduct end-to-end testing.
• Document design specifications and contribute to implementation planning with architecture team.
• Coordinate infrastructure/service needs with architecture and infrastructure teams.
• Develop Glue ETL PySpark jobs including SQL, Lambda, Step Functions, REST API calls.
• Develop and integrate custom software with automated deployment technologies.
• Use CodeCommit, CodeBuild, CodePipeline, and AWS CloudFormation for deployment.
• Communicate project data to team and infrastructure for cohesion.
• Utilize Jira and Confluence to track activities.
• Identify best practices and SOPs; create innovative solutions for customers.

Skills

ETL development

Cloud experience

Python/PySpark

Fast-paced development

Education

Bachelor's degree

Master's degree

Tools

AWS Glue Studio

PostgreSQL

CodeCommit

CodeBuild

CodePipeline

Jira

Confluence

Linux Bash scripting

Job description

Job Description

Total Force Alliance is seeking a Sr. AWS Glue ETL Developer with strong systems, software, and AWS cloud experience to support a major mainframe systems modernization initiative for federal customer. Based in DevOps framework, participate in and/or direct major deliverables of projects through all aspects of the software development lifecycle including scope and work estimation, architecture and design, coding, unit testing, support deployments and testing in higher environments.

Primary Responsibilities

• Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue.
• Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing.
• Coordinate closely with mainframe resources to ensure requirements and specifications are clearly understood.
• Design Glue jobs to meet requirements, consider performance where applicable, code per standards, and perform end-to-end testing.
• Document the design specifications and contribute to implementation plan then work with the architecture team and lead developer to review the design and the code.
• Effectively coordinate the infrastructure/service needs working with the architecture and infrastructure teams.
• Implement overall solution comprising of Glue ETL PySpark jobs including SQL queries, Lambda, Step Functions, REST API calls.
• Develop and integrate custom developed software solutions to leverage automated deployment technologies.
• Use industry leading DevOps tools such as CodeCommit, CodeBuild, CodePipeline and AWS CloudFormation.
• Communicate key project data to team members and infrastructure team cohesion and effectiveness.
• Leverage Atlassian tool suite like JIRA and Confluence to track activities.
• Identify and apply best practices and standard operating procedures.
• Create innovative solutions to meet the technical needs of customers.

Basic Qualifications

• Experience working in the software development lifecycle, with strong experience on ETL based development.
• Working experience with development using Amazon Web Services (AWS) and primarily on AWS Glue studio.
• Experience working with programming language PySpark/Python
• Experience working with relational database like PostgreSQL.
• Experience working in a fast-paced development environment with drive to completion.
• Well versed with using version control systems (CodeCommit, CodeBuild, CodePipeline preferred)
• Well versed with using issue/problem tracking systems (Jira preferred)
• Candidate must have bachelor’s with 8-12 years of prior relevant experience or master’s with 6-10 years of prior relevant experience

Preferred Qualifications

• Familiarity working with multiple file formats, and knowledge on DB2, JCL, COBOL COPYBOOK and EBCDIC character format is strongly desired.
• AWS, Agile, or other related Certification(s)
• Prior experience working mainframe modernization.
• Prior experience with Linux bash scripting

Equal Opportunity Employer

CLOUD ANALYTICS TECHNOLOGIES is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

CLOUD ANALYTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

Some of our Business Ventures - Knowledge Analytics

Do restrictive necessities, your capability for advanced analytics or your business model need custom-made applications and infrastructure configurations? opt for our hosted managed services to urge comprehensive analytics solutions supported industry-leading Cloud Analytics Technologies, LLC code - delivered by the Cloud Analytics Technologies, LLC consultants UN agency understand these solutions best. Through a mix of with-it technology and dedicated service and support, Cloud Analytics Technologies, LLC hosted managed services will facilitate you: