GovCloud ETL Engineer: AWS Glue & PySpark (Onsite Phoenix)

Realign LLC; Phoenix (AZ); On-site; USD 102,000 - 138,000; Full time

Job summary

Realign LLC in Phoenix, AZ is hiring an AWS Glue Data Engineer to design, build, and optimize scalable ETL pipelines using AWS Glue and PySpark/Spark. The role focuses on governance, security with AWS Lake Formation, and collaborating with the cloud engineering team on a GovCloud proof of concept; on-site buildout week is required.

You will configure Crawlers, Data Catalog, jobs, workflows, and connections; integrate with Snowflake via SQL; convert SQL logic to maintainable PySpark code;

Qualifications

• Hands-on AWS Glue expertise, including PySpark/Spark ETL development, Crawlers, and Data Catalog.
• Snowflake experience with SQL and connectors; basic administration.
• Data governance experience with AWS Lake Formation.
• Eligibility to work on ITAR/export-controlled GovCloud engagements; US citizenship is required.
• Ability to work on-site in Phoenix, Arizona during the buildout week.

Responsibilities

• Design, build, test, and optimize scalable ETL pipelines using AWS Glue and PySpark/Spark.
• Configure and maintain AWS Glue Crawlers, Data Catalog objects, jobs, workflows, and connections.
• Integrate AWS Glue workloads with Snowflake using SQL and connectors.
• Implement data access controls, governance, and security with AWS Lake Formation.
• Collaborate with cloud engineering to deliver GovCloud proof of concept.
• Convert SQL logic into maintainable PySpark code and validate data quality and performance.
• Document architecture, deployment steps, test results, risks, and handover.
• Participate in on-site Phoenix buildout week and support troubleshooting through POC completion.
• Own deliverables, risks, dependencies, and provide timely status reporting.

Skills

AWS Glue

PySpark/Spark ETL

Crawlers

Data Catalog

SQL

Snowflake

AWS Lake Formation

Tools

Snowflake connectors

Job description

Realign LLC in Phoenix, AZ is hiring an AWS Glue Data Engineer to design, build, and optimize scalable ETL pipelines using AWS Glue and PySpark/Spark. The role focuses on governance, security with AWS Lake Formation, and collaborating with the cloud engineering team on a GovCloud proof of concept; on-site buildout week is required.

You will configure Crawlers, Data Catalog, jobs, workflows, and connections; integrate with Snowflake via SQL; convert SQL logic to maintainable PySpark code;