Data Engineer - AWS Glue, ELT Pipelines and Data Mesh

SMX; City of Albany (NY); On-site; USD 103,000 - 172,000; Full time

Benefits offered by this job

Health insurance

Paid leave

Retirement savings

Job summary

SMX is seeking a Data Engineer to architect, build, test, and maintain data infrastructure for mission partners. You will design scalable ELT/ETL pipelines and collaborate with analytics and business teams to transform raw data into high-quality datasets.

Proficiency in SQL, AWS services (Glue, Glue Catalog, Step Functions), and data modeling are essential. A Top Secret clearance is required, with strong communication skills and experience in data migration and governance.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.
• 3 years of professional experience in a data engineering or backend software engineering role.
• Active Top Secret security clearance.
• Strong proficiency in SQL and data query creation.
• Hands-on experience with AWS services, specifically AWS Glue, Glue Catalog, and Step Functions.
• Experience with data modeling, data migration, and ETL functions.
• Excellent communication skills, both written and verbal.

Responsibilities

• Design, construct, test, and maintain highly scalable data management systems and robust ELT/ETL pipelines.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from various sources using cloud technologies, with a strong focus on AWS Glue, Glue Catalog, and Step Functions.
• Support data migration efforts and ETL functions.
• Optimize database schemas and build systems to collect, validate, and prepare data.
• Combine raw information from different sources to meet business and mission needs.
• Work with analytics and business teams to understand data requirements and deliver production-ready datasets

Skills

SQL

Data modeling

Data integration

Data migration

Communication skills

Security clearance

Education

Bachelor's degree in Computer Science or related field

Tools

AWS Glue

Glue Catalog

Step Functions

Job description

SMX is seeking a Data Engineer to architect, build, test, and maintain data infrastructure for mission partners. You will design scalable ELT/ETL pipelines and collaborate with analytics and business teams to transform raw data into high-quality datasets.

Proficiency in SQL, AWS services (Glue, Glue Catalog, Step Functions), and data modeling are essential. A Top Secret clearance is required, with strong communication skills and experience in data migration and governance.