Senior ETL & AWS Data Engineer

Cloud Analytics Technologies, LLC; Chicago (IL); On-site; USD 120,000 - 180,000; Full time

Job summary

Cloud Analytics Technologies, LLC is seeking an experienced Software Development Engineer to lead the migration of ETL jobs and databases from on‑premises to AWS. You will build ETL solutions, understand existing ETL jobs, and guide the team through data validation, quality and compliance.

Responsibilities include designing and implementing PySpark ETL processes, deploying to Redshift/Aurora, and ensuring robust production support.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 8+ years of ETL development, data warehousing, AWS cloud services, and API development.
• Proficiency in AWS services and data integration, transformation and loading.
• Scripting: DataStage or Informatica, Shell, Perl, Python.
• Experience with API development (REST/SOAP).
• AWS services: Glue, Step Functions, Airflow DAGs, Lambda, S3, EC2, and more.
• SQL proficiency across on-prem DB2 and AWS databases (RDS, Aurora, Redshift).
• Version control with Git or Bitbucket.
• CI/CD with Jenkins.
• Experience in data analysis/validation with Excel, Python, Tableau.
• AWS certifications and AI/ML knowledge are advantageous.

Responsibilities

• Lead migration of ETL jobs from on‑premises to AWS cloud.
• Design, develop and implement ETL using DataStage or Informatica and PySpark.
• Develop full‑stack components or APIs as required.
• Validate data quality, ensure data compliance and business rules.
• Collaborate with data analysts and architects to improve data accuracy.
• Automate ETL processes and orchestrate workflows across on‑premises and cloud.
• Provide production support, monitoring and issue resolution for ETL pipelines.
• Document processes, data mappings, data flows and APIs.

Skills

ETL development

Data warehousing

AWS cloud services

API development

Python

Perl scripting

Unix/Linux

Shell scripting

SQL

Data analysis

Tableau

Education

Bachelor's degree in Computer Science or related field

Tools

DataStage

Informatica

Git/Bitbucket

Jenkins

AWS Glue/Step Functions

Airflow

Job description

Cloud Analytics Technologies, LLC is seeking an experienced Software Development Engineer to lead the migration of ETL jobs and databases from on‑premises to AWS. You will build ETL solutions, understand existing ETL jobs, and guide the team through data validation, quality and compliance.

Responsibilities include designing and implementing PySpark ETL processes, deploying to Redshift/Aurora, and ensuring robust production support.