Senior AWS Data Engineer - Python, PySpark & Redshift

Cloud Analytics Technologies, LLC; Reston (VA); On-site; USD 100,000 - 130,000; Full time

Job summary

A data analytics company seeks an experienced developer to build and maintain ETL pipelines using Python and PySpark on AWS. The role involves orchestrating workflows with AWS Step Functions, implementing event-driven patterns, and ensuring data quality. The ideal candidate will have strong experience with AWS services like Glue and Redshift, solid SQL skills, and familiarity with ETL best practices. This position offers an opportunity to work in a dynamic environment.

Qualifications

• Strong experience with Python and PySpark for large-scale data processing.
• Proven hands-on experience with AWS services including Glue and Redshift.
• Solid SQL skills and familiarity with data modeling and query optimization.

Responsibilities

• Build and maintain ETL pipelines using Python and PySpark on AWS.
• Orchestrate workflows with AWS Step Functions and serverless components.
• Implement messaging and event-driven patterns using AWS SNS and SQS.

Skills

Python

PySpark

AWS services

SQL

ETL best practices

Git

Job description

A data analytics company seeks an experienced developer to build and maintain ETL pipelines using Python and PySpark on AWS. The role involves orchestrating workflows with AWS Step Functions, implementing event-driven patterns, and ensuring data quality. The ideal candidate will have strong experience with AWS services like Glue and Redshift, solid SQL skills, and familiarity with ETL best practices. This position offers an opportunity to work in a dynamic environment.