A technology solutions company in Virginia is seeking an AWS Data Engineer to design, build, and maintain scalable data pipelines and ETL solutions. The ideal candidate will have strong experience with Python/PySpark and AWS services, including Lambda, SNS, SQS, Glue, and Redshift. You will be responsible for building ETL pipelines, orchestrating workflows, and ensuring data quality and monitoring. Collaboration with teams to translate requirements into actionable solutions is essential. This role offers the opportunity to work in a dynamic environment.
Qualifications
Strong experience with Python and PySpark for large-scale data processing.
Solid SQL skills and familiarity with data modeling and query optimization.
Responsibilities
Build and maintain ETL pipelines using Python and PySpark on AWS Glue.
Orchestrate workflows with AWS Step Functions and serverless components.
Implement messaging and event-driven patterns using AWS SNS and SQS.
Skills
Python
PySpark
AWS Services
SQL
Version Control (Git)
CI/CD
Tools
AWS Glue
AWS Lambda
AWS SNS
AWS SQS
Amazon Redshift
Job description
A technology solutions company in Virginia is seeking an AWS Data Engineer to design, build, and maintain scalable data pipelines and ETL solutions. The ideal candidate will have strong experience with Python/PySpark and AWS services, including Lambda, SNS, SQS, Glue, and Redshift. You will be responsible for building ETL pipelines, orchestrating workflows, and ensuring data quality and monitoring. Collaboration with teams to translate requirements into actionable solutions is essential. This role offers the opportunity to work in a dynamic environment.