Senior AWS Data Engineer — Python, PySpark & Glue

Artifintech; Reston (VA); On-site; USD 120,000 - 160,000; Full time

Job summary

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC seeks an experienced data engineer to build and maintain ETL pipelines using Python and PySpark on AWS Glue and other compute platforms. You will orchestrate workflows with Step Functions, implement event-driven patterns with SNS/SQS, and design data stores in Redshift.

Strong SQL skills and CI/CD mindset required. You will collaborate with data consumers and engineers to translate requirements into scalable solutions, ensure data quality, monitoring, and

Qualifications

• Strong experience with Python and PySpark for large-scale data processing.
• Hands-on experience with AWS services: Lambda, SNS, SQS, Glue, Redshift, Step Functions.
• Solid SQL skills and familiarity with data modeling and query optimization.
• Experience with ETL best practices, data quality checks, and monitoring/alerting.
• Familiarity with version control (Git) and basic DevOps/CI-CD workflows.

Responsibilities

• Build and maintain ETL pipelines using Python and PySpark on AWS Glue and other compute platforms.
• Orchestrate workflows with AWS Step Functions and serverless components (Lambda).
• Implement messaging and event-driven patterns using AWS SNS and SQS.
• Design and optimize data storage and querying in Amazon Redshift.
• Write performant SQL for data transformations, validation, and reporting.
• Ensure data quality, monitoring, error handling and operational support for pipelines.
• Collaborate with data consumers, engineers, and stakeholders to translate requirements into solutions.
• Contribute to CI/CD, infrastructure-as-code, and documentation for reproducible deployments.

Skills

Python

PySpark

SQL

Data modeling

DevOps/CI-CD

Tools

AWS Lambda

AWS SNS

AWS SQS

AWS Glue

Amazon Redshift

AWS Step Functions

Job description

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC seeks an experienced data engineer to build and maintain ETL pipelines using Python and PySpark on AWS Glue and other compute platforms. You will orchestrate workflows with Step Functions, implement event-driven patterns with SNS/SQS, and design data stores in Redshift.

Strong SQL skills and CI/CD mindset required. You will collaborate with data consumers and engineers to translate requirements into scalable solutions, ensure data quality, monitoring, and