Senior AWS Python Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Reston (VA); On-site; USD 90,000 - 120,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Sr AWS Python Developer in Reston, VA. The role involves building and maintaining ETL pipelines using Python and PySpark on AWS Glue, orchestrating workflows with AWS Step Functions, and implementing messaging patterns with AWS services.

The ideal candidate will have strong experience with Python, PySpark, and various AWS services including Lambda, SNS, SQS, Glue, and Redshift. This position offers a duration of 21 months with the potential for extension.

Qualifications

• Strong experience with Python and PySpark for large-scale data processing.
• Proven hands-on experience with AWS services: Lambda, SNS, SQS, Glue, Redshift, Step Functions.
• Solid SQL skills and familiarity with data modeling and query optimization.

Responsibilities

• Build and maintain ETL pipelines using Python and PySpark on AWS Glue and other compute platforms.
• Orchestrate workflows with AWS Step Functions and serverless components (Lambda).
• Implement messaging and event-driven patterns using AWS SNS and SQS.
• Design and optimize data storage and querying in Amazon Redshift.

Skills

Python

PySpark

AWS Lambda

AWS SNS

AWS SQS

AWS Glue

AWS Redshift

SQL

Version Control (Git)

DevOps/CI-CD

Job description

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Sr AWS Python Developer in Reston, VA. The role involves building and maintaining ETL pipelines using Python and PySpark on AWS Glue, orchestrating workflows with AWS Step Functions, and implementing messaging patterns with AWS services.

The ideal candidate will have strong experience with Python, PySpark, and various AWS services including Lambda, SNS, SQS, Glue, and Redshift. This position offers a duration of 21 months with the potential for extension.