Senior AWS Data Engineer - Scalable Pipelines for Utilities

Scalepex; Plano (TX); Remote; USD 90,000 - 120,000; Full time

Job summary

Scalepex is looking for an experienced AWS Data Engineer based in Plano, Texas, to develop scalable data solutions for top-tier clients. The role involves building and optimizing data pipelines, ensuring compliance and security of sensitive utility data, and collaborating with various stakeholders.

The ideal candidate will need at least 5 years of experience in data engineering, strong skills in AWS services, and proficiency in Python for effective data processing.

Qualifications

• Minimum of 5 years of experience in data engineering.
• Proficiency in AWS services like Step Functions, Lambda, and Glue.
• Strong programming skills in Python and experience with PySpark and Pandas.
• Hands-on experience with distributed systems and scalable architectures.

Responsibilities

• Develop scalable data pipelines using AWS services.
• Orchestrate workflows across data pipelines using AWS Step Functions.
• Implement ETL/ELT processes using PySpark and Python.
• Design data models tailored for utilities use cases.
• Optimize data pipelines for better performance and security.

Skills

AWS services proficiency

Python programming

Data modeling

ETL/ELT processes

Distributed systems expertise

Data security practices

Tools

PySpark

Pandas

AWS Glue

AWS Lambda

AWS Step Functions

AWS Redshift

Job description

Scalepex is looking for an experienced AWS Data Engineer based in Plano, Texas, to develop scalable data solutions for top-tier clients. The role involves building and optimizing data pipelines, ensuring compliance and security of sensitive utility data, and collaborating with various stakeholders.

The ideal candidate will need at least 5 years of experience in data engineering, strong skills in AWS services, and proficiency in Python for effective data processing.