Contract Data Engineer: PySpark/AWS ETL Pipelines

Randstad USA; Charlotte (NC); On-site; USD 83,000 - 90,000; Part time

Job summary

Randstad Digital in Charlotte, NC seeks a data engineer to design and build batch and real-time ETL pipelines using Python and PySpark on AWS. The role focuses on hands-on development with AWS services and relational databases.

You'll contribute to data integration projects, optimize SQL queries, and work in an Agile environment, with standard 8am-5pm hours. This contract role offers engagement in cutting-edge data solutions.

Qualifications

• Hands-on Python and PySpark for scalable ETL/ELT pipelines.
• Production experience with AWS Glue, Lambda, MSK (Kafka), S3, Step Functions, and RDS.
• Deep experience with relational databases (PostgreSQL, SQL Server, Oracle) and advanced SQL programming.
• Solid background in High-Level/Low-Level Design, data mapping specs, and shell/UNIX scripting.

Responsibilities

• Develop batch and real-time ETL data pipelines using Python/PySpark.
• Work with AWS services and REST APIs.
• Implement CI/CD processes and DevOps practices.
• Collaborate in Agile/SCRUM teams.
• Design high/low level data mappings and schemas.

Skills

Python

PySpark

AWS

ETL

Data pipelines

Education

Bachelor's degree

Tools

AWS Glue

AWS Lambda

MSK (Kafka)

S3

Step Functions

RDS

EKS

PostgreSQL

SQL Server

Oracle

Job description

Randstad Digital in Charlotte, NC seeks a data engineer to design and build batch and real-time ETL pipelines using Python and PySpark on AWS. The role focuses on hands-on development with AWS services and relational databases.

You'll contribute to data integration projects, optimize SQL queries, and work in an Agile environment, with standard 8am-5pm hours. This contract role offers engagement in cutting-edge data solutions.