Data Engineer

Randstad USA; Charlotte (NC); On-site; USD 83,000 - 90,000; Part time

Job summary

Randstad Digital in Charlotte, NC seeks a data engineer to design and build batch and real-time ETL pipelines using Python and PySpark on AWS. The role focuses on hands-on development with AWS services and relational databases.

You'll contribute to data integration projects, optimize SQL queries, and work in an Agile environment, with standard 8am-5pm hours. This contract role offers engagement in cutting-edge data solutions.

Qualifications

• Hands-on Python and PySpark for scalable ETL/ELT pipelines.
• Production experience with AWS Glue, Lambda, MSK (Kafka), S3, Step Functions, and RDS.
• Deep experience with relational databases (PostgreSQL, SQL Server, Oracle) and advanced SQL programming.
• Solid background in High-Level/Low-Level Design, data mapping specs, and shell/UNIX scripting.

Responsibilities

• Develop batch and real-time ETL data pipelines using Python/PySpark.
• Work with AWS services and REST APIs.
• Implement CI/CD processes and DevOps practices.
• Collaborate in Agile/SCRUM teams.
• Design high/low level data mappings and schemas.

Skills

Python

PySpark

AWS

ETL

Data pipelines

Education

Bachelor's degree

Tools

AWS Glue

AWS Lambda

MSK (Kafka)

S3

Step Functions

RDS

EKS

PostgreSQL

SQL Server

Oracle

Job description

Design and build batch/real-time ETL data pipelines, integrations, and large-scale data solutions using Python/PySpark on AWS.

Location: Charlotte, North Carolina

Job type: Contract

Salary: $60 - 65 per hour

Work hours: 8am to 5pm

Education: Bachelors

Responsibilities

• Developer experience specifically focusing on Data Engineering.
• Hands-on experience in Development using Python and Pyspark as an ETL tool.
• Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
• Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
• Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
• Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
• Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL.
• Experience with data models, data mining, data analysis and data profiling.
• Experience in working with REST API's.
• Experience in workload automation tools like Control-M, Autosys etc.
• Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins.
• Strong experience with Agile/SCRUM methodology.
• Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.).
• Knowledge in MDM, Data warehouse and Data Analytics.

Qualifications

• Core Stack: Hands-on development using Python and PySpark for scalable ETL/ELT pipelines.
• AWS Data Services: Production experience with AWS Glue, Lambda, MSK (Kafka), S3, Step Functions, and RDS.
• Databases & Advanced SQL: Deep experience with relational databases (PostgreSQL, SQL Server, Oracle) and advanced SQL programming (performance tuning, stored procedures, complex queries, data modeling).
• System Design & Linux: Solid background in High-Level/Low-Level Design (HLD/LLD), data mapping specs, and shell/UNIX scripting.

Skills

AWS tools,batch processing,large data,data mining,data extraction,data manipulation,Pyspark,Python,design and development,business value

Equal Opportunity Employer

Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact [e-mail].

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.