Data Engineer

Randstad Digital

Charlotte (NC)

On-site

USD 83,000 - 90,000

Part time

12 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical
Prescription coverage
Dental
Vision
AD&D
Life insurance
Short-term disability
401K plan

Job summary

Randstad Digital in Charlotte, NC seeks a data engineer to design and build batch and real-time ETL pipelines using Python and PySpark on AWS. This contract role offers 8am–5pm with competitive hourly pay.

You will work with AWS data services (Glue, Lambda, S3, RDS), relational databases, and modern CI/CD tooling in an Agile/SCRUM environment. Strong SQL and data modeling skills are required.

Qualifications

  • Hands-on development of batch/real-time ETL pipelines with Python and PySpark.
  • Experience with AWS data services (Glue, Lambda, S3, RDS).
  • Strong SQL with performance tuning and data modeling.
  • Experience with CI/CD and Agile/SCRUM.

Responsibilities

  • Design and build batch/real-time ETL data pipelines, integrations using Python/PySpark on AWS.
  • Develop with SQL databases and data warehousing concepts.
  • Collaborate in an Agile/SCRUM environment and design mappings.
  • Work with REST APIs and data modeling to support analytics.

Skills

Python
PySpark
AWS
SQL
Unix scripting
ETL
REST APIs
CI/CD

Education

Bachelor's degree

Tools

AWS Glue
AWS Lambda
MSK (Kafka)
S3
Step Functions
RDS
EKS
PostgreSQL
SQL Server
Oracle
Control-M
Autosys
Bitbucket
GitHub
Jenkins
DataStage
Informatica
Pentaho

Job description

Job summary: Design and build batch/real-time ETL data pipelines, integrations, and large-scale data solutions using Python/PySpark on AWS.

Location: Charlotte, North Carolina

Job type: Contract

Salary: $60 - 65 per hour

Work hours: 8am to 5pm

Education: Bachelors

Responsibilities
  • Developer experience specifically focusing on Data Engineering.
  • Hands-on experience in Development using Python and Pyspark as an ETL tool.
  • Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
  • Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
  • Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
  • Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
  • Knowledge in developing UNIX scripts, Oracle SQL/PL‑SQL.
  • Experience with data models, data mining, data analysis and data profiling.
  • Experience in working with REST API's.
  • Experience with workload automation tools like Control-M, Autosys etc.
  • Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins.
  • Strong experience with Agile/SCRUM methodology.
  • Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.).
  • Knowledge in MDM, Data warehouse and Data Analytics.
Qualifications
  • Core Stack: Hands-on development using Python and PySpark for scalable ETL/ELT pipelines.
  • AWS Data Services: Production experience with AWS Glue, Lambda, MSK (Kafka), S3, Step Functions, and RDS.
  • Databases & Advanced SQL: Deep experience with relational databases (PostgreSQL, SQL Server, Oracle) and advanced SQL programming (performance tuning, stored procedures, complex queries, data modeling).
  • System Design & Linux: Solid background in High-Level/Low-Level Design (HLD/LLD), data mapping specs, and shell/UNIX scripting.
Skills
  • AWS tools,batch processing,large data,data mining,data extraction,data manipulation,Pyspark,Python,design and development,business value
Equal Opportunity Employer

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants.

If you require a reasonable accommodation to make your application or interview experience a great one, please contact Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc.

Benefits
  • medical
  • prescription
  • dental
  • vision
  • AD&D
  • life insurance offerings
  • short-term disability
  • 401K plan (all benefits are based on eligibility)

This posting is open for thirty (30) days.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Randstad USA • Charlotte (NC)

On-site
USD 83,000 - 90,000
Data Engineer
Data Engineer

Randstad Digital • Arlington (VA)

On-site
USD 66,000 - 72,000
Data Engineer
Data Engineer

Randstad Digital • Smithfield (RI)

On-site
USD 95,000 - 96,000
Medical insurance
Dental insurance
Vision insurance
+4
Data Engineer - Python/PySpark on AWS ETL
Data Engineer - Python/PySpark on AWS ETL

Randstad Digital • Charlotte (NC)

On-site
USD 83,000 - 90,000
Medical
Prescription coverage
Dental
+5
Data Engineer Sr Specialized
Data Engineer Sr Specialized

Randstad Digital • United States

Remote
USD 92,000 - 106,000
Medical
Prescription
Dental
+5
Data Engineer
Data Engineer

Randstad USA • Atlanta (GA)

On-site
USD 76,000 - 85,000
Medical benefits
Dental benefits
Vision benefits
+3
Data Engineer
Data Engineer

Eliassen Group • United States

Remote
USD 69,000 - 79,000
Medical, Dental, Vision
401k with company matching
Life insurance
Contract Data Engineer: PySpark/AWS ETL Pipelines
Contract Data Engineer: PySpark/AWS ETL Pipelines

Randstad USA • Charlotte (NC)

On-site
USD 83,000 - 90,000
Data Engineer - iGrid
Data Engineer - iGrid

Primary Talent Partners • Charlotte (NC)

On-site
USD 121,000 - 135,000
Data Engineer Sr Specialized
Data Engineer Sr Specialized

Randstad Digital Americas • Cleveland (OH)

Remote
USD 92,000 - 106,000