Data Engineer - PySpark & AWS Cloud Pipelines

SDLC Technologies

Charlotte (NC)

On-site

USD 90,000 - 150,000

Full time

3 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

SDLC Technologies in Charlotte, NC is seeking a data engineer/backend developer to design and optimise large-scale data pipelines using PySpark and Python. You will work with data scientists and analysts to translate requirements into robust, scalable solutions running on AWS services.

Responsibilities include troubleshooting issues, performing data quality checks, and tuning job performance. The role emphasizes strong SQL skills, OOP fundamentals, and teamwork to deliver reliable data workflows

Qualifications

Hands-on experience in data engineering or backend development.
Experience with AWS ecosystem (S3, Glue, EMR, Redshift, Lambda) and Kafka.
Proficiency in PySpark and Python for scalable data transformations.
Strong understanding of OOP principles and design patterns.
Proficient SQL in writing complex queries and optimizing performance.
Strong problem-solving and independent troubleshooting skills.
Excellent communication and collaboration abilities.

Responsibilities

Design, develop, and optimise large-scale data pipelines.
Collaborate with data scientists, analysts, and stakeholders to gather requirements.
Troubleshoot data issues and ensure timely resolutions.
Conduct code reviews and data quality checks.
Tune performance of data jobs and manage cloud-native workflows.