Data Engineer - PySpark & AWS ETL Architect

Talentify; Charlotte (NC); On-site; USD 95,000 - 125,000; Full time

Job summary

Talentify is seeking a Data Engineer in Charlotte, NC for a 12-month contract. You will design and implement data integration pipelines using Python and PySpark, leveraging AWS services such as Glue, Lambda, and S3. Collaboration with developers and business teams will drive scalable data solutions.

The role requires experienc e in SQL, REST APIs, and CI/CD workflows with GitHub/Jenkins, following Agile/SCRUM practices to deliver high-quality data platforms and analytics capabilities.

Qualifications

• Proficient in Python and PySpark for ETL development.
• Strong understanding of AWS services (Glue, Lambda, S3, MSK, RDS, EKS).
• Experience with SQL databases and query tuning.
• Experience with REST APIs and data integration.
• Familiar with GitHub/Jenkins for CI/CD workflows.
• Knowledge of Agile/SCRUM practices.
• Exposure to external ETL tools (DataStage, Informatica, Pentaho).
• Understanding of data warehousing, MDM, and analytics.

Responsibilities

• Design and develop ETL pipelines for large data domains.
• Collaborate with developers and business areas to implement data solutions.
• Estimate, plan, and deliver data integration projects.
• Build and maintain data pipelines using Python and PySpark.
• Document technical designs and present solutions to clients.
• Manage risks and resolve issues in development and production.
• Coordinate vendors/contractors on projects.
• Adhere to SDLC and quality assurance practices.

Tools

Python (ETL)

PySpark

AWS

SQL

REST APIs

CI/CD (GitHub/Jenkins)

Unix scripting

Data Modeling

Job description

Talentify is seeking a Data Engineer in Charlotte, NC for a 12-month contract. You will design and implement data integration pipelines using Python and PySpark, leveraging AWS services such as Glue, Lambda, and S3. Collaboration with developers and business teams will drive scalable data solutions.

The role requires experienc e in SQL, REST APIs, and CI/CD workflows with GitHub/Jenkins, following Agile/SCRUM practices to deliver high-quality data platforms and analytics capabilities.