Senior Data Engineer - PySpark & Python Pipelines

CIS TECHNOLOGIES INC; Charlotte (NC); On-site; USD 120,000 - 160,000; Full time

Job summary

CIS TECHNOLOGIES INC. is seeking a Senior Data Engineer proficient in PySpark and Python to design and optimize large-scale data pipelines in Charlotte, NC. The role emphasizes building cloud-native workflows using AWS services and writing advanced SQL for ETL tasks.

The ideal candidate will have solid OOP knowledge, strong problem-solving abilities, and excellent collaboration skills to work with data scientists, analysts, and stakeholders.

Qualifications

• Proficiency with PySpark and Python for scalable data transformations.
• Strong SQL skills for complex data extraction, transformation and loading.
• Experience with AWS cloud services (S3, Glue, EMR, Redshift, Lambda).
• Knowledge of object-oriented programming principles and design patterns.
• Experience in data engineering or backend development.

Responsibilities

• Design, develop, and optimise large-scale data pipelines using PySpark and Python.
• Implement best practices in OOP to build reusable, maintainable code.
• Write advanced SQL queries for ETL.
• Collaborate with data scientists, analysts and stakeholders to translate requirements into technical solutions.
• Troubleshoot data issues and ensure timely resolution.
• Leverage AWS cloud services to build and manage cloud-native data workflows.
• Participate in code reviews, data quality checks and performance tuning of data jobs.

Skills

PySpark

Python

SQL

OOP

Kafka

Tools

S3

Glue

EMR

Redshift

Lambda

Job description

CIS TECHNOLOGIES INC. is seeking a Senior Data Engineer proficient in PySpark and Python to design and optimize large-scale data pipelines in Charlotte, NC. The role emphasizes building cloud-native workflows using AWS services and writing advanced SQL for ETL tasks.

The ideal candidate will have solid OOP knowledge, strong problem-solving abilities, and excellent collaboration skills to work with data scientists, analysts, and stakeholders.