Senior AWS-Python Data Engineer (PySpark) - Hybrid NJ

Polarits; Newark (NJ); Hybrid; USD 140,000 - 180,000; Full time

Job summary

Polarits in New Jersey is seeking an experienced Python Developer with strong AWS and PySpark skills to join our data engineering team. This backfill role requires hands-on experience building scalable data pipelines, processing large datasets, and integrating with cloud environments.

The ideal candidate has 10+ years of software development experience using Python, plus extensive ETL and data pipeline experience and familiarity with distributed data processing frameworks.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• 10+ years of experience in software development with a strong focus on Python.
• Hands-on PySpark experience for distributed data processing and AWS services.

Responsibilities

• Design, develop, and maintain data pipelines and ETL workflows using Python, PySpark, and AWS.
• Build and optimize large-scale data processing and data transformation solutions.
• Integrate various data sources and ensure data quality, performance, and reliability.
• Collaborate with data engineers, analysts, and architects to deliver end-to-end data solutions.
• Implement best practices for code optimization, error handling, and data validation.
• Participate in code reviews, documentation, and deployment automation.
• Ensure adherence to data security and compliance standards.

Skills

Python

PySpark

AWS

Data pipelines

SQL

Distributed data processing

Education

Bachelor's degree in Computer Science, Data Engineering, or related field

Tools

Airflow

Databricks

Git

Docker

Kubernetes

Job description

Polarits in New Jersey is seeking an experienced Python Developer with strong AWS and PySpark skills to join our data engineering team. This backfill role requires hands-on experience building scalable data pipelines, processing large datasets, and integrating with cloud environments.

The ideal candidate has 10+ years of software development experience using Python, plus extensive ETL and data pipeline experience and familiarity with distributed data processing frameworks.