Data Engineer — PySpark, SQL & Cloud Pipelines

TechDigital Group; United States; On-site; USD 80,000 - 120,000; Full time

Job summary

A leading company in the tech industry is seeking a Data Engineer to develop and maintain ETL/ELT pipelines using PySpark and SQL. The role involves working with both structured and unstructured data, optimizing data solutions, and collaborating with cross-functional teams. The ideal candidate will have strong experience in Python, SQL, and cloud platforms, ensuring high-quality data workflows. Join this innovative team to make a significant impact in data engineering.

Qualifications

• Strong experience in Python for data engineering tasks.
• Proficiency in PySpark for large-scale data processing.
• Deep understanding of SQL including optimization.

Responsibilities

• Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL.
• Collaborate with Data Scientists and Analysts to integrate data workflows.
• Ensure data quality, validation, and consistency in data pipelines.

Skills

Python

SQL

PySpark

Tools

AWS

Azure

GCP

Airflow

Git

Job description

A leading company in the tech industry is seeking a Data Engineer to develop and maintain ETL/ELT pipelines using PySpark and SQL. The role involves working with both structured and unstructured data, optimizing data solutions, and collaborating with cross-functional teams. The ideal candidate will have strong experience in Python, SQL, and cloud platforms, ensuring high-quality data workflows. Join this innovative team to make a significant impact in data engineering.