PySpark Data Engineer — Pipelines & Databricks (6-mo Contract)

RemoDevs; United States; Remote; USD 110,000 - 150,000; Full time

Job summary

RemoDevs is seeking a Mid Data Engineer to develop and maintain data pipelines using PySpark, with hands-on Databricks experience. The role focuses on large-scale data processing, optimization and reliable data delivery in a fast-paced project environment.

You will work on building ETL/ELT data pipelines, transforming data, and writing efficient SQL while collaborating with a team of engineers and stakeholders across data platforms.

Qualifications

• Hands-on PySpark experience required.
• Commercial data engineering experience, mid-level.
• Strong SQL and data transformation skills.
• Experience with ETL/ELT pipelines.
• Familiarity with cloud environments (Azure/AWS/GCP).

Responsibilities

• Develop and maintain data pipelines using PySpark and Apache Spark.
• Build and optimize data transformation processes for large datasets.
• Integrate data from multiple sources and ensure reliable data processing.
• Write and optimize SQL queries.
• Work with Databricks to run data processing workloads.
• Troubleshoot pipelines and improve performance.
• Implement data quality checks and reliable data delivery.
• Collaborate with engineers and stakeholders on data tasks.

Skills

PySpark

SQL

Python

ETL/ELT

Data pipelines

Distributed data processing

Tools

Databricks

Delta Lake

Azure

AWS

GCP

Job description

RemoDevs is seeking a Mid Data Engineer to develop and maintain data pipelines using PySpark, with hands-on Databricks experience. The role focuses on large-scale data processing, optimization and reliable data delivery in a fast-paced project environment.

You will work on building ETL/ELT data pipelines, transforming data, and writing efficient SQL while collaborating with a team of engineers and stakeholders across data platforms.