Remote Senior Data Engineer - PySpark & Databricks ETL

Truelogic; United States; Remote; USD 120,000 - 170,000; Full time

Benefits offered by this job

Remote work

Competitive USD pay

Paid time off

Autonomy

Work with US clients

Job summary

Truelogic is seeking a Data Engineer with 5–7 years of hands-on experience to join our client’s team. You will design, build, and maintain scalable ETL pipelines for large‑scale data processing using PySpark and Databricks.

You will optimize performance, ensure data quality and governance, and collaborate with engineering and business teams to translate requirements into robust data solutions. This is a 100% remote role with USD pay.

Qualifications

• 5–7 years of hands-on data engineering experience building production-grade solutions.
• Strong proficiency in PySpark and extensive hands-on experience with Databricks.
• Advanced knowledge of Databricks AutoLoader, Python, best practices, performance tuning, and compute cost optimization.
• Deep understanding of end-to-end ETL processes, complex data transformations, and pipeline optimization.
• Exceptional problem-solving skills and the ability to communicate technical concepts clearly across both technical and business teams.

Responsibilities

• Pipeline Architecture: Design, build, and maintain scalable ETL pipelines for large-scale data processing.
• Core Tech Stack: Work extensively with PySpark and Databricks to execute complex data transformations and workflows.
• Optimization & Efficiency: Fine-tune data pipelines to maximize performance, scalability, and cloud cost-efficiency.
• Cross-Functional Collaboration: Partner with engineering and business teams to translate requirements into high-quality data solutions.
• Troubleshooting & Maintenance: Debug, resolve, and prevent complex data processing and pipeline bottlenecks.
• Data Standards: Enforce best practices for data quality, governance, and system performance.

Skills

ETL pipelines

PySpark

Databricks

Python

Data quality

Cost optimization

Communication

Tools

Databricks AutoLoader

Job description

Truelogic is seeking a Data Engineer with 5–7 years of hands-on experience to join our client’s team. You will design, build, and maintain scalable ETL pipelines for large‑scale data processing using PySpark and Databricks.

You will optimize performance, ensure data quality and governance, and collaborate with engineering and business teams to translate requirements into robust data solutions. This is a 100% remote role with USD pay.