Senior Data Engineer: PySpark & Databricks, Remote

Truelogic; United States; Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Remote work

USD pay

Paid time off

Autonomy

Work with U.S. companies

Job summary

Truelogic is seeking a skilled Data Engineer with 5–7 years of hands-on experience to join a nearshore team delivering data solutions. You will design scalable ETL pipelines, optimize performance, and collaborate across tech and business units in a fully remote capacity.

The role emphasizes PySpark and Databricks proficiency, strong problem-solving, and clear communication to deliver high‑quality data systems for US clients.

Qualifications

• 5–7 years of hands-on data engineering experience building production-grade solutions.
• Strong proficiency in PySpark and extensive hands-on experience with Databricks.
• Advanced knowledge of Databricks AutoLoader, Python, performance tuning, and compute cost optimization.
• Deep understanding of end-to-end ETL processes, complex data transformations, and pipeline optimization.
• Exceptional problem-solving skills and the ability to communicate technical concepts clearly across teams.

Responsibilities

• Pipeline Architecture: Design, build, and maintain scalable ETL pipelines for large-scale data processing.
• Core Tech Stack: Work extensively with PySpark and Databricks to execute complex data transformations and workflows.
• Optimization & Efficiency: Fine-tune data pipelines to maximize performance, scalability, and cloud cost-efficiency.
• Cross-Functional Collaboration: Partner with engineering and business teams to translate requirements into high-quality data solutions.
• Troubleshooting & Maintenance: Debug, resolve, and prevent complex data processing and pipeline bottlenecks.
• Data Standards: Enforce best practices for data quality, governance, and system performance.

Skills

PySpark

Databricks

Python

ETL pipelines

Data transformations

Tools

Databricks AutoLoader

Job description

Truelogic is seeking a skilled Data Engineer with 5–7 years of hands-on experience to join a nearshore team delivering data solutions. You will design scalable ETL pipelines, optimize performance, and collaborate across tech and business units in a fully remote capacity.

The role emphasizes PySpark and Databricks proficiency, strong problem-solving, and clear communication to deliver high‑quality data systems for US clients.