Remote Senior Data Engineer - PySpark & Databricks

Truelogic; New York (NY); Hybrid; MXN 2,195,000 - 2,927,000; Full time

Benefits offered by this job

Remote work from anywhere

USD pay

Paid time off

Autonomy

Work with U.S. companies

Job summary

Truelogic is seeking a Data Engineer with 5–7 years of hands-on experience to join our client’s team. You will design and optimize ETL pipelines, transform data, and ensure scalable, fault-tolerant workflows using PySpark and Databricks.

You will collaborate with cross-functional teams, implement best practices for data quality, governance, and performance, and help reduce cloud costs while delivering timely data to business users across initiatives.

Qualifications

• 5–7 years hands-on data engineering experience.
• Proficiency in PySpark and Databricks.
• Databricks AutoLoader and Python expertise.
• End-to-end ETL processes and pipeline optimization knowledge.
• Strong communication across technical and business teams.

Responsibilities

• Design, build, and maintain scalable ETL pipelines for large-scale data processing.
• Utilize PySpark and Databricks for complex data transformations.
• Tune pipelines for performance, scalability, and cost efficiency.
• Collaborate with engineering and business teams to translate requirements.
• Troubleshoot and maintain data processing pipelines.
• Enforce data quality, governance, and system performance standards.

Skills

ETL design

Data transformations

Performance tuning

Cost optimization

Cross-functional collaboration

Tools

PySpark

Databricks

Databricks AutoLoader

Python

Job description

Truelogic is seeking a Data Engineer with 5–7 years of hands-on experience to join our client’s team. You will design and optimize ETL pipelines, transform data, and ensure scalable, fault-tolerant workflows using PySpark and Databricks.

You will collaborate with cross-functional teams, implement best practices for data quality, governance, and performance, and help reduce cloud costs while delivering timely data to business users across initiatives.