Senior Data Engineer: Pipelines & Spark (Remote)

BairesDev; Mexico; On-site; PHP 5,474,000 - 9,124,000; Full time

Benefits offered by this job

100% remote

USD payments

Home office setup

Job summary

BairesDev is a remote-first technology company delivering data-driven solutions to global clients. We are seeking a Software Engineer (Data) to build and maintain large-scale batch and streaming pipelines that power analytics and insights.

You will work with Python, PySpark, Spark internals, and data lake technologies like Delta Lake or Iceberg, ensuring data quality, reliability, and scalable data architectures across cloud environments. This is a 100% remote role with global collaboration.

Qualifications

• 4+ years of software engineering with a focus on data engineering.
• Proven experience building large-scale data pipelines using Python and SQL.
• Strong hands-on experience with Apache Spark and PySpark.

Responsibilities

• Design and develop scalable data pipelines using Python and PySpark.
• Optimize Spark jobs for performance and cost-efficiency.
• Implement data storage with Delta Lake or Iceberg for reliable lakes.
• Orchestrate workflows with Airflow or similar tools.
• Write efficient SQL for transformations across cloud environments.
• Collaborate with teams to ensure data quality and availability at scale.

Skills

Python

SQL

Spark

Airflow

English

Tools

Delta Lake

Apache Iceberg

Job description

BairesDev is a remote-first technology company delivering data-driven solutions to global clients. We are seeking a Software Engineer (Data) to build and maintain large-scale batch and streaming pipelines that power analytics and insights.

You will work with Python, PySpark, Spark internals, and data lake technologies like Delta Lake or Iceberg, ensuring data quality, reliability, and scalable data architectures across cloud environments. This is a 100% remote role with global collaboration.