Senior Spark Data Engineer - Remote, Flexible Hours

BairesDev; Colombia; Remote; COP 324,496,000 - 486,744,000; Full time

Benefits offered by this job

Remote work

USD or local currency compensation

Home office setup

Flexible hours

Parental leave and vacations

Mentorship and growth opportunities

Global multicultural environment

Job summary

BairesDev is seeking a Senior Spark Data Engineer. You will design and build large-scale data processing systems to handle complex batch and streaming workloads.

As a technical anchor, you will ensure that high-throughput data pipelines are scalable, efficient, and robustly engineered. You will design and optimize data pipelines, build scalable data models, and implement workflow orchestration to automate processing schedules.

Qualifications

• 5+ years of experience in Data Engineering, Spark Development, or a related field.
• Proven expertise in Apache Spark, Scala, and Python.
• Strong hands-on experience with ETL/ELT pipeline design and advanced SQL.
• Proficiency in workflow orchestration and cloud data platforms or warehouses.
• Advanced proficiency in English.

Responsibilities

• Design and optimize high-performance data pipelines using distributed computing frameworks.
• Build structured, scalable data models and efficient extraction processes.
• Implement robust workflow orchestration to automate complex processing schedules.
• Ensure data integrity and quality across modern cloud data environments.
• Collaborate with stakeholders to translate complex requirements into reliable data solutions.

Skills

Apache Spark

Scala

Python

SQL

ETL/ELT design

Workflow orchestration

Cloud data platforms

English

Job description

BairesDev is seeking a Senior Spark Data Engineer. You will design and build large-scale data processing systems to handle complex batch and streaming workloads.

As a technical anchor, you will ensure that high-throughput data pipelines are scalable, efficient, and robustly engineered. You will design and optimize data pipelines, build scalable data models, and implement workflow orchestration to automate processing schedules.