Remote Spark Data Engineer — Scale Big Data Pipelines

BairesDev; Bogotá; Remote; COP 379,687,000 - 569,530,000; Full time

Benefits offered by this job

100% remote

USD or local currency pay

Home setup provided

Flexible hours

Parental leave

Generous vacation

Global team

Mentorship

Job summary

BairesDev is seeking a Spark Data Engineer to design and optimize scalable data pipelines for large-scale datasets. You will connect raw data sources with analytic platforms, ensuring high performance and reliability across our data ecosystem.

You’ll build batch and streaming pipelines using Apache Spark, Databricks, and modern lakehouse technologies, collaborating with global engineering teams. Fluency in English is required.

Qualifications

• 5+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in building and optimizing large-scale data pipelines with Apache Spark.
• Hands-on experience developing analytics and lakehouse solutions on the Databricks platform.
• Strong proficiency in data modeling, transformation, and processing at scale.
• Advanced proficiency in English.

Responsibilities

• Build and maintain scalable batch and streaming data pipelines.
• Optimize processing jobs for maximum performance and cost-efficiency.
• Develop analytics and lakehouse solutions at scale.
• Implement robust data modeling and structural transformations.
• Collaborate with engineering teams to ensure data quality and reliability.

Skills

Apache Spark

Data pipelines

Data modeling

English proficiency

Tools

Databricks

Job description

BairesDev is seeking a Spark Data Engineer to design and optimize scalable data pipelines for large-scale datasets. You will connect raw data sources with analytic platforms, ensuring high performance and reliability across our data ecosystem.

You’ll build batch and streaming pipelines using Apache Spark, Databricks, and modern lakehouse technologies, collaborating with global engineering teams. Fluency in English is required.