Spark Data Engineer - Remote work | REF#306537

BairesDev; Bogotá; Remote; COP 379,687,000 - 569,530,000; Full time

Benefits offered by this job

100% remote

USD or local currency pay

Home setup provided

Flexible hours

Parental leave

Generous vacation

Global team

Mentorship

Job summary

BairesDev is seeking a Spark Data Engineer to design and optimize scalable data pipelines for large-scale datasets. You will connect raw data sources with analytic platforms, ensuring high performance and reliability across our data ecosystem.

You’ll build batch and streaming pipelines using Apache Spark, Databricks, and modern lakehouse technologies, collaborating with global engineering teams. Fluency in English is required.

Qualifications

• 5+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in building and optimizing large-scale data pipelines with Apache Spark.
• Hands-on experience developing analytics and lakehouse solutions on the Databricks platform.
• Strong proficiency in data modeling, transformation, and processing at scale.
• Advanced proficiency in English.

Responsibilities

• Build and maintain scalable batch and streaming data pipelines.
• Optimize processing jobs for maximum performance and cost-efficiency.
• Develop analytics and lakehouse solutions at scale.
• Implement robust data modeling and structural transformations.
• Collaborate with engineering teams to ensure data quality and reliability.

Skills

Apache Spark

Data pipelines

Data modeling

English proficiency

Tools

Databricks

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Spark Data Engineer at BairesDev

As a Spark Data Engineer, you will design and optimize robust data pipelines to handle large-scale datasets. You will connect raw data sources with analytical platforms, ensuring high performance, scalability, and efficiency across the organization's data ecosystem.

What You'll Do

• Build and maintain scalable batch and streaming data pipelines.
• Optimize processing jobs for maximum performance and cost-efficiency.
• Develop advanced analytics and lakehouse solutions at scale.
• Implement robust data modeling and structural transformations.
• Collaborate with engineering teams to ensure data quality and reliability.

What We Are Looking For

• 5+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in building and optimizing large-scale data pipelines using Apache Spark.
• Hands-on experience developing analytics and lakehouse solutions on the Databricks platform.
• Strong proficiency in data modeling, transformation, and processing at scale.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!