Senior Spark Data Engineer - Remote Work | REF#308801

BairesDev; Colombia; Remote; COP 324,496,000 - 486,744,000; Full time

Benefits offered by this job

Remote work

USD or local currency compensation

Home office setup

Flexible hours

Parental leave and vacations

Mentorship and growth opportunities

Global multicultural environment

Job summary

BairesDev is seeking a Senior Spark Data Engineer. You will design and build large-scale data processing systems to handle complex batch and streaming workloads.

As a technical anchor, you will ensure that high-throughput data pipelines are scalable, efficient, and robustly engineered. You will design and optimize data pipelines, build scalable data models, and implement workflow orchestration to automate processing schedules.

Qualifications

• 5+ years of experience in Data Engineering, Spark Development, or a related field.
• Proven expertise in Apache Spark, Scala, and Python.
• Strong hands-on experience with ETL/ELT pipeline design and advanced SQL.
• Proficiency in workflow orchestration and cloud data platforms or warehouses.
• Advanced proficiency in English.

Responsibilities

• Design and optimize high-performance data pipelines using distributed computing frameworks.
• Build structured, scalable data models and efficient extraction processes.
• Implement robust workflow orchestration to automate complex processing schedules.
• Ensure data integrity and quality across modern cloud data environments.
• Collaborate with stakeholders to translate complex requirements into reliable data solutions.

Skills

Apache Spark

Scala

Python

SQL

ETL/ELT design

Workflow orchestration

Cloud data platforms

English

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Spark Data Engineer at BairesDev

As a Senior Spark Data Engineer, you will design and build large-scale data processing systems to handle complex batch and streaming workloads. You will serve as a key technical anchor, ensuring that our high-throughput data pipelines are scalable, efficient, and robustly engineered.

What You'll Do

• Design and optimize high-performance data pipelines using distributed computing frameworks.
• Build structured, scalable data models and efficient extraction processes.
• Implement robust workflow orchestration to automate complex processing schedules.
• Ensure data integrity and quality across modern cloud data environments.
• Collaborate with stakeholders to translate complex requirements into reliable data solutions.

What We Are Looking For

• 5+ years of experience in Data Engineering, Spark Development, or a related field.
• Proven expertise in Apache Spark, Scala, and Python.
• Strong hands-on experience with ETL/ELT pipeline design and advanced SQL.
• Proficiency in workflow orchestration and cloud data platforms or warehouses.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!