Senior Data Engineer (Databricks) - Remote Work | REF#304690

BairesDev; Antioquia; Remote; COP 388,387,000 - 582,581,000; Full time

Benefits offered by this job

Remote 100%

USD or local currency compensation

Hardware provided

Flexible hours

Paid parental leave

National holidays

Mentorship and growth opportunities

Job summary

BairesDev is seeking a Senior Data Engineer (Databricks) to design and optimize scalable data pipelines and lakehouse models. You will ensure data assets are reliable, scalable, and production-ready, serving analytics and operational needs.

In this remote role, you will work with Databricks, Apache Spark, Airflow, and dbt to build robust data products. Fluent English required; 4+ years experience; join a global Top 1% data team.

Qualifications

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable analytics-ready datasets.
• Advanced proficiency in English.

Responsibilities

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark.
• Design durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold).
• Orchestrate data workflows and manage task dependencies with Airflow.
• Transform raw data using dbt and SQL into production-ready data products.
• Optimize pipeline performance and resource usage via partitioning, caching, and tuning.
• Implement data quality checks and automated testing for lakehouse governance.

Skills

Databricks

Apache Spark

Airflow

dbt

SQL

Data modeling

Medallion Architecture

Tools

Databricks

Apache Spark

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Engineer (Databricks) at BairesDev

As a Senior Data Engineer (Databricks), you will design and optimize robust data pipelines and models within lakehouse environments. You will ensure data assets are scalable, reliable, and accessible, acting as a technical anchor to drive analytics and operational excellence.

What You'll Do

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

What We Are Looking For

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable and maintainable analytics-ready datasets.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!