Senior Data Engineer (Databricks) - Remote Work | REF#304691

BairesDev; Colombia; À distance; COP 382 153 000 - 509 538 000; Plein temps

Avantages offerts par ce poste

Remote work

Competitive USD salary

Home office setup

Flexible hours

Parental leave

Mentorship & growth

Résumé du poste

BairesDev is seeking a Senior Data Engineer (Databricks) to join our global remote team. You will architect and optimize scalable ETL/ELT pipelines, build durable data models, and ensure data quality within a lakehouse architecture using Databricks, Airflow, and dbt.

You’ll collaborate across teams, own end-to-end data workflows, and help deliver production-ready analytics datasets. This role offers 100% remote work, flexible hours, and competitive USD compensation.

Qualifications

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable and maintainable analytics-ready datasets.
• Advanced proficiency in English.

Responsabilités

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

Connaissances

Databricks lakehouse

Airflow orchestration

dbt modeling

SQL querying

Data modeling

Data pipelines design

English proficiency

Outils

Databricks

Airflow

dbt

SQL

Description du poste

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Engineer (Databricks) at BairesDev

What You’ll Do

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

What We Are Looking For

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable and maintainable analytics-ready datasets.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred.
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!