Senior Databricks Data Engineer - Remote, Flexible Hours

BairesDev; Colombia; Remote; COP 388,387,000 - 582,581,000; Full time

Benefits offered by this job

100% remote work

Competitive USD compensation

Flexible hours

Global mentorship and growth

Job summary

BairesDev is hiring a Senior Data Engineer (Databricks) for a fully remote role. You will design and optimize scalable data pipelines in Databricks lakehouse environments, ensuring data assets are reliable and production-ready.

You will build scalable data models, orchestrate workflows with Airflow, and transform data with dbt and SQL. Expect strong collaboration across a global Top 1% talent network and flexible hours, with compensation offered in USD or local currency.

Qualifications

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.

Responsibilities

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

Skills

Databricks lakehouse

Airflow

dbt

SQL

ETL/ELT design

English proficiency

Tools

Databricks

Apache Spark

Airflow

Job description

BairesDev is hiring a Senior Data Engineer (Databricks) for a fully remote role. You will design and optimize scalable data pipelines in Databricks lakehouse environments, ensuring data assets are reliable and production-ready.

You will build scalable data models, orchestrate workflows with Airflow, and transform data with dbt and SQL. Expect strong collaboration across a global Top 1% talent network and flexible hours, with compensation offered in USD or local currency.