Remote Databricks Engineer: Scale Data Pipelines & Lakehouse

BairesDev; Mexico; On-site; PHP 5,474,000 - 9,124,000; Full time

Benefits offered by this job

100% remote work

USD compensation

Hardware provided

Flexible hours

Paid parental leave

Global mentorship

Job summary

At BairesDev, a 15+ year technology leader, we empower a 4,000+ global team to work remotely on impactful roles. As a Databricks Engineer, you will build and maintain data pipelines and analytics on the Databricks Lakehouse, connecting raw data to insights with scalable governance and performance.

You will design scalable pipelines, optimize lakehouse architectures with Delta Lake, and manage notebooks, jobs, and Unity Catalog.

Qualifications

• 4+ years of experience in Data Engineering, Software Engineering, or Database Administration.
• Proven expertise in building data pipelines and analytics solutions on the Databricks Lakehouse platform.
• Proficiency in managing notebooks, jobs, and Unity Catalog governance.
• Hands-on experience with Delta Lake and MLflow for data processing and lifecycle management.
• Advanced proficiency in English.

Responsibilities

• Design and implement scalable data pipelines using Databricks notebooks and automated jobs.
• Build and optimize data lakehouse architectures leveraging Delta Lake for ACID transactions and reliability.
• Manage data governance and security frameworks using Unity Catalog to ensure compliant data access.
• Develop and maintain machine learning lifecycles and experiment tracking using MLflow.
• Collaborate with data scientists and analysts to provide a high-performance platform for advanced analytics.
• Optimize cluster configurations and job execution to ensure cost-effectiveness and system efficiency.

Skills

Databricks Lakehouse

Delta Lake

Unity Catalog governance

MLflow

Data pipelines

English proficiency

Tools

Databricks notebooks

Delta Lake

Unity Catalog

MLflow

Job description

At BairesDev, a 15+ year technology leader, we empower a 4,000+ global team to work remotely on impactful roles. As a Databricks Engineer, you will build and maintain data pipelines and analytics on the Databricks Lakehouse, connecting raw data to insights with scalable governance and performance.

You will design scalable pipelines, optimize lakehouse architectures with Delta Lake, and manage notebooks, jobs, and Unity Catalog.