Databricks Data Engineer — Remote, Flexible Hours

BairesDev; Bogotá; Remote; COP 264,122,000 - 396,183,000; Full time

Benefits offered by this job

Remote work

USD payments

Home setup for work from home

Flexible hours

Parental leave

Vacations and holidays

Job summary

BairesDev is seeking a Data Engineer (Databricks) to design and optimize end-to-end data pipelines, leveraging Databricks, PySpark, and SQL. You will work on Bronze-Silver-Gold lakehouse architectures, ensuring data quality and scalable production deployments.

The role emphasizes collaboration with data scientists and analysts, maintaining data integrity, and enabling advanced analytics and ML workloads. 100% remote with flexible hours and USD or local currency compensation.

Qualifications

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in developing and optimizing data pipelines using Databricks and PySpark.
• Strong proficiency in SQL and experience with data warehousing concepts.
• Hands-on experience building and maintaining data lakehouse architectures.
• Deep understanding of ETL/ELT processes and large-scale data transformations.
• Advanced proficiency in English.

Responsibilities

• Design and implement end-to-end ETL pipelines using PySpark and SQL within the Databricks platform.
• Build and optimize data transformations following the Medallion Architecture to create high-quality Bronze, Silver, and Gold layers.
• Develop declarative pipelines and manage complex orchestration workflows to ensure reliable production deployments.
• Collaborate with data scientists and analysts to provide clean, structured data for advanced analytics and machine learning workloads.
• Ensure data integrity and performance through proactive monitoring, schema enforcement, and automated data quality checks.
• Maintain and scale lakehouse environments to handle diverse structured and unstructured datasets efficiently.

Skills

Data engineering

Software engineering

ETL/ELT design

English proficiency

Big data pipelines

PySpark

Tools

Databricks

PySpark

SQL

Data warehousing

Job description

BairesDev is seeking a Data Engineer (Databricks) to design and optimize end-to-end data pipelines, leveraging Databricks, PySpark, and SQL. You will work on Bronze-Silver-Gold lakehouse architectures, ensuring data quality and scalable production deployments.

The role emphasizes collaboration with data scientists and analysts, maintaining data integrity, and enabling advanced analytics and ML workloads. 100% remote with flexible hours and USD or local currency compensation.