Data Engineer - Azure Databricks & AI Pipelines (Remote)

BairesDev; Montes de María; Remote; COP 291,290,000 - 420,753,000; Full time

Benefits offered by this job

100% remote work

Competitive USD compensation or local

Home office setup provided

Flexible hours

Paid parental leaves, vacations, and"

Job summary

BairesDev is seeking a Data Engineer to design scalable data pipelines and Lakehouse architectures on Azure Databricks, and to integrate AI capabilities into data workflows using Python.

You will collaborate with AI and product teams to deliver data-driven solutions, ensure pipeline reliability, and implement governance across cloud environments. This role offers 100% remote work and competitive USD compensation.

Qualifications

• 4+ years of experience in Data Engineering, Machine Learning Engineering, or Software Engineering.
• Proven expertise in developing and optimizing data pipelines using Azure Databricks and Python.
• Proficiency in integrating ML/AI solutions and LLM APIs into automated data workflows.
• Strong background in data manipulation, automation, and supporting classification tasks.
• Deep understanding of cloud-native data architectures and AI integration patterns.
• Advanced proficiency in English.

Responsibilities

• Design, build, and optimize end-to-end data pipelines and Lakehouse architectures using Azure Databricks.
• Integrate LLM APIs and machine learning models into data processing streams to support automated classification and insights.
• Develop and maintain high-quality Python code and SQL procedures to ensure efficient data transformation and ingestion.
• Collaborate with AI and product teams to implement data-driven solutions that drive significant business value.
• Monitor and troubleshoot pipeline performance, ensuring reliability and scalability across distributed cloud environments.
• Implement data governance and security best practices to maintain the integrity and compliance of the data platform.

Skills

Azure Databricks

Python

Data pipelines

ML/AI integration

English proficiency

Tools

LLM APIs

SQL

Job description

BairesDev is seeking a Data Engineer to design scalable data pipelines and Lakehouse architectures on Azure Databricks, and to integrate AI capabilities into data workflows using Python.

You will collaborate with AI and product teams to deliver data-driven solutions, ensure pipeline reliability, and implement governance across cloud environments. This role offers 100% remote work and competitive USD compensation.