Remote Data Engineer: Azure Databricks & AI Pipelines

BairesDev; Bogotá ciudad; Remote; COP 287,825,000 - 447,728,000; Full time

Benefits offered by this job

Remote work

Competitive USD salary

Home office setup

Flexible hours

Parental leave & holidays

Global team & mentorship

Job summary

BairesDev is seeking a Data Engineer to design and build scalable data pipelines and Lakehouse architectures using Azure Databricks and Python. You will help integrate AI capabilities into data workflows, enabling complex data processing and automated classification.

The role requires 4+ years in data/ML/engineering, strong ML/AI experience, and excellent English. Enjoy 100% remote work, flexible hours, and competitive compensation in USD or local currency.

Qualifications

• 4+ years of experience in Data/ML/Software Engineering.
• Experience with Azure Databricks and Python for building data pipelines.
• Experience integrating ML/AI solutions and LLM APIs into automated data workflows.
• Strong data manipulation, automation, and data classification support.
• Deep understanding of cloud-native data architectures and AI integration patterns.
• Advanced proficiency in English.

Responsibilities

• Design, build, and optimize end-to-end data pipelines and Lakehouse architectures using Azure Databricks.
• Integrate LLM APIs and ML models into data processing streams for automated classification and insights.
• Develop and maintain high-quality Python code and SQL procedures for data transformation and ingestion.
• Collaborate with AI and product teams to implement data-driven solutions delivering business value.
• Monitor pipeline performance and ensure reliability and scalability across distributed cloud environments.
• Implement data governance and security best practices to maintain data integrity.

Skills

Azure Databricks

Python

ML/AI integration

LLM APIs

Data pipelines

English proficiency

Cloud-native architectures

Job description

BairesDev is seeking a Data Engineer to design and build scalable data pipelines and Lakehouse architectures using Azure Databricks and Python. You will help integrate AI capabilities into data workflows, enabling complex data processing and automated classification.

The role requires 4+ years in data/ML/engineering, strong ML/AI experience, and excellent English. Enjoy 100% remote work, flexible hours, and competitive compensation in USD or local currency.