Azure Databricks Data Engineer — AI Pipelines (Remote)

BairesDev; Distrito Capital; Remote; VES 52,585,000 - 105,171,000; Full time

Benefits offered by this job

100% remote

USD compensation

Home setup provided

Flexible hours

Parental leave

Diverse team

Mentorship program

Job summary

BairesDev is hiring a Data Engineer to design and implement scalable data pipelines and Lakehouse architectures using Azure Databricks and Python. You will integrate ML/AI solutions and LLM APIs into data workflows to enable automated classification and insights.

The role emphasizes cloud-native architectures, data governance, and collaboration with AI and product teams to deliver high-impact solutions. Remote work is 100% available, with compensation in USD or local currency.

Qualifications

• 4+ years of experience in Data Engineering, ML Engineering, or Software Engineering.
• Experience building data pipelines with Azure Databricks and Python.
• Ability to integrate ML/AI solutions and LLM APIs into data workflows.
• Strong data manipulation, automation, and classification tasks.

Responsibilities

• Design, build, and optimize end-to-end data pipelines and lakehouse architectures on Azure Databricks.
• Integrate LLM APIs and ML models into data streams for automated classification and insights.
• Develop and maintain Python code and SQL procedures for data transformation and ingestion.
• Collaborate with AI and product teams to deliver data-driven solutions and business value.
• Monitor pipeline performance and ensure reliability and scalability in cloud environments.
• Apply data governance and security best practices to the data platform.

Skills

Azure Databricks

Python

LLM APIs

Data pipelines

SQL

English

Cloud architectures

Tools

SQL

Job description

BairesDev is hiring a Data Engineer to design and implement scalable data pipelines and Lakehouse architectures using Azure Databricks and Python. You will integrate ML/AI solutions and LLM APIs into data workflows to enable automated classification and insights.

The role emphasizes cloud-native architectures, data governance, and collaboration with AI and product teams to deliver high-impact solutions. Remote work is 100% available, with compensation in USD or local currency.