Data Engineer: Azure Databricks and Python - AI Pipelines

BairesDev; Peru (IL); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

100% remote

USD or local currency pay

Home-office hardware & setup

Flexible hours

Paid parental leave

Mentorship and growth opportunities

Job summary

BairesDev is seeking a Data Engineer to design and develop scalable data pipelines using Azure Databricks and Python, with a focus on integrating AI capabilities into data workflows for automated insights.

You will join a global, 100% remote team of top tech talent, enjoy excellent compensation in USD or local currency, flexible hours, home-office setup, parental leave, and clear career development opportunities.

Qualifications

• 4+ years in Data/ML/SWE roles with data engineering focus.
• Experience building pipelines with Azure Databricks and Python.
• Experience integrating ML/AI and LLM APIs into data workflows.
• Strong English communication.

Responsibilities

• Design and optimize end-to-end data pipelines and Lakehouse architectures.
• Integrate LLM APIs and ML models into data streams.
• Develop Python code and SQL procedures for data transformation.
• Collaborate with AI and product teams to deliver data-driven solutions.
• Monitor pipeline performance and ensure reliability.
• Implement data governance and security best practices.

Skills

Azure Databricks

Python

LLM APIs

Data Pipelines

SQL

English proficiency

Job description

BairesDev is seeking a Data Engineer to design and develop scalable data pipelines using Azure Databricks and Python, with a focus on integrating AI capabilities into data workflows for automated insights.

You will join a global, 100% remote team of top tech talent, enjoy excellent compensation in USD or local currency, flexible hours, home-office setup, parental leave, and clear career development opportunities.