Remote Data Engineer — Azure Databricks & AI Pipelines

BairesDev; United States; Remote; CLP 87,891,000 - 126,953,000; Full time

Benefits offered by this job

100% remote work

USD or local currency compensation

Hardware provided for home setup

Flexible hours

Paid parental leave and vacations

Mentorship and growth opportunities

Job summary

BairesDev is hiring a Data Engineer to design and develop scalable data pipelines using Azure Databricks and Python, with AI integration to automate classification tasks. You will work with AI and product teams to deliver data-driven solutions across distributed cloud environments.

The role emphasizes data governance, security, and high-quality code, while offering flexible hours and remote work from anywhere. Strong English required and 4+ years of experience are preferred.

Qualifications

• 4+ years of experience in Data Engineering, ML Engineering, or Software Engineering.
• Proven expertise in developing data pipelines using Azure Databricks and Python.
• Experience integrating ML/AI solutions and LLM APIs into automated data workflows.
• Strong background in data manipulation, automation, and supporting classification tasks.
• Deep understanding of cloud-native data architectures and AI integration patterns.
• Advanced proficiency in English.

Responsibilities

• Design, build, and optimize end-to-end data pipelines and Lakehouse architectures using Azure Databricks.
• Integrate LLM APIs and machine learning models into data processing streams to support automated classification and insights.
• Develop and maintain high-quality Python code and SQL procedures to ensure efficient data transformation and ingestion.
• Collaborate with AI and product teams to implement data-driven solutions that drive significant business value.
• Monitor and troubleshoot pipeline performance, ensuring reliability and scalability across distributed cloud environments.
• Implement data governance and security best practices to maintain the integrity and compliance of the data platform.

Skills

Azure Databricks

Python

LLM APIs

Machine Learning

SQL

Tools

Azure Databricks

SQL

Job description

BairesDev is hiring a Data Engineer to design and develop scalable data pipelines using Azure Databricks and Python, with AI integration to automate classification tasks. You will work with AI and product teams to deliver data-driven solutions across distributed cloud environments.

The role emphasizes data governance, security, and high-quality code, while offering flexible hours and remote work from anywhere. Strong English required and 4+ years of experience are preferred.