Remote Data Engineer | Azure Databricks & AI Pipelines

BairesDev; Antioquia; Presencial; COP 277.675.000 - 370.233.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work

USD payments

Hardware provided

Flexible hours

Parental leave & holidays

Mentorship & growth

Descripción de la vacante

BairesDev is seeking a Data Engineer to design and implement scalable data pipelines using Azure Databricks and Python, with a focus on integrating AI capabilities into data workflows.

You will collaborate with AI and product teams to deliver data-driven solutions, ensure data governance, and maintain secure, reliable pipelines in a fully remote role with flexible hours and USD compensation.

Formación

• 4+ years of experience in Data Engineering, ML Engineering, or Software Engineering.
• Expertise in building data pipelines with Azure Databricks and Python.
• Proficiency in integrating ML/AI and LLM APIs into data workflows.
• Strong data manipulation and automation skills for classification tasks.
• Deep knowledge of cloud-native data architectures and AI integration patterns.
• Advanced English proficiency.

Responsabilidades

• Design, build, and optimize end-to-end data pipelines and Lakehouse architectures using Azure Databricks.
• Integrate LLM APIs and ML models into data processing streams for automated classification and insights.
• Develop and maintain high-quality Python code and SQL procedures for data transformation and ingestion.
• Collaborate with AI and product teams to implement data-driven solutions with significant business value.
• Monitor and troubleshoot pipeline performance to ensure reliability and scalability in distributed cloud environments.
• Implement data governance and security best practices to maintain data platform integrity.

Conocimientos

Azure Databricks

Python

ML/AI integration

LLM APIs

SQL

Data pipelines

Cloud architectures

English

Herramientas

Databricks

Descripción del empleo

BairesDev is seeking a Data Engineer to design and implement scalable data pipelines using Azure Databricks and Python, with a focus on integrating AI capabilities into data workflows.

You will collaborate with AI and product teams to deliver data-driven solutions, ensure data governance, and maintain secure, reliable pipelines in a fully remote role with flexible hours and USD compensation.