Remote Data Engineer: Azure Databricks, Python & AI Pipelines

BairesDev; Colombia; A distancia; COP 286.451.000 - 413.762.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

100% remote work

USD salary or local currency

Hardware provided

Flexible hours

Parental leave & vacation

Descripción de la vacante

BairesDev is seeking a Data Engineer to design and build scalable data pipelines using Azure Databricks and Python, with a focus on integrating AI capabilities and LLM APIs to enable automated classification and insights. You will contribute to data governance, security, and scalable cloud architectures.

The role emphasizes collaboration with AI and product teams, delivering data-driven solutions, and operating in a 100% remote environment with competitive USD compensation and flexible schedules.

Formación

• 4+ years of Data Engineering, ML Engineering, or Software Engineering.
• Experience with Azure Databricks and Python for building data pipelines.
• Experience integrating ML/AI solutions and LLM APIs into data workflows.
• Strong data manipulation and automation skills.
• Understanding of cloud-native data architectures and AI integration patterns.
• Advanced proficiency in English.

Responsabilidades

• Design, build, and optimize end-to-end data pipelines and Lakehouse architectures using Azure Databricks.
• Integrate LLM APIs and ML models into data processing streams for automated classification and insights.
• Develop and maintain high-quality Python code and SQL procedures for data transformation and ingestion.
• Collaborate with AI and product teams to implement data-driven solutions with business impact.
• Monitor and troubleshoot pipeline performance for reliability and scalability in distributed cloud environments.
• Implement data governance and security best practices to maintain data integrity and compliance.

Conocimientos

Azure Databricks

Python

LLM APIs

ML/AI workflows

Data manipulation

Cloud-native architectures

English (Advanced)

Herramientas

Azure Databricks

SQL

Descripción del empleo

BairesDev is seeking a Data Engineer to design and build scalable data pipelines using Azure Databricks and Python, with a focus on integrating AI capabilities and LLM APIs to enable automated classification and insights. You will contribute to data governance, security, and scalable cloud architectures.

The role emphasizes collaboration with AI and product teams, delivering data-driven solutions, and operating in a 100% remote environment with competitive USD compensation and flexible schedules.