Data Engineer: Azure Databricks + AI Pipelines

BairesDev; Chile; Remote; CLP 88.670.000 - 128.079.000; Vollzeit

Benefits dieser Stelle

100% remote work

Flexible hours

Competitive USD pay

Zusammenfassung

BairesDev is actively seeking a Data Engineer to design and build scalable pipelines and Lakehouse architectures using Azure Databricks. You will integrate AI capabilities, including LLM APIs, into data workflows to enable automated classification and insights.

Ideal candidates bring 4+ years in Data Engineering or related fields, strong Python/SQL skills, and experience with cloud-native architectures. This role is fully remote with competitive USD compensation and a focus on growth within a

Qualifikationen

• 4+ years of experience in Data Engineering, ML Engineering, or Software Engineering.

Aufgaben

• Design, build, and optimize end-to-end data pipelines and Lakehouse architectures using Azure Databricks.
• Integrate LLM APIs and ML models into data streams to support automated classification and insights.
• Develop and maintain Python code and SQL procedures for data transformation and ingestion.
• Collaborate with AI and product teams to implement data-driven solutions with business value.
• Monitor and troubleshoot pipeline performance for reliability and scalability across distributed cloud environments.
• Implement data governance and security best practices to maintain data platform integrity.

Kenntnisse

Data pipelines

Azure Databricks

Python

SQL

ML/AI

LLM APIs

Data governance

Security best practices

English proficiency

Tools

Azure Databricks

Python

SQL

Jobbeschreibung

BairesDev is actively seeking a Data Engineer to design and build scalable pipelines and Lakehouse architectures using Azure Databricks. You will integrate AI capabilities, including LLM APIs, into data workflows to enable automated classification and insights.

Ideal candidates bring 4+ years in Data Engineering or related fields, strong Python/SQL skills, and experience with cloud-native architectures. This role is fully remote with competitive USD compensation and a focus on growth within a