Remote Data Engineer - Azure & Databricks Pipelines

CGV; San José; Remote; COP 48,000,000 - 66,000,000; Full time

Job summary

CGV is seeking a Data Engineer to design, build, and maintain scalable data pipelines on Microsoft Azure. You will ingest, transform, and deliver trusted data to analytics apps, working with Azure Databricks, Microsoft Fabric, and Delta Lake.

Collaborate with data scientists and client stakeholders to ensure data quality, governance, and timely insights. Proficiency in Python, SQL, and PySpark is required, with a strong focus on end-to-end data lifecycle and API-driven data services.

Qualifications

• This role requires 1-3 years of data engineering experience.
• Proficiency in Python and SQL with production-quality code experience.
• Hands-on experience with PySpark and distributed data processing.
• Familiarity with Azure data ecosystem (ADF, Fabric, Databricks) is preferred.

Responsibilities

• Design, develop, and deploy scalable data pipelines across sources.
• Collaborate with data scientists and analysts for data needs.
• Monitor and optimize data systems for efficiency and security.
• Implement data governance, quality checks, and lineage.
• Troubleshoot data issues and document architectures.
• Explain data flows and transformation logic to stakeholders.

Skills

Python

SQL

PySpark

APIs

Tools

Azure Databricks

Azure Data Factory

Microsoft Fabric

Delta Lake

Job description

CGV is seeking a Data Engineer to design, build, and maintain scalable data pipelines on Microsoft Azure. You will ingest, transform, and deliver trusted data to analytics apps, working with Azure Databricks, Microsoft Fabric, and Delta Lake.

Collaborate with data scientists and client stakeholders to ensure data quality, governance, and timely insights. Proficiency in Python, SQL, and PySpark is required, with a strong focus on end-to-end data lifecycle and API-driven data services.