Senior Data Engineer - AI DBT & Databricks Lead Remote

Encora; Colombia; Presencial; COP 374.895.000 - 593.583.000; Jornada completa

Descripción de la vacante

Coforge is hiring a Lead/Principal Data Engineer - DBT & Databricks for remote work across Latin America. The role focuses on designing and maintaining DBT models on Azure Databricks with Delta Lake, Unity Catalog, and Medallion Architecture, delivering Gold-layer data domains in regulated environments.

The ideal candidate has 5+ years in data engineering, hands-on DBT and Databricks experience, strong SQL and Python skills, and familiarity with AI-assisted development tools.

Formación

• 5+ years of experience in Data Engineering.
• 2+ years hands-on experience building and operating production-grade DBT projects (models, tests, snapshots, refactoring).
• Strong SQL skills and Python programming experience.
• Hands-on Azure Databricks with Delta Lake, Unity Catalog, and Medallion Architecture.
• Strong knowledge of DBT testing, data validation, and QA best practices.
• Familiarity with dbt-expectations, Great Expectations, or Delta Live Tables expectations.
• Experience with Git-based PR workflows, code reviews, and CI/CD deployment.
• Experience using AI-powered development tools such as Claude Code, GitHub Copilot, Cursor.
• Ability to own data domains and collaborate directly with business stakeholders.
• Strong communication, analytical, and problem-solving skills.

Responsabilidades

• Design, build, and maintain DBT models on Azure Databricks using Delta Lake, Unity Catalog, and Medallion Architecture.
• Deliver curated Gold-layer data domains to production standards in regulated environments.
• Leverage AI-assisted development tools to improve model generation, refactoring, documentation, and debugging.
• Establish DBT testing strategies including schema validation and data quality checks.
• Work in CI/CD-driven delivery environments with PR workflows and automated quality gates.
• Curate datasets, semantic definitions, and business terminology to support NL analytics initiatives.
• Define and enforce data contracts, domain ownership, and governance standards.
• Implement data observability, monitoring, and root-cause analysis across data platforms.
• Drive modernization and migration through AI-assisted Data Engineering approaches.
• Contribute to playbooks, standards, and enablement programs for DBT, Databricks, and AI development.
• Measure and improve AI-generated code adoption, quality, productivity, and delivery outcomes.

Conocimientos

Data engineering

SQL

Python

AI tools

Stakeholder collaboration

Communication

CI/CD

Herramientas

DBT

Azure Databricks

Delta Lake

Unity Catalog

Medallion Architecture

dbt testing

Great Expectations

Delta Live Tables

Git workflows

Claude Code

GitHub Copilot

Cursor

Databricks Genie

Descripción del empleo

Coforge is hiring a Lead/Principal Data Engineer - DBT & Databricks for remote work across Latin America. The role focuses on designing and maintaining DBT models on Azure Databricks with Delta Lake, Unity Catalog, and Medallion Architecture, delivering Gold-layer data domains in regulated environments.

The ideal candidate has 5+ years in data engineering, hands-on DBT and Databricks experience, strong SQL and Python skills, and familiarity with AI-assisted development tools.