Lead Data Engineer

Encora; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Coforge is seeking a Lead Data Engineer to guide data platform architecture and delivery across cloud environments. You will lead data engineering teams, conduct code reviews, and set technical direction.

The role focuses on migrations, building scalable pipelines with Snowflake, Azure Databricks, DBT, and Terraform, while ensuring observability, CI/CD, and high data quality.

Qualifications

• 8+ years of Data Engineering experience with 2–3+ years in a Lead role.
• Proven ownership of system design for large-scale data platforms.
• Hands-on with Snowflake, Azure Databricks, DBT, and Python; thousands of DBT models.
• Deep knowledge of data architecture, data modeling, and ETL/ELT frameworks.
• Extensive Terraform and IaC experience.
• Experience leading cloud-to-cloud migrations (AWS to Azure).
• Strong CI/CD, Git-based version control, and advanced SQL.
• Proven leadership across teams with mentoring and development.
• Insurance/financial services domain knowledge and strong communication.

Responsibilities

• Lead and mentor data engineering teams while setting technical direction and conducting code reviews.
• Own end-to-end architecture, design, and delivery of scalable data platforms.
• Define and drive data migration strategies from Snowflake/SSIS to Azure Databricks and DBT.
• Oversee scalable data pipelines, data models, Terraform infra, CI/CD, observability, and platform stability.

Skills

Data Engineering

Data Architecture

Data Modeling

ETL/ELT

CI/CD

Data Migration

Python

SQL

AWS to Azure migration

Git-based version control

Tools

Snowflake

Azure Databricks

DBT

Terraform

Python

SQL

Kafka

Event Hubs

Delta Live Tables

SSIS

Job description

Job Title: Lead Data Engineer

Key Skills: Data Engineering, Azure Databricks, Snowflake, DBT, Python, Terraform, Data Architecture, Data Modeling, SQL, ETL/ELT, CI/CD, Data Migration

Experience: 8+ YOE.

Location: Costa Rica, Perú, Colombia, Bolivia.

Mode: Remote.

We at Coforge are hiring Lead Data Engineer (#16277-1-1) with the following skill set.

Key Responsibilities

• Lead and mentor data engineering teams while setting technical direction, conducting code reviews, and driving engineering excellence.

• Own the end-to-end architecture, design, and implementation of scalable and reliable data platforms, ensuring production-ready delivery.

• Define and drive data migration strategies from Snowflake/SSIS to Azure Databricks and DBT, including architecture decisions and execution oversight.

• Oversee scalable data pipelines, data models, Terraform infrastructure, CI/CD, data integration, observability, and platform stability across Azure and legacy environments.

Required Skills & Qualifications

• 8+ years of experience in Data Engineering, with 2–3+ years in a Lead or Staff-level role.

• Proven experience owning system design and leading implementations of large-scale data platforms.

• Strong hands-on expertise with Snowflake, Azure Databricks, DBT, and Python, including thousands of DBT models and data pipelines processing terabytes of data daily.

• Deep understanding of data architecture, data modeling, distributed data systems, and ETL/ELT frameworks.

• Extensive experience with Terraform and Infrastructure-as-Code principles.

• Demonstrated experience leading cloud-to-cloud data migration projects, preferably AWS to Azure.

• Strong experience with CI/CD pipelines, Git-based version control, and advanced SQL.

• Strong problem-solving skills with the ability to make architectural trade-offs and technical decisions.

• Proven experience managing and developing teams across different performance levels through mentoring, training, and development.

• Previous experience in insurance or financial services, with knowledge of claims, policies, underwriting, and risk domains, plus strong communication skills.

Preferred Skills:

• Experience implementing data governance, observability, and data quality frameworks.

• Strong knowledge of security and compliance standards in insurance or financial services.

• Experience with real-time and streaming technologies such as Kafka, Event Hubs, and Delta Live Tables.

• Familiarity with lakehouse architecture and cost/performance optimization.

• Experience operating in multi-cloud or hybrid cloud environments.

Posted On: 24-09-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.