Senior Data Engineer (Earnix)

Encora10; Comisión de Fomento de Perú; À distance; ARS 136 310 000 - 196 892 000; Plein temps

Résumé du poste

Coforge is hiring a Senior Data Engineer (Earnix) to design, build, and optimize production-grade data pipelines using Azure Databricks, dbt, Python, PySpark and SQL. You will model pricing and rating data and ensure governance with Unity Catalog.

You will mentor teams and collaborate across pricing, actuarial, underwriting, Data Science, BI, and Architecture. The role emphasizes ownership of end-to-end data pipelines, production support, and scalable Lakehouse practices in a remote setting

Qualifications

• 7+ years of data engineering experience with Databricks platforms.
• Advanced Azure Databricks, Delta Lake, and Databricks SQL production experience.
• Strong Python and PySpark for transformations and testing; CI/CD integration.
• Experience with Unity Catalog governance and data quality monitoring.

Responsabilités

• Design and optimize production-grade data pipelines and governed data products.
• Build conformed Silver/Gold data models for pricing, ratings, and policy data.
• Implement Lakehouse practices with data quality, observability, and governance.
• Lead design reviews, code reviews, and mentor engineering teams.

Connaissances

Data engineering

Leadership

Mentoring

Data modeling

Observability

Governance

Production data pipelines

Formation

Bachelor's degree or higher

Outils

Azure Databricks

dbt

Python

PySpark

SQL

Delta Lake

Unity Catalog

Azure

CI/CD

Git

Virtual Data Platforms

Databricks SQL

Kafka

Event Hubs

FastAPI

REST APIs

Power BI

Terraform

Dataiku

MLflow

Description du poste

Senior Data Engineer (Earnix)

Job Title: Senior Data Engineer (Earnix)

Key Skills: Azure Databricks, dbt, Python, PySpark, SQL, Delta Lake, Unity Catalog, Azure, CI/CD, Data Engineering, Earnix

Experience: 7+ YOE.

Location: Costa Rica, Peru, Colombia, Bolivia

Mode: Remote

We at Coforge are hiring Senior Data Engineer (Earnix) (#006fu00000cVkwnAAC-1) with the following skill set.

Key Responsibilities

• Design, develop, and optimize production-grade data pipelines and governed data products using Azure Databricks, dbt, Python/PySpark, SQL, and Delta Lake.
• Build conformed Silver and Gold data models for rating factors, model inputs, quote versions, policy premiums, and other insurance pricing and rating data.
• Implement scalable Lakehouse engineering practices, including data quality, observability, monitoring, governance with Unity Catalog, and performance optimization.
• Collaborate with pricing, actuarial, underwriting, Data Science, BI, Architecture, and Quality Engineering teams while providing technical leadership through design reviews, code reviews, and mentoring.

Required Skills & Qualifications

• 7+ years of Data Engineering experience, including strong recent experience with enterprise Databricks platforms.
• Strong production experience with Azure Databricks, Spark, Delta Lake, Workflows/Jobs, Databricks SQL, and platform optimization.
• Advanced hands‑on experience with dbt models, macros, tests, documentation, incremental patterns, and CI/CD integration.
• Strong Python and PySpark skills for transformations, reusable frameworks, integrations, validation, and automated testing.
• Advanced SQL skills, including query optimization, data reconciliation, and analytical data modeling.
• Strong experience with enterprise ELT/ETL, batch pipelines, incremental processing, data quality, and production support.
• Practical experience with Unity Catalog or comparable data governance, lineage, and access‑control capabilities.
• Experience with CI/CD, Git, automated deployments, peer reviews, and environment promotion for data products.
• Strong Azure experience, including cloud storage, identity, security, and integration patterns.
• Proven ownership of production data pipelines from design through deployment, monitoring, and incident resolution.

Preferred Skills

• Experience with insurance pricing, policies, quotes, premiums, rating factors, underwriting, or actuarial data.
• Experience integrating with Earnix or another enterprise pricing/rating engine.
• Experience with Dataiku, MLflow, or governed machine‑learning workflows.
• Knowledge of Kafka, Event Hubs, streaming patterns, FastAPI, REST APIs, or low‑latency data services.
• Experience with Power BI and Terraform.

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.