Senior SDET: Data Quality & CI/CD for Databricks

Encora10; Comisión de Fomento de Perú; Remote; ARS 121,164,000 - 166,601,000; Full time

Job summary

Coforge is hiring a Senior SDET focused on Earnix to lead automated testing of data pipelines and pricing workflows. Remote across Latin America, you will validate Databricks pipelines, dbt models, Delta tables, and APIs, ensuring data quality and integrity for analytical products.

You'll build and maintain Python-based test frameworks with PyTest, SQL validations, and CI/CD quality gates, championing shift-left testing and robust data governance across the Lakehouse platform.

Qualifications

• 7+ years of experience in Quality Engineering or Test Automation.
• Strong hands-on experience testing enterprise data platforms.
• Hands-on testing of Databricks pipelines, Delta tables, jobs/workflows, and Lakehouse data products.
• Advanced experience with dbt testing, including custom tests, source freshness, model validation, documentation, and CI/CD quality gates.
• Strong Python automation skills, including PyTest, reusable test utilities, test-data generation, and pipeline/API validation.
• Advanced SQL skills for complex validation, source-to-target reconciliation, defect analysis, and data-quality investigation.
• Strong knowledge of data-quality testing, including completeness, accuracy, uniqueness, integrity, timeliness, schema, and business-rule validation.
• Experience designing enterprise test automation frameworks covering unit, integration, regression, end-to-end, and release validation.
• Strong experience with CI/CD, Git, automated test execution, quality gates, and version-controlled test assets.
• Working knowledge of ELT/ETL, PySpark, data modeling, incremental loads, orchestration, and production support.
• Strong analytical, communication, defect-triage, and stakeholder-management skills.

Responsibilities

• Define and implement end-to-end test strategies for Databricks pipelines, dbt models, Delta tables, APIs, and downstream analytical products.
• Build maintainable automation frameworks using Python, PyTest, SQL, and dbt tests, validating Bronze-to-Silver-to-Gold transformations through reconciliation, accuracy, integrity, completeness, and business-rule testing.
• Test pricing and rating data, including rating factors, model inputs, quote versions, premium calculations, and integrations with pricing or rating platforms such as Earnix.
• Embed automated quality gates into CI/CD pipelines, investigate defects, support root-cause analysis, define quality metrics, and promote shift-left testing and data-quality best practices.

Skills

Databricks

dbt

Python

PyTest

SQL

Test Automation

Data Quality

Delta Lake

PySpark

CI/CD

Earnix Experience

Tools

Databricks

dbt

Delta Lake

PySpark

CI/CD

Earnix

Job description

Coforge is hiring a Senior SDET focused on Earnix to lead automated testing of data pipelines and pricing workflows. Remote across Latin America, you will validate Databricks pipelines, dbt models, Delta tables, and APIs, ensuring data quality and integrity for analytical products.

You'll build and maintain Python-based test frameworks with PyTest, SQL validations, and CI/CD quality gates, championing shift-left testing and robust data governance across the Lakehouse platform.