Senior SDET — Data Quality & Spark Automation (Remote)

Encora10; Colombia; Remote; COP 286,469,000 - 413,789,000; Full time

Job summary

Coforge is seeking a Senior SDET with Earnix experience to lead end-to-end testing of Databricks pipelines, dbt models, Delta Lake datasets, APIs, and downstream analytics products. This remote role supports Latin America, including Colombia, Costa Rica, Peru, and nearby regions.

You will build maintainable automation frameworks using Python, PyTest, SQL, and dbt tests, perform data-quality validation, and ensure data transformations from Bronze to Gold are correct.

Qualifications

• 7+ years of experience in Quality Engineering or Test Automation, including enterprise data platforms.
• Hands-on experience testing Databricks pipelines, Spark workloads, Delta tables, jobs/workflows, and Lakehouse data products.
• Advanced dbt testing with custom tests, source freshness, model validation, and CI/CD quality gates.
• Strong Python automation: PyTest, reusable test utilities, test-data generation, and pipeline validation.
• Advanced SQL for complex validation, source-to-target reconciliation, and data-quality investigation.
• Strong knowledge of data-quality testing: completeness, accuracy, integrity, timeliness, and schema.
• Experience designing enterprise test automation frameworks covering unit, integration, and end-to-end tests.
• CI/CD, Git, automated test execution, quality gates, and version-controlled test assets.
• Working knowledge of ELT/ETL, PySpark, data modeling, orchestration, and production support.
• Strong analytical and stakeholder-management skills.

Responsibilities

• Define end-to-end test strategies for Databricks pipelines, dbt models, Delta tables, APIs.
• Build maintainable automation frameworks using Python, PyTest, SQL, and dbt tests; validate data quality.
• Test pricing and rating data, including factors, model inputs, and integrations with pricing platforms such as Earnix.
• Embed automated quality gates into CI/CD pipelines and promote shift-left testing and data-quality best practices.

Skills

Databricks

dbt

Python

PyTest

SQL

Test Automation

Data Quality

Delta Lake

PySpark

CI/CD

Job description

Coforge is seeking a Senior SDET with Earnix experience to lead end-to-end testing of Databricks pipelines, dbt models, Delta Lake datasets, APIs, and downstream analytics products. This remote role supports Latin America, including Colombia, Costa Rica, Peru, and nearby regions.

You will build maintainable automation frameworks using Python, PyTest, SQL, and dbt tests, perform data-quality validation, and ensure data transformations from Bronze to Gold are correct.