Sr QA - Data & QA (Python + Azure Databricks)

Envision Technology Solutions; India; Remote; INR 900,000 - 1,500,000; Full time

Job summary

Envision Technology Solutions is seeking a QA Engineer to strengthen our data platform with Python, CI/CD, and Azure data services. You will build and validate data pipelines on Azure Databricks and Delta Live Tables, performing ETL testing and data quality checks to ensure reliable deployments.

You will implement pytest-based testing, collaborate with DevOps and Data Engineering, and help govern data quality across Bronze, Silver, and Gold layers to ensure scalable, compliant pipelines.

Qualifications

• Strong hands-on expertise in Python
• Automation Testing Framework for Data validation and BDD approach
• Solid experience in pytest unit testing for ETL/data pipelines
• Practical knowledge of CI/CD tools (Azure DevOps, GitHub Actions, or Jenkins)
• Proven experience in Azure Databricks, DLH, and DLT
• Strong understanding of ETL testing methodologies
• Proficiency in Azure SQL, ADB SQL, and S3 file validation
• Expertise in data quality checks and governance validation
• Strong analytical, debugging, and problem-solving skills

Responsibilities

• Design, build, and maintain CI/CD pipelines for the data platform
• Work extensively with Azure Databricks, Data Lakehouse (DLH), and Delta Live Tables (DLT)
• Implement pytest unit testing frameworks for pipeline validation and transformations
• Conduct ETL testing and data quality validation (DQC) across Bronze, Silver, and Gold layers
• Validate data stored in Azure SQL, ADB SQL, and S3 file systems
• Collaborate with DevOps, Platform, and Data Engineering teams for seamless integration and deployment
• Troubleshoot and resolve platform-related issues in Python-based workflows
• Ensure platform governance, data quality, and compliance standards are met

Skills

Python

pytest

ETL testing

Data quality testing

Data governance

Debugging

Azure Databricks

Delta Live Tables

CI/CD

Tools

Azure DevOps

GitHub Actions

Jenkins

Azure Databricks

Delta Live Tables

Data Lakehouse

Azure SQL

S3

Job description

Role Overview

We are seeking a QA Engineer with strong expertise in Python, CI/CD, and Azure data services to strengthen our data platform. The role involves building, testing, and validating data pipelines on Azure Databricks and Delta Live Tables, ensuring high-quality data delivery across the platform. The engineer will play a key role in ETL testing, data quality validations, and CI/CD automation to support reliable and scalable deployments.

Key Responsibilities

• Design, build, and maintain CI/CD pipelines for the data platform.
• Work extensively with Azure Databricks, Data Lakehouse (DLH), and Delta Live Tables (DLT).
• Implement pytest unit testing frameworks for pipeline validation and transformations.
• Conduct ETL testing and data quality validation (DQC) across Bronze, Silver, and Gold layers.
• Validate data stored in Azure SQL, ADB SQL, and S3 file systems.
• Collaborate with DevOps, Platform, and Data Engineering teams for seamless integration and deployment.
• Troubleshoot and resolve platform-related issues in Python-based workflows.
• Ensure platform governance, data quality, and compliance standards are met.

Required Skills

• Strong hands-on expertise in Python
• Automation Testing Framework for Data validation and BDD approach.
• Solid experience in pytest unit testing for ETL/data pipelines.
• Practical knowledge of CI/CD tools (Azure DevOps, GitHub Actions, or Jenkins).
• Proven experience in Azure Databricks, DLH, and DLT.
• Strong understanding of ETL testing methodologies.
• Proficiency in Azure SQL, ADB SQL, and S3 file validation.
• Expertise in data quality checks and governance validation.
• Strong analytical, debugging, and problem-solving skills.

Good to Have

• Knowledge of Medallion architecture (Bronze, Silver, Gold layers).
• Exposure to enterprise data platforms and cloud-native data ecosystems.
• Familiarity with Agile methodologies and DevOps best practices.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.