Data Quality Analyst

Mployee.me; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

NESS DIGITAL Engineering is seeking a Senior Data Quality Analyst to lead end-to-end ETL QA for data pipelines in Azure. You will validate data across ingestion, staging, and warehouse layers, and ensure accuracy for multiple sources and BI outputs.

The ideal candidate has 3–6+ years of hands-on testing experience with ETL, data quality, and data warehousing concepts. Proficiency with Databricks, Azure Data Factory, Azure Data Lake, Synapse, PySpark, SparkSQL and T-SQL is required, with agile

Qualifications

• 3-6+ years of ETL QA testing experience.
• Experience with data completeness, data cataloging, and data quality for diverse feeds.
• Knowledge of data warehousing concepts and modeling.

Responsibilities

• End-to-end testing of ETL data pipelines in Azure-based environments.
• Validate data across ingestion, staging and warehouse layers.
• Write reusable PySpark and T-SQL scripts to verify data.
• Collaborate in an Agile environment and participate in test design.

Skills

ETL QA testing

Data quality

Azure cloud

Agile

Test planning

Data validation

Tools

Databricks

SQL Database

Azure Data Factory

Azure Data Lake

Azure Synapse

PySpark

SparkSQL

T-SQL

Job description

Job Description for Senior Data Quality Analyst” role

Greetings from NESS DIGITAL Engineering !!!

Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources. Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. Well versed in Databricks, SQL Database, Azure Data Factory, Azure Data Lake, Azure synapse Must have hands-on experience in PySpark, SparkSQL, T-SQL Should be able to go through requirements, design specs and create appropriate test scenarios across various layers/stages of data pipelines. Should be able to write reusable PySpark and T-SQL script to validate data across layers. Experience of working in Databricks Delta Lake will be highly desirable. Ideally should have worked in a team using Agile methodology.

• 3- 6+ hands-on years of testing exp
• Working experience in ETL testing including Master Data Management, Data Completeness Data Cataloging, Data Leverage and Data Quality for various data feeds coming from the source
• Experience in database testing, data comparison & data transformation scripting
• Good knowledge Data Warehousing concepts & Data Modelling
• Must have good hands-on experience in creating Stored Procedures, Functions, Tables, Cursors, Hashtables and handling large data types.
• Should know about working of Joins, Subqueries, CTEs and complex query writing skills
• Experience in testing of reports, BO Universe
• Experienced in structured test methods and processes
• Azure Infra & Networking know-how and Testing
• Cloud Azure PaaS Analytics & Storage services know-how and Testing
• Good understanding of Azure Security like identity and access controls, safeguarding data, keys & secret management, securing network, general information protection, understanding of threats like DDoS etc
• Experience in SAP HANA projects would be added advantage