Data Quality Analyst

Ness Digital Engineering; Bengaluru; Hybrid; INR 1,500,000 - 2,300,000; Full time

Job summary

NESS DIGITAL Engineering is hiring a Senior Data Quality Analyst for Bangalore to own end-to-end ETL QA testing across data pipelines in Azure cloud. You will validate data across sources, lakes, and warehouse targets, leveraging Databricks, PySpark, and SQL-based validation to ensure data quality and integrity.

The role requires 3-6+ years of hands-on testing experience, expertise in data warehousing concepts, and strong SQL skills, with Agile experience and knowledge of Azure security and

Qualifications

• 3-6+ hands-on years of testing experience.
• ETL testing including Master Data Management, Data Cataloging, and Data Quality.
• Experience in database testing, data comparison & data transformation scripting.
• Good knowledge of data warehousing concepts & data modelling.
• Hands-on experience in creating stored procedures, functions, tables, cursors and handling large data types.
• Strong SQL skills: joins, subqueries, CTEs and complex query writing.
• Experience in testing reports and BO Universe; Agile methodology exposure.
• Azure Infra, networking know-how and testing; Azure PaaS analytics & storage testing.
• Understanding of Azure security controls and data protection.
• SAP HANA exposure would be an added advantage.

Responsibilities

• Analyze requirements and design specs to create test scenarios across data pipelines.
• Write reusable PySpark and T-SQL scripts to validate data across layers.

Skills

ETL testing

SQL

PySpark

Databricks

Azure Data Factory

Azure Data Lake

Azure Synapse

T-SQL

Data Warehousing

Data Modelling

Agile methodology

Tools

Databricks

SQL Database

Azure Data Factory

Azure Data Lake

Azure Synapse

PySpark

SparkSQL

T-SQL

Stored Procedures

CTEs

Job description

Job Description for Senior Data Quality Analyst” role

Greetings from NESS DIGITAL Engineering !!!

Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources. Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. Well versed in Databricks, SQL Database, Azure Data Factory, Azure Data Lake, Azure synapse Must have hands-on experience in PySpark, SparkSQL, T-SQL Should be able to go through requirements, design specs and create appropriate test scenarios across various layers/stages of data pipelines. Should be able to write reusable PySpark and T-SQL script to validate data across layers. Experience of working in Databricks Delta Lake will be highly desirable. Ideally should have worked in a team using Agile methodology.

• 3- 6+ hands-on years of testing exp
• Working experience in ETL testing including Master Data Management, Data Completeness Data Cataloging, Data Leverage and Data Quality for various data feeds coming from the source
• Experience in database testing, data comparison & data transformation scripting
• Good knowledge Data Warehousing concepts & Data Modelling
• Must have good hands-on experience in creating Stored Procedures, Functions, Tables, Cursors, Hashtables and handling large data types.
• Should know about working of Joins, Subqueries, CTEs and complex query writing skills
• Experience in testing of reports, BO Universe
• Experienced in structured test methods and processes
• Azure Infra & Networking know-how and Testing
• Cloud Azure PaaS Analytics & Storage services know-how and Testing
• Good understanding of Azure Security like identity and access controls, safeguarding data, keys & secret management, securing network, general information protection, understanding of threats like DDoS etc
• Experience in SAP HANA projects would be added advantage