ETL Data testing

People's Growth HR Solutions; Hyderabad; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

People's Growth HR Solutions is seeking a skilled Data QA Engineer with 5+ years of experience to lead data quality testing, ETL validation, and end-to-end QA for enterprise software in an Agile setup. The role involves collaborating with data scientists, engineers, and a recruitment team to ensure robust data pipelines.

The ideal candidate will have strong Python and SQL skills, experience with Hive QL/Spark QL, and hands-on use of data testing tools.

Qualifications

• Experience creating detailed and comprehensive test suites using Python.
• Proficiency in writing complex SQL queries for data extraction or validation.
• Big Data concepts and NoSQL databases knowledge (preferred).
• Expertise in Hive QL and Spark QL queries.
• Hands-on data testing tools: DBT, iCEDQ, QuerySurge, Denodo, Informatica.
• Understanding of QE testing types for data quality.
• Experience troubleshooting applications and defect lifecycle management.
• Ability to test software and complete UAT in an Agile environment.
• Expertise in continuous automation for test coverage and efficiency.
• Support deployments and production environments.
• Proficiency in Linux/Unix.
• Ability to resolve cluster operating issues.
• Experience integrating data from multiple sources.
• Knowledge of BI tools like Power BI and Tableau (preferred).
• Experience with messaging systems like Kafka or RabbitMQ.
• Strong analytical and excellent communication skills.

Responsibilities

• Select and integrate data tools and frameworks to provide requested capabilities.
• Provide technical guidance to software engineers in designing, coding, reviewing, and testing enterprise software.
• Collaborate with Data Scientists, Data Engineers, and Software Engineers to develop QA tests to validate data and models.
• Implement ETL processes. Monitor performance and recommend infrastructure changes as needed.
• Collaborate with the recruitment team for hiring.

Skills

Python

SQL

Big Data

NoSQL

Hive QL

Spark QL

Kafka

RabbitMQ

Tools

DBT

iCEDQ

QuerySurge

Denodo

Informatica

Power BI

Tableau

Job description

Notice Period: (Immediate Joiner - Preferred)

Experience: 5+ Years

What youll do:

Key Responsibilities:

• Select and integrate data tools and frameworks to provide requested capabilities.
• Provide technical guidance to software engineers in designing, coding, reviewing, and testing enterprise software.
• Collaborate with Data Scientists, Data Engineers, and Software Engineers to develop QA tests to validate data and models.
• Implement ETL processes. Monitor performance and recommend infrastructure changes as needed.
• Collaborate with the recruitment team for hiring.

Requirements:

• Experience creating detailed and comprehensive test suites using Python.
• Proficiency in writing complex SQL queries for data extraction or validation.
• Strong understanding of Big Data concepts and NoSQL databases (preferred).
• Expertise in writing Hive QL and Spark QL queries.
• Hands-on experience with data testing tools like DBT, iCEDQ, QuerySurge, Denodo, Informatica, etc.
• Good understanding of QE testing types for data quality.
• Experience in troubleshooting applications and managing the defect lifecycle.
• Ability to test software and complete UAT in an Agile environment.
• Expertise in continuous automation for increased test coverage and efficiency.
• Proactive and reactive support in deployments and production environments.
• Proficiency in Linux or Unix environments.
• Ability to resolve cluster operating issues.
• Experience integrating data from multiple sources.
• Knowledge of BI tools like Power BI and Tableau (preferred).
• Experience with messaging systems like Kafka or RabbitMQ.
• Strong analytical and excellent communication skills.

Mandatory Skills:

• Python Advanced SQL queries Big Data concepts NoSQL databases Hive QL, Spark QL
• Data testing tools: DBT, iCEDQ, QuerySurge, Denodo, Informatica, etc.
• Linux or Unix
• Messaging systems: Kafka or RabbitMQ

Driving Results:

• Good single contributor & good team player.
• Flexible attitude towards work, as per the needs.
• Proactively identify & communicate issues and risks.

Other Personal Characteristics:

Dynamic, engaging, self-reliant developer Ability to deal with ambiguity Manage a collaborative and analytical approach Self-confident and humble Open to continuous learning Intelligent, rigorous thinker who can operate successfully amongst bright people