ETL Testing, Pyspark professional

Diverse Lynx; Bengaluru; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Diverse Lynx in Bengaluru, India seeks a data-focused tester to design and execute ETL test cases and maintain automated PySpark tests. The role emphasizes data integrity, collaboration with data engineers, and ensuring processing workflows meet quality standards.

You will analyze defects, propose improvements, participate in code reviews, and stay current with ETL testing and data analytics trends to drive reliable data pipelines.

Qualifications

• Proficiency in ETL testing and PySpark data testing.
• Experience with large datasets and complex data systems.
• Strong analytical and problem-solving abilities.
• Excellent communication and team collaboration.
• Ability to design automated tests with various tools.
• Understanding of data modeling and relational databases.

Responsibilities

• Design and develop test cases for ETL processes to ensure data integrity.
• Develop and maintain automated tests using PySpark.
• Collaborate with cross-functional teams to resolve data-related issues.
• Analyze defects and provide improvement recommendations.
• Participate in code reviews to ensure quality and best practices.
• Stay updated with ETL testing and data analytics trends.

Skills

ETL testing

PySpark

Python

Analytical thinking

Team collaboration

Communication

Tools

PySpark

SQL

Job description

• Design and develop test cases for ETL processes to ensure data integrity and accuracy.
• Develop and maintain automated tests using Pyspark to validate data processing workflows.
• Collaborate with cross-functional teams to identify and resolve data-related issues.
• Analyze and report defects found during testing, providing recommendations for improvement.
• Participate in code reviews to ensure adherence to coding standards and best practices.
• Stay updated with industry trends and emerging technologies in ETL testing and data analytics.

Job Requirements

• Proficiency in ETL Testing, Pyspark (data testing), and Python programming.
• Experience working with large datasets and complex data systems.
• Strong analytical and problem-solving skills with attention to detail.
• Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
• Ability to design and implement automated tests using various tools and technologies.
• Strong understanding of data modeling and database concepts, with experience working with relational databases.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.