ETL/ Bigdata Tester

NucleusTeq; Indore District; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

NucleusTeq is seeking an experienced Big Data Test Automation Engineer to design, build, and maintain robust test automation frameworks for large-scale data platforms and web applications. You will validate ETL/ELT pipelines, ensure data integrity across distributed stores, and automate both back-end data processing and front-end workflows.

Collaborate with product managers and data engineers, develop test scenarios, and integrate automated suites into CI/CD pipelines (Jenkins, GitHub Actions).

Qualifications

• 5+ years of QA and test automation in data platforms
• Strong Java and Python proficiency
• Selenium WebDriver experience
• BDD frameworks (Cucumber/Gherkin) and Pytest
• SQL skills for data validation
• ETL/ELT testing and data quality
• CI/CD experience (Jenkins, GitHub Actions, GitLab CI)
• Bachelor’s or Master’s degree in CS/SE/IT or related field

Responsibilities

• Design, implement, and maintain scalable test automation frameworks
• Validate ETL pipelines and ensure data integrity across distributed environments
• Automate back-end data processing and front-end workflows
• Develop automated test suites for API services and UI workflows
• Collaborate with product managers and data engineers to derive test scenarios

Skills

Java

Python

Education

Bachelor/Master in CS/SE/IT

Tools

Selenium WebDriver

BDD (Cucumber/Gherkin)

Pytest

Job description

We are seeking an experienced Big Data Test Automation Engineer to design, build, and maintain robust test automation frameworks across our large-scale data platforms and web applications. In this role, you will validate complex data pipelines (ETL/ELT), ensure high data integrity across distributed data stores, and automate both back-end data processing and front-end interface workflows using modern test frameworks.

Location: Indore, Gurugram, Raipur

Key Responsibilities

• Test Framework Development: Design, implement, and maintain scalable test automation frameworks from scratch using Java and Python.
• ETL & Big Data Validation: Formulate automated test suites to validate complex ETL pipelines, data transformations, data quality, data completeness, and schema migrations across distributed environments.
• UI & BDD Automation: Automate functional, regression, and end-to-end user workflows using Selenium WebDriver integrated with BDD Cucumber.
• Service & Pipeline Testing: Build and execute test suites using Pytest for data scripts, API services, and scheduled pipeline jobs.
• Database & Query Verification: Author advanced SQL queries to extract, reconcile, and validate high-volume data sets across relational databases, data warehouses, and data lakes.
• Functional & Integration Testing: Partner with product managers and data engineers to derive comprehensive test scenarios, edge cases, and acceptance criteria from functional requirements.
• CI/CD Integration: Integrate automated test suites into CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab CI) to ensure continuous quality gates across all release cycles.
• Defect Management: Identify, report, trace, and isolate defects using issue tracking tools (e.g., JIRA), performing thorough root cause analysis on pipeline or automation failures.

Required Qualifications

• Experience: 5 years of hands‑on experience in Quality Assurance and Test Automation, with significant focus on Data Platform or Big Data testing.
• Programming Languages: Strong proficiency in both Java and Python.
• Automation Tools & Frameworks:
  • Hands‑on expertise with Selenium WebDriver.
  • Strong working knowledge of BDD frameworks (Cucumber / Gherkin syntax).
  • Deep experience with Pytest for Python‑based test development.
• Database & ETL Skills:
  • Advanced SQL skills (joins, window functions, aggregations, subqueries) for large‑scale data validation.
  • Proven experience in ETL/ELT Testing, validating source‑to‑target data mappings, reconciliation, and schema integrity.
• Testing Methodologies: Solid foundation in Functional Testing, Regression Testing, End‑to‑End Testing, and Data Quality Assurance best practices.
• Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline (or equivalent practical experience).

Why Join Us?

• Work on cutting‑edge cloud data projects.
• Leadership opportunity with high ownership.
• Dynamic and growth‑orientated work environment.