BigData QA Automation Test Engineer - Spark, Scala, AWS

1203 Barclays Global Serv. Cent; Pune District; On-site; INR 900,000 - 1,350,000; Full time

Job summary

1203 Barclays Global Serv. Cent is seeking a software testing professional to design, develop, and execute testing strategies for data-heavy applications, focusing on quality, reliability, and user experience.

You will create automated scripts, analyze requirements, participate in design discussions, and support defect resolution across cross‑functional teams. The role requires strong SQL skills, experience with Spark and Jupyter Notebooks, and familiarity with AWS.

Qualifications

• Extensive testing experience in Data Warehouse and Big Data.
• Experience with Spark, JSON/Parquet/CSV formats.
• Experience in Jupyter Notebooks with Scala-Spark or PySpark.
• AWS Cloud exposure.
• Strong SQL for data analysis and validation.
• Experience with JIRA for test management.
• Agile/DevOps experience.
• Nice to have Unix/Shell scripting or Python; Investment Banking domain exposure.

Responsibilities

• Develop and implement test plans and strategies for software validation.
• Create and execute automated test scripts with testing frameworks.
• Collaborate with cross-functional teams to analyze requirements and acceptance criteria.
• Perform root-cause analysis with developers to resolve defects.
• Participate in code reviews and promote code quality.
• Stay informed on industry trends and contribute to technology communities.

Skills

Software testing

Big Data testing

SQL

Python/Scala Spark

Tools

Spark

Jupyter Notebooks

JIRA

AWS

Job description

Job Description

Purpose of the role: To design, develop, and execute testing strategies to validate functionality, performance, and user experience, while collaborating with cross‑functional teams to identify and resolve defects, and continuously improve testing processes and methodologies, to ensure software quality and reliability.

Accountabilities & Responsibilities

• Development and implementation of comprehensive test plans and strategies to validate software functionality and ensure compliance with established quality standards.
• Creation and execution of automated test scripts, leveraging testing frameworks and tools to facilitate early detection of defects and quality issues.
• Collaboration with cross‑functional teams to analyze requirements, participate in design discussions, and contribute to the development of acceptance criteria, ensuring a thorough understanding of the software being tested.
• Root‑cause analysis for identified defects, working closely with developers to provide detailed information and support defect resolution.
• Collaboration with peers, participation in code reviews, and promotion of a culture of code quality and knowledge sharing.
• Staying informed of industry technology trends and innovations, and contributing to the organization’s technology communities to foster a culture of technical excellence and growth.

Analyst Expectations

• Perform prescribed activities in a timely manner and to a high standard, consistently driving continuous improvement.
• Demonstrate in‑depth technical knowledge and thorough understanding of underlying principles and concepts.
• Lead and/or supervise a team as required, guiding and supporting professional development, allocating work, and coordinating resources.
• Exhibit clear leadership behaviours (Listen, Energize, Align, Develop) or, as an individual contributor, develop technical expertise, act as an advisor, and influence decision making.
• Collaborate effectively across functions, manage risk, strengthen controls, and influence decision making within one's area of expertise.
• Communicate complex and sensitive information, act as a contact point for stakeholders, and build a broad network of contacts.

Qualifications & Experience

• Strong software testing experience in Data Warehouse and Big Data applications.
• Experience working with Big Data tools like Spark, handling data formats such as JSON, Parquet, and CSV.
• Experience developing Jupyter Notebooks using Scala‑Spark or PySpark.
• Exposure to AWS Cloud services.
• Strong understanding of ETL processes, data validation techniques, and data analysis.
• Proficiency in writing complex SQL for data analysis and validation.
• Experience with test management and defect tracking using JIRA.
• Ability to work collaboratively in Agile or DevOps environments.
• Additional desirable skills: Unix/Shell scripting or Python; exposure to the Investment Banking domain; excellent communication and collaboration skills; quick learning of new tools and technologies.

Location

The role is based out of Pune.