ETL Tester – PySpark

Quantum Technologies. LLC; Boston (MA); On-site; USD 70,000 - 110,000; Full time

Job summary

Quantum Technologies. LLC in Boston is seeking an ETL Tester with 3–5 years of experience in data testing, ETL testing, and data automation. The candidate should be proficient in PySpark, SQL, Databricks, and API testing to validate data across systems.

Responsibilities include executing data validation, writing test cases, collaborating with developers and QA, and participating in Agile ceremonies. Familiarity with JIRA, Xray, and Confluence helps ensure quality across BI and data pipelines.

Qualifications

• Must have 3–5 years of experience in ETL Testing, Data Testing, or Data Automation.
• Working knowledge of PySpark and Apache Spark.
• Basic to intermediate experience with Databricks and Spark SQL.
• Good understanding of SQL queries, joins, aggregations, and analytical functions.
• Experience in data validation, data reconciliation, and ETL testing.
• Exposure to API Testing and API Automation.
• Understanding of Entity Resolution and data matching concepts.
• Knowledge of Software Testing Life Cycle (STLC).
• Experience creating and executing test cases and test scripts.
• Familiarity with JIRA, Xray, and Confluence.
• Understanding of Agile/Scrum methodologies.

Responsibilities

• Perform ETL testing and validate data across different systems.
• Execute data validation and reconciliation using SQL queries.
• Develop and maintain basic automation scripts using PySpark.
• Test data transformation and processing workflows in Databricks.
• Perform API testing and validate API responses.
• Write and execute functional, integration, and regression test cases.
• Identify, document, and track defects using JIRA.
• Validate data accuracy, completeness, and consistency.
• Support test planning, test execution, and QA documentation.
• Collaborate with developers, business analysts, and QA teams.
• Participate in Agile ceremonies and daily project meetings.
• Assist with BU A/UAT.

Skills

ETL Testing

Data Testing

PySpark

SQL

Databricks

API Testing

STLC

JIRA

Xray

Confluence

Agile/Scrum

Data Validation

Data Reconciliation

Entity Resolution

Spark SQL

Testing Automation

Tools

Databricks

JIRA

Xray

Confluence

Job description

Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are looking for a skilled ETL Tester with 3–5 years of experience in Data Testing, ETL Testing, and Data Automation. The ideal candidate should have working knowledge of PySpark, SQL, Databricks, and API Testing, along with a good understanding of data validation and testing methodologies.

Required Skills & Experience:

• 3–5 years of experience in ETL Testing, Data Testing, or Data Automation.
• Working knowledge of PySpark and Apache Spark.
• Basic to intermediate experience with Databricks and Spark SQL.
• Good understanding of SQL queries, joins, aggregations, and analytical functions.
• Experience in data validation, data reconciliation, and ETL testing.
• Exposure to API Testing and API Automation.
• Understanding of Entity Resolution and data matching concepts.
• Knowledge of Software Testing Life Cycle (STLC).
• Experience creating and executing test cases and test scripts.
• Familiarity with JIRA, Xray, and Confluence.
• Understanding of Agile/Scrum methodologies.

Key Responsibilities:

• Perform ETL testing and validate data across different systems.
• Execute data validation and reconciliation using SQL queries.
• Develop and maintain basic automation scripts using PySpark.
• Test data transformation and processing workflows in Databricks.
• Perform API testing and validate API responses.
• Write and execute functional, integration, and regression test cases.
• Identify, document, and track defects using JIRA.
• Validate data accuracy, completeness, and consistency.
• Support test planning, test execution, and QA documentation.
• Collaborate with developers, business analysts, and QA teams.
• Participate in Agile ceremonies and daily project meetings.
• Assist with Business User Acceptance Testing (BUA/UAT).

Preferred Qualifications:

• Exposure to Banking or Financial Services projects.
• Basic understanding of Anti-Money Laundering (AML) processes.
• Knowledge of Entity Resolution and data matching techniques.
• Exposure to Business Analysis or UAT activities.
• Familiarity with automation testing frameworks.
• Strong analytical and problem-solving skills.
• Good verbal and written communication skills.
• Ability to work independently and collaborate with distributed teams.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.