Senior QA Testing Specialist -Data Engineer

SMBC; Charlotte (NC); Hybrid; USD 97,000 - 156,000; Full time

Benefits offered by this job

Hybrid work model

Accommodations during candidacy

Job summary

SMBC is seeking a Senior QA Testing Specialist-Data Engineer in Charlotte, NC to ensure data quality across enterprise platforms built on Databricks. The role focuses on validating complex ETL pipelines, data transformations, and large datasets to enable data-driven decision-making.

The candidate will work with Data Engineers, Business Analysts, Product Owners, and Project Managers across distributed teams, developing test strategies, automation, and regression testing to ensure production

Qualifications

• 8+ years of QA testing or data engineering development roles.
• Advanced SQL (CTEs, window functions, complex joins) for large-scale data validation.
• 6+ years in test management strategy, in securities or financial services.
• 3+ years in designing process flow, business logic and UI.
• Strong experience with Azure data ecosystem and Databricks notebooks.
• Experience building data test automation and CI/CD integrations.
• Proficient in Python, PySpark, Pandas for data validation.
• Understanding ETL pipelines and data warehouse testing, including end-to-end validation.

Responsibilities

• Ensure data quality and validation before production releases.
• Define test scope, scenarios, risk-based coverage, and test strategies.
• Design and execute test cases for complex ETL pipelines; perform regression testing.
• Develop Python validation scripts to support data test automation.
• Monitor Databricks jobs; investigate pipeline failures and data quality issues.
• Log, track and manage defects using JIRA; ensure quality documentation.
• Collaborate with data engineers, architects, and business teams to resolve issues.
• Provide timely communication on quality risks, progress, and release readiness.

Skills

Advanced SQL

Test management

Python (PySpark/Pandas)

Data quality assurance

ETL/Data warehouse testing

Databricks

Git & CI/CD

Azure data ecosystem

Communication skills

Tools

Databricks notebooks

Databricks clusters

CI/CD pipelines

Git

Job description

Select how often (in days) to receive an alert:

Job Level: Associate

Location: Charlotte, NC, US, 28202

Employment Type: Full Time

Requisition ID: 8007

SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 employees worldwide in nearly 40 countries. Sumitomo Mitsui Financial Group, Inc. (SMFG) is the holding company of SMBC Group, which is one of the three largest banking groups in Japan. SMFG’s shares trade on the Tokyo, Nagoya, and New York (NYSE: SMFG) stock exchanges.

In the Americas, SMBC Group has a presence in the US, Canada, Mexico, Brazil, Chile, Colombia, and Peru. Backed by the capital strength of SMBC Group and the value of its relationships in Asia, the Group offers a range of commercial and investment banking services to its corporate, institutional, and municipal clients. It connects a diverse client base to local markets and the organization’s extensive global network. The Group’s operating companies in the Americas include Sumitomo Mitsui Banking Corp. (SMBC), SMBC Nikko Securities America, Inc., SMBC Capital Markets, Inc., SMBC MANUBANK, JRI America, Inc., SMBC Leasing and Finance, Inc., Banco Sumitomo Mitsui Brasileiro S.A., and Sumitomo Mitsui Finance and Leasing Co., Ltd.

The anticipated salary range for this role is between $97,000.00and $156,000.00. The specific salary offered to an applicant will be based on their individual qualifications, experiences, and an analysis of the current compensation paid in their geography and the market for similar roles at the time of hire. The role may also be eligible for an annual discretionary incentive award. In addition to cash compensation, SMBC offers a competitive portfolio of benefits to its employees.

Role Description

The Senior QATesting Specialist-Data Engineer is responsible for ensuring the accuracy, reliability, and integrity of enterprise data platforms built on Databricks. This role combines strong data engineering knowledge with deep quality assurance expertise , focusing on validating complex ETL pipelines, data transformations, and large ‑ scaled datasets.

The position plays a critical role in enabling data ‑ driven decision ‑ making by ensuring that analytical and financial data is complete, accurate, and production ‑ ready before release. The role partners closely with Data Engineers, Business Analysts, Product Owners, and Project Managers across globally distributed teams.

Role Objectives

Data Quality & Validation:

• Ensure data quality standards are met prior to production releases.
• Participate in requirements analysis and solution design reviews.
• Define test scope, scenarios, risk‑based coverage, and overall test strategies.
• Design and execute test cases for complex ETL pipelines and Perform regression testing and manage test data conditions.

DataValidation & Automation:

• Write and execute advanced SQL queries (CTEs, window functions, complex joins).
• Develop Python validation scripts using PySpark and Pandas to support and enhance data test automation efforts where applicable.
• Monitor Databricks jobs and workflow executions. Investigate pipeline failures, data inconsistencies, and quality issues. Analyze defects both functionally and technically prior to assignment.
• Log, track, and manage defects using JIRA, ensuring high‑quality defect documentation.
• Collaborate closely with Data Engineers, Architects, and Business teams to resolve issues.
• Provide clear and timely communication on quality risks, test progress, and release readiness and Escalate issues through defined governance and quality escalation channels.

Qualifications and Skills

• 8+ years of experience in Quality Assurance testing or relevant Data Engineering development roles.
• Demonstrated expertise in Advanced SQL, including CTEs, window functions, and complex joins, for large‑scale data validation.
• 6+ years of experience in test management strategy; experience in the securities or financial services industry
• 3+ years of experience in designing solutions in process flow, business logic and UI.
• Strong experience within the Azure data ecosystem, with hands‑on expertise in Databricks notebooks and cluster management.
• Experience building or supporting data test automation frameworks, with exposure to CI/CD pipelines and Git‑based version control.
• Hands-on manual and automated test development and design experience leading medium to large scales or enterprise-wide projects and production implementations.
• Strong command of Python, particularly PySpark and Pandas, for comprehensive data validation and analysis.
• Thorough understanding of ETL processes, data pipelines, and data warehouse architecture, with proven experience in ETL/Data Warehouse testing, including end source‑to‑target validation.
• Prior experience working directly with business users and finance stakeholders, including exposure to Oracle or similar enterprise financial platforms.
• Strong analytical, critical‑thinking, and problem‑solving skills.
• Excellent written and verbal communication skills, with the ability to articulate technical concepts clearly.
• Ability to work independently while collaborating effectively across distributed and global teams.

Measures of Success

• High level of confidence in production data quality, reflected by reduced defect leakage post‑release.
• Strong and consistent test coverage across complex, multi‑layer data platforms.
• Effective collaboration with engineering, product, and business teams throughout the delivery lifecycle.
• Proactive identification and mitigation of data quality risks and issues.
• Consistent, on‑time delivery of test outcomes without compromising quality standards.

SMBC’s employees participate in a Hybrid workforce model that provides employees with an opportunity to work from home, as well as, from an SMBC office. SMBC requires that employees live within a reasonable commuting distance of their office location. Prospective candidates will learn more about their specific hybrid work schedule during their interview process. Hybrid work may not be permitted for certain roles, including, for example, certain FINRA-registered roles for which in-office attendance for the entire workweek is required.

SMBC provides reasonable accommodations during candidacy for applicants with disabilities consistent with applicable federal, state, and local law. If you need a reasonable accommodation during the application process, please let us know at [e-mail].