Senior QA Testing Specialist -Data Engineer

SMBC Group; Charlotte (NC); Hybrid; USD 93,600 - 156,000; Full time

Benefits offered by this job

Hybrid work model

Disability accommodations

Competitive benefits

Job summary

SMBC Group is seeking a Senior QA Testing Specialist- Data Engineer to ensure the accuracy and reliability of enterprise data platforms built on Databricks. You will validate ETL pipelines and data transformations, partnering with Data Engineers, Analysts, and Product Owners across global teams.

You will write advanced SQL, develop Python validation scripts, monitor Databricks jobs, and drive data quality and automation efforts in a hybrid work environment.

Qualifications

• 8+ years of experience in Quality Assurance testing or relevant Data Engineering development roles.
• Advanced SQL development using CTEs, window functions, and complex joins for large-scale data validation.
• 6+ years of experience in test management strategy; experience in securities/financial services industry.
• 3+ years of designing solutions in process flow, business logic and UI.
• Strong experience in Azure data ecosystem with Databricks notebooks and cluster management.
• Experience building data test automation frameworks with CI/CD pipelines and Git integration.
• Hands-on Python (PySpark and Pandas) for data validation and analysis.
• Thorough understanding of ETL/data warehouse testing with end-to-end validation.
• Experience with Oracle or similar enterprise financial platforms.

Responsibilities

• Validate end-to-end data using source-to-target mappings and data transformations in Databricks.
• Define test scope, scenarios, risk-based coverage, and test strategies.
• Design and execute test cases for complex ETL pipelines and perform regression testing.
• Write SQL queries and monitor Databricks jobs; investigate failures and data quality issues.
• Log, track, and manage defects in JIRA; communicate risks and release readiness.
• Collaborate with Data Engineers, Architects, and Business teams to resolve issues.

Skills

Advanced SQL

Test management

Azure Databricks

Python (PySpark)

ETL testing

Data validation

Data warehouse testing

Communication skills

Tools

Databricks notebooks

CI/CD pipelines

Git

JIRA

Oracle

Job description

SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 employees worldwide in nearly 40 countries. Sumitomo Mitsui Financial Group, Inc. (SMFG) is the holding company of SMBC Group, which is one of the three largest banking groups in Japan. SMFG’s shares trade on the Tokyo, Nagoya, and New York (NYSE: SMFG) stock exchanges.

In the Americas, SMBC Group has a presence in the US, Canada, Mexico, Brazil, Chile, Colombia, and Peru. Backed by the capital strength of SMBC Group and the value of its relationships in Asia, the Group offers a range of commercial and investment banking services to its corporate, institutional, and municipal clients. It connects a diverse client base to local markets and the organization’s extensive global network. The Group’s operating companies in the Americas include Sumitomo Mitsui Banking Corp. (SMBC), SMBC Nikko Securities America, Inc., SMBC Capital Markets, Inc., SMBC MANUBANK, JRI America, Inc., SMBC Leasing and Finance, Inc., Banco Sumitomo Mitsui Brasileiro S.A., and Sumitomo Mitsui Finance and Leasing Co., Ltd.

The anticipated salary range for this role is between $97,000.00 and $156,000.00. The specific salary offered to an applicant will be based on their individual qualifications, experiences, and an analysis of the current compensation paid in their geography and the market for similar roles at the time of hire. The role may also be eligible for an annual discretionary incentive award. In addition to cash compensation, SMBC offers a competitive portfolio of benefits to its employees.

Role Description

The Senior QA Testing Specialist- Data Engineer is responsible for ensuring the accuracy, reliability, and integrity of enterprise data platforms built on Databricks. This role combines strong data engineering knowledge with deep quality assurance expertise , focusing on validating complex ETL pipelines, data transformations, and large ‑ scale datasets.

The position plays a critical role in enabling data ‑ driven decision ‑ making by ensuring that analytical and financial data is complete, accurate, and production ‑ ready before release. The role partners closely with Data Engineers, Business Analysts, Product Owners, and Project Managers across globally distributed teams.

Role Objectives

Data Quality & Validation

• Perform end‑to‑end data validation, including source‑to‑target mapping, reconciliation, and completeness checks. Validate data transformations across Databricks Medallion Architecture (Bronze, Silver, Gold).
• Ensure data quality standards are met prior to production releases.

Test Strategy & Execution

• Participate in requirements analysis and solution design reviews.
• Define test scope, scenarios, risk‑based coverage, and overall test strategies.
• Design and execute test cases for complex ETL pipelines and Perform regression testing and manage test data conditions.

Data Validation & Automation

• Write and execute advanced SQL queries (CTEs, window functions, complex joins).
• Develop Python validation scripts using PySpark and Pandas to support and enhance data test automation efforts where applicable.
• Monitor Databricks jobs and workflow executions. Investigate pipeline failures, data inconsistencies, and quality issues. Analyze defects both functionally and technically prior to assignment.

Defect Management & Collaboration

• Log, track, and manage defects using JIRA, ensuring high‑quality defect documentation.
• Collaborate closely with Data Engineers, Architects, and Business teams to resolve issues.
• Provide clear and timely communication on quality risks, test progress, and release readiness and Escalate issues through defined governance and quality escalation channels.

Qualifications And Skills

• 8+ years of experience in Quality Assurance testing or relevant Data Engineering development roles.
• Demonstrated expertise in Advanced SQL, including CTEs, window functions, and complex joins, for large‑scale data validation.
• 6+ years of experience in test management strategy; experience in the securities or financial services industry
• 3+ years of experience in designing solutions in process flow, business logic and UI.
• Strong experience within the Azure data ecosystem, with hands‑on expertise in Databricks notebooks and cluster management.
• Experience building or supporting data test automation frameworks, with exposure to CI/CD pipelines and Git‑based version control.
• Hands‑on manual and automated test development and design experience leading medium to large scales or enterprise-wide projects and production implementations.
• Strong command of Python, particularly PySpark and Pandas, for comprehensive data validation and analysis.
• Thorough understanding of ETL processes, data pipelines, and data warehouse architecture, with proven experience in ETL/Data Warehouse testing, including end source‑to‑target validation.
• Prior experience working directly with business users and finance stakeholders, including exposure to Oracle or similar enterprise financial platforms.
• Strong analytical, critical‑thinking, and problem‑solving skills.
• Excellent written and verbal communication skills, with the ability to articulate technical concepts clearly.
• Ability to work independently while collaborating effectively across distributed and global teams.

Measures of Success

• High level of confidence in production data quality, reflected by reduced defect leakage post‑release.
• Strong and consistent test coverage across complex, multi‑layer data platforms.
• Effective collaboration with engineering, product, and business teams throughout the delivery lifecycle.
• Proactive identification and mitigation of data quality risks and issues.
• Consistent, on‑time delivery of test outcomes without compromising quality standards.

SMBC’s employees participate in a Hybrid workforce model that provides employees with an opportunity to work from home, as well as, from an SMBC office. SMBC requires that employees live within a reasonable commuting distance of their office location. Prospective candidates will learn more about their specific hybrid work schedule during their interview process. Hybrid work may not be permitted for certain roles, including, for example, certain FINRA-registered roles for which in‑office attendance for the entire workweek is required.

SMBC provides reasonable accommodations during candidacy for applicants with disabilities consistent with applicable federal, state, and local law. If you need a reasonable accommodation during the application process, please let us know at [e-mail].