Senior CCAR Data Engineer – Databricks, AI-Driven Pipelines

SMBC; Charlotte (NC); Hybrid; USD 140,000 - 190,000; Full time

Job summary

SMBC Group is seeking a seasoned Data Engineer to join the Regulatory Reporting & CCAR Technology Team in the Americas. You will design scalable data platforms on Databricks, enabling end-to-end data sourcing, CCAR model execution, data adjustments, and attestation workflows, with strong emphasis on AI/ML-enabled data quality and governance.

You will collaborate with Finance, Risk, and Model Development teams to deliver auditable, regulatory-compliant solutions and support CI/CD, production

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, Information Systems, or a related field.
• 7+ years of experience in Data Engineering, Data Platform Development, or Analytics Engineering.
• Strong hands-on experience with: Azure Data Factory, Databricks, PySpark, Python, SQL, Delta Lake, GitHub and CI/CD
• Experience building cloud-native and distributed data processing solutions.
• Strong understanding of ETL/ELT architectures, data modeling, data governance, and data quality frameworks.
• Knowledge of AI/ML concepts, machine learning lifecycle management, and model operationalization.
• Excellent analytical, problem-solving, communication, and stakeholder management skills.

Responsibilities

• Design, develop, and optimize scalable data pipelines using Databricks, PySpark, Python, SQL, and Delta Lake.
• Develop data sourcing, ingestion, and reconciliation frameworks for CCAR, Stress Testing, and Regulatory Reporting.
• Support CCAR model execution platforms and related risk models.
• Implement data quality controls, lineage tracking, and audit capabilities.
• Build workflows for data adjustments, overlays, and exception handling.
• Develop attestation, approval, and sign-off workflows for regulatory reporting governance.
• Collaborate with Finance, Risk, Data Management, and Model Development teams to deliver solutions.
• Leverage AI/ML for data quality monitoring, anomaly detection, and automation.

Skills

Databricks

PySpark

Python

SQL

Delta Lake

Azure Data Factory

GitHub

CI/CD

Data Modeling

Data Governance

AI/ML concepts

Education

Bachelor's or Master's degree in Computer Science, Engineering, Data Science, Information Systems

Tools

GitHub

MLflow

Azure Data Factory

Azure SQL

Databricks Workflows

REST APIs

Job description

SMBC Group is seeking a seasoned Data Engineer to join the Regulatory Reporting & CCAR Technology Team in the Americas. You will design scalable data platforms on Databricks, enabling end-to-end data sourcing, CCAR model execution, data adjustments, and attestation workflows, with strong emphasis on AI/ML-enabled data quality and governance.

You will collaborate with Finance, Risk, and Model Development teams to deliver auditable, regulatory-compliant solutions and support CI/CD, production