CCAR Data Engineer – Databricks, PySpark & AI/ML

SMBC Group; Charlotte (NC); Hybrid; USD 120,000 - 160,000; Full time

Job summary

SMBC Group is seeking a Data Engineer to join the Regulatory Reporting & CCAR Technology Team. The role focuses on building scalable data platforms on Databricks to support CCAR model execution, data sourcing, adjustments, and attestation workflows.

Strong skills in Databricks, PySpark, Python, SQL, and AI/ML are required. The candidate will collaborate with Finance, Risk, Data Management, and Model Development teams to enhance regulatory reporting processes and operational efficiency in a

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, Information Systems, or related field.
• 7+ years of experience in Data Engineering, Data Platform Development, or Analytics Engineering.
• Strong hands-on experience with Azure Data Factory, Databricks, PySpark, Python, SQL, Delta Lake, GitHub and CI/CD.

Responsibilities

• Design, develop, and support scalable data pipelines using Databricks, PySpark, Python, SQL, and Delta Lake.
• Build and maintain data sourcing and ingestion frameworks for CCAR, Stress Testing, and Regulatory Reporting.
• Develop and support platforms for CCAR model execution, including PPNR, Balance Sheet, RWA, and other risk models.
• Implement data quality controls, reconciliation processes, lineage tracking, and audit capabilities.
• Develop solutions for data adjustments, management overlays, business overrides, and exception management workflows.
• Build and enhance attestation, approval, and sign-off workflows for regulatory reporting governance.
• Partner with Finance, Risk, and Regulatory Reporting stakeholders to deliver business-critical solutions.
• Leverage AI/ML capabilities for data quality monitoring, anomaly detection, intelligent automation, and operational insights.
• Support CI/CD, production releases, troubleshooting, performance tuning, and operational support activities.

Skills

Databricks

PySpark

Python

SQL

Delta Lake

Azure Data Factory

CI/CD

GitHub

Education

Bachelor's degree in CS/Engineering/Data Science

Master's degree

Tools

Databricks

Azure

Job description

SMBC Group is seeking a Data Engineer to join the Regulatory Reporting & CCAR Technology Team. The role focuses on building scalable data platforms on Databricks to support CCAR model execution, data sourcing, adjustments, and attestation workflows.

Strong skills in Databricks, PySpark, Python, SQL, and AI/ML are required. The candidate will collaborate with Finance, Risk, Data Management, and Model Development teams to enhance regulatory reporting processes and operational efficiency in a