Lead Data Engineer – Regulatory Reporting & Databricks

SMBC; Charlotte (NC); Hybrid; USD 140,000 - 180,000; Full time

Benefits offered by this job

Hybrid work model

Disability accommodations during the C

Job summary

SMBC Group is seeking a Lead Data Engineer for its Regulatory Reporting and Finance Technology team in the Americas. You will design scalable data pipelines on Databricks, implement data quality controls, and collaborate with Finance, Risk, and Model Development teams to deliver auditable, regulatory‑compliant solutions.

You will work on CCAR model execution, data sourcing, and attestation workflows, applying PySpark, Python, SQL, Delta Lake, and AI/ML concepts to drive operational efficiency

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, Information Systems, or a related field.
• 12+ years of experience in Data Engineering, Data Platform Development, or Analytics Engineering.
• Strong hands‑on experience with: Azure Data Factory, Databricks, PySpark, Python, SQL, Delta Lake, GitHub and CI/CD.
• Experience building cloud‑native and distributed data processing solutions.
• Strong understanding of ETL/ELT architectures, data modeling, data governance, and data quality frameworks.
• Knowledge of AI/ML concepts, machine learning lifecycle management, and model operationalization.
• Excellent analytical, problem‑solving, communication, and stakeholder management skills.

Responsibilities

• Design, develop, and support scalable data pipelines using Databricks, PySpark, Python, SQL, and Delta Lake.
• Build and maintain data sourcing and ingestion frameworks for CCAR, Stress Testing, and Regulatory Reporting.
• Develop and support platforms for CCAR model execution, including PPNR, Balance Sheet, RWA, and other risk models.
• Implement data quality controls, reconciliation processes, lineage tracking, and audit capabilities.
• Develop solutions for data adjustments, management overlays, business overrides, and exception management workflows.
• Build and enhance attestation, approval, and sign‑off workflows for regulatory reporting governance.
• Partner with Finance, Risk, and Regulatory Reporting stakeholders to deliver business‑critical solutions.
• Leverage AI/ML capabilities for data quality monitoring, anomaly detection, intelligent automation, and operational insights.
• Support CI/CD, production releases, troubleshooting, performance tuning, and operational support activities.

Skills

Data Engineering

Databricks

PySpark

Python

SQL

Delta Lake

Azure Data Factory

GitHub

CI/CD

Data Governance

AI/ML concepts

Stakeholder Management

Education

Bachelor's or Master's degree in CS/Engineering/Data Science

Tools

Databricks

Azure Data Factory

GitHub

CI/CD

Delta Lake

Job description

SMBC Group is seeking a Lead Data Engineer for its Regulatory Reporting and Finance Technology team in the Americas. You will design scalable data pipelines on Databricks, implement data quality controls, and collaborate with Finance, Risk, and Model Development teams to deliver auditable, regulatory‑compliant solutions.

You will work on CCAR model execution, data sourcing, and attestation workflows, applying PySpark, Python, SQL, Delta Lake, and AI/ML concepts to drive operational efficiency