Data Engineer - Azure Databricks, SQL & Python (Hybrid)

SMBC Group; Charlotte (NC); Hybrid; USD 97,000 - 154,000; Full time

Job summary

SMBC Group is seeking an Associate Data Engineer/Technology Analyst in Charlotte, NC to join the Market Surveillance Technology team. The role focuses on migrating data processing to Azure Databricks and building scalable data pipelines, with strong SQL and Python/PySpark expertise.

The candidate will optimize analytics models, improve performance, and support regulatory surveillance data workflows while working in a hybrid model with onsite and remote options.

Qualifications

• 3–5+ years of relevant experience in financial services data environments.
• Strong SQL expertise and Python/PySpark development.
• Experience migrating to Azure Databricks and building ETL/ELT pipelines.
• Ability to optimize analytics models and scale Spark workloads.

Responsibilities

• Migrate and modernize data processing from Azure-SQL to Azure Databricks.
• Develop scalable data ingestion, transformation, and data-quality processes.
• Optimize Python-based analytics models and Spark performance.

Skills

SQL

Python

PySpark

Azure Databricks

Azure Data Factory

ETL/ELT

Data engineering

Job description

SMBC Group is seeking an Associate Data Engineer/Technology Analyst in Charlotte, NC to join the Market Surveillance Technology team. The role focuses on migrating data processing to Azure Databricks and building scalable data pipelines, with strong SQL and Python/PySpark expertise.

The candidate will optimize analytics models, improve performance, and support regulatory surveillance data workflows while working in a hybrid model with onsite and remote options.