Cloud Data Solutions Lead — Azure & Databricks (Finance)

SMBC Group; Charlotte (NC); On-site; USD 140,000 - 190,000; Full time

Job summary

SMBC Group in Charlotte, NC seeks a Cloud Data Solutions Lead to oversee the design, development, and deployment of cloud data solutions across risk, regulatory, finance, and compliance initiatives. Lead cross-functional teams, mentor juniors, and drive on-prem to cloud migration with Azure and Databricks.

Collaborate with architects, engineers, and business stakeholders to deliver enterprise-grade data platforms.

Qualifications

• 10+ years of software development experience in enterprise applications.
• Preferably in the financial services industry and on data-heavy systems.
• Bachelor’s or master’s degree in computer science or information systems preferred.

Responsibilities

• Extensive experience on Cloud solutions, specifically in Azure and Databricks.
• Experience with Azure cloud services, Azure Data Factory, Gen 2, Azure Databases, Functions, Databricks, etc.
• Strong knowledge of Python, Java or similar high-level server-side languages.
• Advanced working SQL knowledge on relational databases, preferably on MS SQL Server and databases on Azure cloud.
• Experience designing and architecting distributed systems, containerization, Web API’s and gateway management.
• Experience with the DevOps lifecycle (git, Jenkins, etc.).
• Experience with Jira/Confluence.
• Experience with REST web services and microservice architecture.
• Good understanding of ETL/ELT.
• Databricks Cluster configuration, Unity catalog repository configuration.
• Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform.
• Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise grade platforms that enable data-driven solutions.
• Provide technical guidance on technology implementation and architectural changes.
• Coordinating with platform, APIM, Azure DevOps, and Support.
• Analyze and design technical solutions on Azure to address business needs.
• Develop, test, and modify software to improve efficiency of data platforms and applications.
• Ability to own projects from end to end, working with business stakeholders, IT teams, data stewards, and 3rd party companies to ensure accurate and insightful outcomes.
• Integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
• Enable streaming data use-cases and standard design patterns in a big data environment.
• Review and provide feedback on core code changes and support production deployment.

Skills

Azure

Azure Databricks

Python/Java

SQL

Distributed systems

DevOps

REST APIs

Jira/Confluence

ETL/ELT

Data pipelines

Education

Bachelor’s or Master’s in CS/IS preferred

Tools

Azure Data Factory

Databricks

Git

Jenkins

Azure DevOps

SQL Server

Unity Catalog

Confluence

Azure Databricks (tool)

Job description

SMBC Group in Charlotte, NC seeks a Cloud Data Solutions Lead to oversee the design, development, and deployment of cloud data solutions across risk, regulatory, finance, and compliance initiatives. Lead cross-functional teams, mentor juniors, and drive on-prem to cloud migration with Azure and Databricks.

Collaborate with architects, engineers, and business stakeholders to deliver enterprise-grade data platforms.