Azure Data Engineer Lead for Cloud Migration & Analytics

SMBC Group; Charlotte (NC); Hybrid; USD 158,000 - 205,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

SMBC Group is seeking a Senior Data Engineer to join our Cloud data solutions team in Charlotte, NC. You will design, develop and deploy cloud data solutions for risk, regulatory, finance and compliance initiatives, leading on-prem to cloud migration efforts.

Responsibilities include mentoring junior engineers, collaborating with product managers and IT, and building large-scale data pipelines in Azure using Databricks, Data Factory, SQL and microservice patterns. Hybrid work offered.

Qualifications

• Extensive experience on Cloud solutions, specifically in Azure.
• Experience with Azure Data Factory, Gen 2, Azure Databases, Functions, Databricks.
• Strong knowledge of Python, Java or similar high-level server-side languages.
• Advanced working SQL knowledge on relational databases, preferably MS SQL Server and databases on Azure cloud.
• Experience with the DevOps lifecycle (git, Jenkins, etc.).
• Experience with Jira/Confluence.
• Experience with REST web services and microservice architecture.
• Databricks Cluster configuration, Unity catalog repository configuration.
• Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform.
• Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise grade platforms that enable data-driven solutions.
• Coordinating with platform, APIM, Azure DevOps, and Support.
• Analyze and design technical solutions on Azure to address business needs.
• Develop, test, and modify software to improve efficiency of data platforms and applications.
• Integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
• Enable streaming data use-cases and standard design patterns in a big data environment.
• Review and provide feedback on core code changes and support production deployment.
• Minimum 4 years of software development experience in enterprise applications, preferably in the financial services industry and on data-heavy systems.
• Bachelor’s or master’s degree in computer science or information systems preferred.

Responsibilities

• Design, develop & deploy cloud data solutions for risk, regulatory, finance & compliance projects.
• Lead on-prem to cloud migration initiatives and mentor junior team members.
• Work with business teams, product managers, and stakeholders to understand requirements.
• Engage with IT systems architects, DBAs, and cybersecurity to meet backend demands.
• Coordinate with platform, APIM, Azure DevOps, and Support for integration efforts.
• Analyze and design Azure-based solutions to address business needs.

Job description

SMBC Group is seeking a Senior Data Engineer to join our Cloud data solutions team in Charlotte, NC. You will design, develop and deploy cloud data solutions for risk, regulatory, finance and compliance initiatives, leading on-prem to cloud migration efforts.

Responsibilities include mentoring junior engineers, collaborating with product managers and IT, and building large-scale data pipelines in Azure using Databricks, Data Factory, SQL and microservice patterns. Hybrid work offered.