Azure Data Platform Lead: Senior Data Engineer

Ryan Specialty, LLC; Carmel (IN); On-site; USD 140,000 - 175,000; Full time

Benefits offered by this job

Excellent benefits

Paid time off

Job summary

Ryan Specialty, LLC is seeking a Lead Azure Data Engineer to drive data architecture and scalable pipelines on the Azure cloud. You will mentor engineers, implement real-time and batch data integration, and ensure data quality across sources using Delta Parquet and Databricks.

The role emphasizes governance with Azure Purview, Profisee MDM integration, and strong Tableau BI capabilities. Requires extensive SQL Server experience and leadership in a fast-paced environment.

Qualifications

• Bachelor’s degree required; Master’s degree preferred.
• 12+ years of data engineering experience; or 8+ years with a Master’s degree.
• Subject matter expert in SQL Server, Azure Data Factory, Databricks, Delta Parquet, and SSIS/SSRS.
• Proficiency with Profisee MDM integration, CDC, and data governance using Azure Purview.
• Experience with Tableau BI reporting and automation in Azure cloud.
• Licenses & Certifications such as ADAC, SBAPC, or CCP Data Engineer a plus.

Responsibilities

• Provide technical leadership in data architecture and engineering.
• Mentor junior data engineers and team members.
• Explore and implement new data engineering technologies and practices.
• Manage and enhance SSIS packages and SSRS reports for BI.
• Design and maintain scalable data pipelines using Azure Data Factory.
• Develop and optimize Databricks notebooks for big data processing.
• Implement Delta Parquet storage in Azure Data Lake Storage.
• Set up Change Data Capture and data cataloging with Azure Purview.
• Enhance Tableau reporting and integrate with Azure data services.
• Drive CI/CD pipelines using Azure DevOps and automate processes.

Skills

Big Data Analytics

Leadership

Data Governance

Data Modeling

Data Processing

Education

Bachelor’s degree

Master’s degree

Tools

SSIS

SSRS

Azure Data Factory

Databricks

Delta Parquet

Profisee MDM

Azure Purview

Change Data Capture

Tableau

Azure DevOps

Job description

Ryan Specialty, LLC is seeking a Lead Azure Data Engineer to drive data architecture and scalable pipelines on the Azure cloud. You will mentor engineers, implement real-time and batch data integration, and ensure data quality across sources using Delta Parquet and Databricks.

The role emphasizes governance with Azure Purview, Profisee MDM integration, and strong Tableau BI capabilities. Requires extensive SQL Server experience and leadership in a fast-paced environment.