Senior Data Engineer - Azure Data & AI Analytics

InfoStride; Raleigh (NC); Hybrid; USD 120,000 - 180,000; Full time

Job summary

NC DHHS is seeking a Senior Data Analyst/Engineer to design, manage, and optimize enterprise data pipelines, data warehouses, and analytics solutions in Microsoft Azure. You will transform complex data into business insights and drive advanced analytics using Azure Synapse Analytics, Microsoft Fabric, and Azure AI services.

The role involves designing ETL/ELT pipelines, optimizing Synapse/Spark pools, writing complex SQL/PLSQL, and building dashboards and predictive models while enforcing data

Qualifications

• Experience in enterprise data analytics, engineering, and designing complex ETL workflows.
• Expertise in Azure Synapse Analytics, Azure Data Factory, and cloud data warehousing.
• Strong SQL and PL/SQL skills including optimization and tuning.
• Hands-on PySpark, Python or Scala experience.
• Knowledge of RBAC and cloud security.

Responsibilities

• Design, build, and maintain robust enterprise ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or PL/SQL procedures.
• Manage and optimize Azure Synapse Analytics (SQL and Spark pools) and Microsoft Fabric Lakehouse.
• Develop, test, and tune complex SQL and PL/SQL scripts, stored procedures, packages, and functions for data integration.
• Collaborate with business users to define analytical goals and build Power BI-ready datasets.
• Integrate AI/ML insights using Azure ML and Azure OpenAI Service.
• Enforce data governance, quality, and security via Microsoft Purview and Entra ID.
• Build cross-functional reporting, dashboards, and predictive analytics models

Skills

Azure Synapse Analytics

Azure Data Factory

SQL

PL/SQL

PySpark/Python/Scala

RBAC/Security

Power BI data models

Agile methodologies

Data analytics

ETL workflows

Tools

Azure Synapse Analytics

Synapse Pipelines

Job description

NC DHHS is seeking a Senior Data Analyst/Engineer to design, manage, and optimize enterprise data pipelines, data warehouses, and analytics solutions in Microsoft Azure. You will transform complex data into business insights and drive advanced analytics using Azure Synapse Analytics, Microsoft Fabric, and Azure AI services.

The role involves designing ETL/ELT pipelines, optimizing Synapse/Spark pools, writing complex SQL/PLSQL, and building dashboards and predictive models while enforcing data