Senior Data Engineer - Azure Synapse, ETL Pipelines & AI

American business solutions inc; Raleigh (NC); In loco; USD 110.000 - 170.000; Tempo pieno

Descrizione del lavoro

American business solutions inc in Raleigh, NC is seeking a Senior Data Engineer to design, build, and optimize enterprise ETL/ELT pipelines on Azure. You will work with Azure Synapse, Data Factory, PySpark, SQL, and Power BI to deliver analytics datasets and dashboards, while applying AI integrations and governance.

This role requires 7+ years in data analytics/engineering, strong SQL/PLSQL, and Agile experience; onsite collaboration with business users and security controls are essential.

Competenze

• Experience in enterprise data analytics and engineering.
• 7+ years of ETL workflow design and delivery.
• Advanced SQL and PL/SQL with performance tuning.
• Hands-on PySpark, Python, or Scala experience.
• Azure data modeling and cost optimization knowledge.
• Security with RBAC and Microsoft Entra ID.
• Familiarity with Power BI semantic models and dataflows.
• Knowledge of Azure OpenAI or generative AI data integration is a plus.
• Ability to organize and prioritize complex procedures.

Mansioni

• Design, build, and maintain robust enterprise ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or PL/SQL procedures.
• Manage and optimize Azure Synapse Analytics (SQL and Spark pools) and Microsoft Fabric Lakehouse.
• Develop, test, and tune complex SQL and PL/SQL scripts, stored procedures, packages, and functions to support data integration.
• Collaborate with business users to define analytical goals and build Power BI-ready datasets.
• Integrate AI and machine learning insights using Azure Machine Learning and Azure OpenAI Service.
• Enforce data governance, quality, and security via Microsoft Purview and Microsoft Entra ID.
• Build cross-functional reporting, dashboards, and predictive analytics models

Conoscenze

Enterprise data analytics

Data engineering

ETL workflow design

SQL/PLSQL

Performance tuning

Agile methodologies

RBAC and cloud security

Power BI data modeling

AI integration with Azure

Strumenti

Azure Synapse Analytics

Azure Data Factory

Power BI

PySpark

Python

Scala

Azure OpenAI

Descrizione del lavoro

American business solutions inc in Raleigh, NC is seeking a Senior Data Engineer to design, build, and optimize enterprise ETL/ELT pipelines on Azure. You will work with Azure Synapse, Data Factory, PySpark, SQL, and Power BI to deliver analytics datasets and dashboards, while applying AI integrations and governance.

This role requires 7+ years in data analytics/engineering, strong SQL/PLSQL, and Agile experience; onsite collaboration with business users and security controls are essential.