Senior Azure Data Engineer | ADF, Synapse, Lakehouse

Machine Learning Technologies, LLC; Raleigh (NC); Vor Ort; USD 89.000 - 126.000; Vollzeit

Zusammenfassung

Machine Learning Technologies, LLC is seeking an experienced Senior Data Engineer to design, develop, and maintain modern enterprise data solutions primarily on Microsoft Azure and Fabric. The role emphasizes building scalable data pipelines, warehousing, and real-time processing to support analytics across the business.

Ideal candidates will have strong Azure ADF, Synapse analytics, Fabric data engineering, SQL/T-SQL, Python, and Power BI integration skills, and will collaborate with

Qualifikationen

• Experience designing and implementing Azure-based data solutions in enterprise environments.
• Strong SQL/T-SQL and Python for data transformation and workflow development.
• Hands-on with Azure Data Factory, Synapse, Data Lake Gen2, and real-time data processing.

Aufgaben

• Design and implement scalable data integration solutions using Azure Data Factory.
• Develop data pipelines using Microsoft Fabric and Synapse Analytics.
• Build and maintain enterprise data warehouses and lakehouse solutions.
• Develop data transformation workflows using T-SQL and Python.
• Implement data ingestion from multiple enterprise applications and sources.
• Configure and manage Azure Data Lake Storage Gen2.
• Develop real-time data processing solutions using Azure Event Hubs.
• Optimize data processing performance and pipeline execution.
• Implement data security, access management, and governance.
• Collaborate with architects, analysts, and business stakeholders.
• Troubleshoot data pipeline failures and resolve production issues.

Kenntnisse

Azure Data Factory

Azure Synapse Analytics

SQL / T-SQL

Python

Power BI

Azure Data Lake Gen2

Azure Event Hubs

Azure Databricks

Terraform

CI/CD

Tools

Azure Databricks

Terraform

CI/CD pipelines

Jobbeschreibung

Machine Learning Technologies, LLC is seeking an experienced Senior Data Engineer to design, develop, and maintain modern enterprise data solutions primarily on Microsoft Azure and Fabric. The role emphasizes building scalable data pipelines, warehousing, and real-time processing to support analytics across the business.

Ideal candidates will have strong Azure ADF, Synapse analytics, Fabric data engineering, SQL/T-SQL, Python, and Power BI integration skills, and will collaborate with