Azure Data Engineer

Prodapt; Richardson (TX); On-site; USD 110,000 - 170,000; Full time

Job summary

Prodapt is seeking an Azure Data Engineer to design, implement, and optimize data pipelines within a Microsoft Fabric-based analytics platform. You will leverage OneLake, Lakehouses, and PySpark notebooks to build scalable, enterprise-grade data solutions that feed Power BI reports.

In this role, you will architect end-to-end data pipelines, ensure data quality and security, and collaborate with engineering and analytics teams to deliver actionable insights across the organization.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or related field.
• 3+ years of Azure Data Engineering experience, including ≥1 year with Microsoft Fabric.
• Proficient in SQL, Python, and PySpark.
• Deep knowledge of Fabric Lakehouse, Dataflows Gen2, Shortcuts, and Fabric Notebooks.
• Experience with Azure Data Factory, Synapse, and ADLS Gen2.
• Understanding of Kimball dimensional modeling and Delta Lake frameworks.

Responsibilities

• Architect and deploy end-to-end data engineering solutions using the Fabric ecosystem.
• Design and maintain scalable ETL/ELT pipelines with Fabric Dataflows Gen2.
• Write optimized data transformations with PySpark, Spark SQL, and Python.
• Implement Medallion-style data warehousing in OneLake and Delta Lake formats.
• Tune performance via partitioning, indexing, and resource management.
• Model Fabric Semantic Models for seamless Power BI integration.
• Enforce data governance and security using Fabric RBAC and Purview.
• Collaborate with DevOps to CI/CD deployments across environments.

Skills

SQL

Python

PySpark

Fabric Notebooks

Fabric Lakehouse

Dataflows Gen2

Delta Lake

Power BI

Education

Bachelor's degree in CS/IS/Data Eng

Tools

OneLake

Lakehouses

Dataflows Gen2

Fabric Notebooks

Azure Data Factory

Azure Synapse

ADLS Gen2

Power BI

Job description

Overview Prodapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow. A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider. A “Great Place To Work® Certified™” company, Prodapt employs over 5,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80+ locations globally.

Overview Prodapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow. A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider. A “Great Place To Work® Certified™” company, Prodapt employs over 5,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80+ locations globally.

We are seeking a highly skilled Azure Data Engineer with deep expertise in Microsoft Fabric to design, implement, and optimize our next-generation data analytics platform. In this role, you will lead the transition and development of end-to-end data pipelines within a unified SaaS analytics environment. You will leverage the full power of OneLake, Lakehouses, and PySpark notebooks to build scalable, high-performance architectures that transform raw data into actionable enterprise insights.

Responsibilities

• Fabric Architecture Design: Architect and deploy end-to-end data engineering solutions leveraging the Microsoft Fabric ecosystem including OneLake, Lakehouses, Warehouses, and Streamhouses.
• Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using Fabric Datafactory, Pipelines, and Dataflows Gen2.
• Data Processing & Transformation: Write complex, optimized data transformation scripts using PySpark, Spark SQL, and Python within Fabric Notebooks.
• Modern Data Warehousing: Implement a Medallion Architecture (Bronze/Silver/Gold layers) inside OneLake utilizing Delta Lake formats for Delta Live Tables.
• Performance Tuning: Optimize query speeds and pipeline performance through strategic file partitioning, indexing, and workspace capacity management.
• Data Modeling & Analytics Integration: Construct and optimize Fabric Semantic Models to ensure seamless, high-performance integration with Power BI reporting.
• Governance & Security: Enforce enterprise data security using Fabric RBAC, Azure Key Vault, Managed Identities, and Microsoft Purview for metadata lineage.
• DevOps Integration: Implement CI/CD workflows using Git integration and Azure DevOps to automate code deployment across development, testing, and production environments.

Requirements

Required Skills & Qualifications

• Education: Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related technical field.
• Core Experience: Minimum 3+ years of professional experience in Azure Data Engineering, with at least 1 year of dedicated hands‑on experience working directly inside Microsoft Fabric.
• Tech Stack Mastery:
  • Languages: Advanced proficiency in SQL, Python, and PySpark.
  • Fabric Components: Deep knowledge of Fabric Lakehouse, Dataflows Gen2, Shortcuts, and Fabric Notebooks.
  • Legacy Azure Services: Solid background in traditional Azure data stack tools like Azure Data Factory (ADF), Azure Synapse Analytics, and ADLS Gen2.
• Methodologies: Strong comprehension of Kimball data warehousing methodologies, dimensional modeling, and Delta Lake frameworks.