Azure Data Engineer

Prodapt Solutions Private Limited; Richardson (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Prodapt is the largest specialized player in the Connectedness industry and seeks an Azure Data Engineer with deep Microsoft Fabric expertise to design, implement, and optimize a unified SaaS analytics platform. This role is based in Richardson, TX, and focuses on end-to-end data pipelines using OneLake, Lakehouses, and PySpark notebooks to deliver enterprise insights.

You will architect Fabric-based data solutions, optimize performance, and ensure seamless integration with Power BI reporting.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related technical field.
• Minimum 3+ years of professional experience in Azure Data Engineering, with at least 1 year hands-on experience inside Microsoft Fabric.
• Deep knowledge of Fabric Lakehouse, Dataflows Gen2, Shortcuts, and Fabric Notebooks.

Responsibilities

• Fabric Architecture Design: Architect and deploy end-to-end data engineering solutions leveraging the Fabric ecosystem including OneLake, Lakehouses, Warehouses, and Streamhouses.
• Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using Fabric Datafactory, Pipelines, and Dataflows Gen2.
• Data Processing & Transformation: Write complex, optimized data transformation scripts using PySpark, Spark SQL, and Python within Fabric Notebooks.
• Modern Data Warehousing: Implement a Medallion Architecture inside OneLake utilizing Delta Lake formats for Delta Live Tables.
• Performance Tuning: Optimize query speeds and pipeline performance through partitioning, indexing, and workspace capacity management.
• Data Modeling & Analytics Integration: Construct Fabric Semantic Models to ensure seamless integration with Power BI reporting.
• Governance & Security: Enforce enterprise data security using Fabric RBAC, Azure Key Vault, Managed Identities, and Microsoft Purview.

Skills

SQL

Python

PySpark

Fabric Lakehouse

Dataflows Gen2

ADF

Azure Synapse

ADLS Gen2

Delta Lake

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure Data Factory

Azure Synapse Analytics

ADLS Gen2

Delta Lake

Fabric Notebooks

OneLake

Job description

Prodapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow. A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider. A “Great Place To Work® Certified™” company, Prodapt employs over 5,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80+ locations globally.

We are seeking a highly skilled Azure Data Engineer with deep expertise in Microsoft Fabric to design, implement, and optimize our next-generation data analytics platform. In this role, you will lead the transition and development of end-to-end data pipelines within a unified SaaS analytics environment. You will leverage the full power of OneLake, Lakehouses, and PySpark notebooks to build scalable, high-performance architectures that transform raw data into actionable enterprise insights.

Responsibilities

• Fabric Architecture Design: Architect and deploy end-to-end data engineering solutions leveraging the Microsoft Fabric ecosystem including OneLake, Lakehouses, Warehouses, and Streamhouses.
• Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using Fabric Datafactory, Pipelines, and Dataflows Gen2.
• Data Processing & Transformation: Write complex, optimized data transformation scripts using PySpark, Spark SQL, and Python within Fabric Notebooks.
• Modern Data Warehousing: Implement a Medallion Architecture (Bronze/Silver/Gold layers) inside OneLake utilizing Delta Lake formats for Delta Live Tables.
• Performance Tuning: Optimize query speeds and pipeline performance through strategic file partitioning, indexing, and workspace capacity management.
• Data Modeling & Analytics Integration: Construct and optimize Fabric Semantic Models to ensure seamless, high-performance integration with Power BI reporting.
• Governance & Security: Enforce enterprise data security using Fabric RBAC, Azure Key Vault, Managed Identities, and Microsoft Purview for metadata lineage.
• DevOps Integration: Implement CI/CD workflows using Git integration and Azure DevOps to automate code deployment across development, testing, and production environments.

Required Skills & Qualifications

• Education: Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related technical field.
• Core Experience: Minimum 3+ years of professional experience in Azure Data Engineering, with at least 1 year of dedicated hands‑on experience working directly inside Microsoft Fabric.
• Tech Stack Mastery:
  • Languages: Advanced proficiency in SQL, Python, and PySpark.
  • Fabric Components: Deep knowledge of Fabric Lakehouse, Dataflows Gen2, Shortcuts, and Fabric Notebooks.
  • Legacy Azure Services: Solid background in traditional Azure data stack tools like Azure Data Factory (ADF), Azure Synapse Analytics, and ADLS Gen2.
• Methodologies: Strong comprehension of Kimball data warehousing methodologies, dimensional modeling, and Delta Lake frameworks.