Senior Microsoft Fabric Performance & Scalability Specialist

Algoworks; India; Remote; INR 6,000,000 - 9,000,000; Full time

Job summary

Algoworks seeks a hands-on Senior Microsoft Fabric Performance & Scalability Specialist with 10+ years of Data Engineering and Data Warehousing experience to optimize, scale, and support an enterprise Fabric platform serving 1,500+ clients. The role emphasizes production delivery, not just architecture, with focus on performance tuning and multi-tenant workloads.

You will lead Fabric Data Warehouse, Lakehouse, Notebooks, and Pipelines development, onboard new data sources, and manage production

Qualifications

• 10+ years in Data Engineering or Data Warehousing.
• Hands-on Microsoft Fabric production experience.
• Proven data-platform optimization and scalability experience.
• Strong PySpark, Python and SQL development and tuning.
• Experience with Medallion Architecture (Bronze/Silver/Gold).

Responsibilities

• Optimize Fabric performance and scalability across Data Warehouse, Lakehouse, and OneLake.
• Develop scalable data-processing pipelines and notebooks.
• Onboard new data sources and tables into Fabric platform.
• Support client onboarding, production issues and SLA management.
• Coordinate with ETL/Data Engineering teams to ensure data quality and performance.

Skills

Microsoft Fabric

Fabric Data Warehouse

Fabric Lakehouse

OneLake

Fabric Pipelines

Fabric Notebooks

PySpark

Python

Advanced SQL

SQL Performance

Medallion Architecture

Full Processing

Incremental Processing

Multi-tenant Workloads

Data Onboarding

Troubleshooting

Job description

Senior Microsoft Fabric Performance & Scalability Specialist

Location: India, Remote

Experience: 10+ Years

Algoworks

About the company

Algoworks is an award-winning artificial intelligence, engineering services and experience transformation firm with offices across the United States, Europe, South America and India. We bring together a global team of engineers, architects, designers, researchers and operators united by rigor, accountability and a commitment to delivering measurable results.

For over 20 years, Algoworks has partnered with Fortune 500 organizations across the Americas, Europe and Asia to define, build and run technology that drives meaningful business outcomes. Our work combines human-centered design, engineering excellence and AI-powered capabilities to solve complex challenges with clarity and precision. Innovation, particularly in the responsible application of AI, is embedded in how teams approach problem-solving and continuous improvement.

At Algoworks, growth is continuous and closely tied to impact. Teams collaborate across geographies and disciplines, strengthening outcomes through shared insight and collective expertise. The culture values transparency, open dialogue and an environment where every voice is heard and contribution is recognized.

Through collaboration, accountability and a focus on results, Algoworks operates at the intersection of technology and people, building not only advanced systems but strong global teams that elevate performance and create lasting impact.

Follow the video below to know about us! Clipchamp

Role overview

We are seeking a hands-on Senior Microsoft Fabric Performance & Scalability Specialist with 10+ years of Data Engineering and Data Warehousing experience to optimize, scale, develop, and support an enterprise Microsoft Fabric platform supporting 1,500+ clients/tenants.

The role will focus on Fabric performance optimization, multi-tenant scalability, Fabric development, new data-source onboarding, client onboarding and support, production issue resolution, and SLA management.

The ideal candidate must have strong hands-on experience with Microsoft Fabric, Fabric Data Warehouse, Lakehouse, PySpark, Python, SQL performance tuning, and Medallion Architecture (Bronze/Silver/Gold). This is a hands-on development and performance optimization role focused on production delivery rather than primarily architecture or administration.

Key responsibilities

1.Microsoft Fabric Performance & Scalability

• Optimize Microsoft Fabric performance, scalability, concurrency, and capacity utilization across Fabric Data Warehouse, Lakehouse, OneLake, Shortcuts, Pipelines, and Notebooks.
• Design and enhance the platform to efficiently support migration and ongoing processing for 1,500+ tenants/clients.
• Develop scalable processing strategies for high-volume and low-volume tenants while meeting data-load and reporting SLAs.
• Analyze Fabric capacity/CU utilization, throttling, concurrency, Query Insights, and workload performance.
• Implement performance optimization recommendations based on workload analysis.
• Conduct performance, scalability, concurrency, stress, and load testing.
• Establish measurable performance benchmarks and continuously improve platform performance.

2.Fabric Development & Data Processing

• Develop and enhance Fabric notebooks using PySpark, Python, and SQL for scalable full and incremental data processing.
• Optimize tenant grouping, batching, parallel processing, concurrency control, workload prioritization, watermark processing, retries, and failure recovery.
• Optimize Fabric Data Warehouse SQL queries, data loads, joins, table structures, and CLUSTER BY strategies.
• Develop reusable and scalable data-processing frameworks for enterprise workloads.
• Support production-grade development and optimization of Fabric-based data solutions.

3.New Data Source Development & Onboarding

• Work closely with ETL/Data Engineering teams to onboard new data sources and new sets of tables into Microsoft Fabric.
• Analyze source schemas, tables, relationships, data volumes, dependencies, primary keys, and incremental-load requirements.
• Perform required development, code changes, configuration, and testing in Microsoft Fabric for newly introduced data sources and tables.
• Develop and enhance Fabric notebooks, pipelines, SQL code, metadata/control frameworks, Lakehouse objects, and Fabric Data Warehouse tables.
• Configure and test full and incremental data-loading processes for newly onboarded tables.
• Perform unit, integration, data-validation, and performance testing before production deployment.
• Coordinate with ETL teams to validate source-to-target mappings, transformation logic, dependencies, and data completeness.
• Develop reusable and metadata-driven patterns to reduce development effort for future data-source and table onboarding.

4.Client Onboarding & Production Support

• Work directly with clients and internal teams during onboarding, migration, production cutover, and post-production support.
• Understand client data volumes, processing requirements, dependencies, and SLA expectations.
• Support client onboarding activities including full loads, incremental-load enablement, data validation, performance validation, and production cutover.
• Investigate and resolve client-reported data, performance, data-load, and reporting issues.
• Perform end-to-end root-cause analysis across source systems, Medallion layers, Fabric notebooks, pipelines, Lakehouse, Data Warehouse, and reporting workloads.
• Troubleshoot missing or duplicate data, failed or delayed loads, incremental-processing issues, performance degradation, and SLA violations.
• Implement permanent fixes and enhance shared frameworks to prevent recurring issues across tenants.

5.Production Operations & SLA Management

• Monitor production workloads and ensure data-processing and reporting SLAs are consistently achieved.
• Identify performance bottlenecks, capacity constraints, processing failures, and concurrency issues.
• Prioritize and resolve production incidents based on business impact and SLA requirements.
• Collaborate with ETL, Data Engineering, reporting, and client-facing teams to resolve complex production issues.
• Document root-cause analysis, corrective actions, and preventive measures.
• Continuously improve production stability, reliability, and operational efficiency.

Required technical skills and competencies:

• 10+ years of experience in Data Engineering, Data Warehousing, ETL/ELT, or enterprise data platforms.
• Strong recent hands-on Microsoft Fabric production experience.
• Proven experience in Microsoft Fabric performance optimization and scalability.
• Strong hands-on experience with Fabric Data Warehouse, Lakehouse, OneLake, Pipelines, and Notebooks.
• Advanced PySpark, Python, and SQL development and performance-tuning skills.
• Strong production experience with Medallion Architecture (Bronze/Silver/Gold) – mandatory.
• Experience developing and optimizing large-scale full and incremental data-loading frameworks.
• Experience handling high-volume, concurrent, and multi-tenant workloads.
• Strong understanding of Fabric capacity, CU utilization, concurrency, throttling, and workload management.
• Hands-on experience with new data-source and table onboarding, development, testing, and production deployment.
• Experience working collaboratively with ETL/Data Engineering teams to implement source-to-target data pipelines.
• Experience working directly with clients during onboarding, migration, and production issue resolution.
• Strong troubleshooting, root-cause analysis, communication, and problem-solving skills.

Must have skills:

• Microsoft Fabric.
• Fabric Data Warehouse.
• Microsoft Fabric Lakehouse.
• OneLake.
• Fabric Pipelines.
• Fabric Notebooks.
• PySpark.
• Python.
• Advanced SQL.
• SQL Performance Tuning.
• Medallion Architecture – Bronze/Silver/Gold.
• Full and Incremental Data Processing.
• Fabric Capacity and CU Optimization.
• Concurrency and Workload Management.
• Data Source and Table Onboarding.
• Production Support and Troubleshooting.
• SLA Management.

Good to have skills:

• Experience supporting platforms with 1,000+ tenants/clients or comparable enterprise-scale workloads.
• Microsoft Fabric F-SKU capacity optimization and workload management.
• ADLS Gen2.
• Databricks.
• OneLake Shortcuts.
• Metadata-driven ETL/ELT frameworks.
• Load and concurrency testing.

Desired attributes:

• Strong hands-on development and performance optimization mindset.
• Ability to take a new data source or set of tables from analysis through Fabric development, testing, deployment, and production support.
• Strong production troubleshooting and root-cause analysis capabilities.
• Ability to work effectively with ETL, Data Engineering, reporting, and client-facing teams.
• Strong understanding of enterprise-scale and multi-tenant data processing.
• Excellent communication and stakeholder management skills.
• Strong ownership of production stability, performance, and SLA adherence.
• Ability to work effectively in a high-volume, fast-paced production environment.
• Strong analytical and problem-solving capabilities.
• Proactive approach to performance optimization and continuous improvement.