Fabric Data Engineer

Affine Analytics; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Affine Analytics is seeking an experienced data engineer to design and manage end-to-end data pipelines using Microsoft Fabric and Fabric Lakehouse. You will build notebooks and data transformation workflows, optimize SQL queries, and ensure data quality, lineage, and monitoring across large-scale data systems in a US-based environment.

Proficiency in Python/PySpark and familiarity with CI/CD practices and datawarehousing concepts will help you drive reliable, scalable analytics solutions for

Qualifications

• Experience with data engineering using Microsoft Fabric and Fabric Lakehouse.
• Strong SQL skills with complex queries, joins and optimization.
• Experience building and maintaining ETL/ELT pipelines.
• Understanding of data warehousing concepts and data modelling.
• Proficient in Python and PySpark for data processing.
• Emphasis on data quality, monitoring and performance optimization.

Skills

Microsoft Fabric

Data engineering

SQL & queries

Data modelling & warehousing

ETL/ELT pipelines

Python/PySpark

Data quality & monitoring

Tools

Fabric Lakehouse

Notebooks

Dataflows Gen2

Git

CI/CD

Delta tables

Power BI

Job description

Required Skills

• 34 years of experience in data engineering, with hands-on exposure to Microsoft Fabric.
• Strong experience in developing and managing data pipelines, notebooks, and data transformation workflows.
• Proficiency in SQL, including complex queries, joins, aggregations, and query optimization.
• Good understanding of database design, data modelling, and data warehousing concepts.
• Experience with data integration, ETL/ELT processes, and pipeline orchestration.
• Working knowledge of Python and PySpark for data processing.
• Understanding of data quality, pipeline monitoring, and performance optimization.

Good to Have

• Hands-on experience with Fabric Lakehouse, Notebooks, and Dataflows Gen2.
• Familiarity with Fabric Warehouse, OneLake, and Delta tables.
• Exposure to Git, version control, and CI/CD practices.
• Familiarity with Power BI and related data integration tools.