Microsoft Fabric Engineer

Tao Digital Solutions Inc.; United States; Sur place; USD 130 000 - 180 000; Plein temps

Résumé du poste

Tao Digital Solutions Inc. is seeking an experienced Microsoft Fabric Engineer to design, develop, and maintain modern data engineering solutions for an automotive industry client.

You will collaborate with data engineers, architects, and analytics teams to build scalable data platforms supporting manufacturing, supply chain, and operations. The role requires hands-on work with Microsoft Fabric, Lakehouse architectures, Data Factory, Spark, SQL, and Power BI, along with CI/CD practices and data

Qualifications

• 5+ years of experience in Data Engineering.
• Hands-on experience with Microsoft Fabric.
• Experience with Azure data services and Spark-based pipelines.
• Strong SQL and Python programming.
• Experience building ETL/ELT pipelines and data warehousing.
• Experience with data governance, security, and performance tuning.

Responsabilités

• Design and develop scalable data engineering solutions using Microsoft Fabric.
• Build and maintain Fabric Lakehouse, Data Warehouse, Data Pipelines, and Notebooks.
• Develop robust ETL/ELT pipelines using Fabric Data Factory and related Azure services.
• Perform data ingestion, transformation, cleansing, and integration from multiple sources.
• Develop solutions using PySpark, Spark SQL, Python, and T-SQL.
• Implement data models and optimize storage and processing for large datasets.
• Develop and maintain batch and near-real-time data pipelines.
• Collaborate with data architects and business teams to translate requirements into technical solutions.
• Support Power BI datasets, semantic models, and analytics workloads where required.
• Implement security, governance, and access controls within the data platform.
• Troubleshoot pipeline failures, data issues, and performance bottlenecks.
• Follow CI/CD and DevOps practices for data engineering deployments.
• Participate in technical design, code reviews, testing, deployment, and production support.

Connaissances

Data Engineering

Microsoft Fabric

Python

SQL / T-SQL

Azure Data Services

Outils

Fabric Lakehouse

Data Factory

OneLake

Spark / PySpark

Power BI

Azure Data Lake Storage

Azure Synapse

Description du poste

We are seeking an experienced Microsoft Fabric Engineer to design, develop, and maintain modern data engineering solutions for a leading automotive industry client. The ideal candidate will have strong hands-on experience with Microsoft Fabric, Azure Data Engineering, Lakehouse architecture, Data Factory, Spark, SQL, and Power BI.

You will work closely with data engineers, architects, business stakeholders, and analytics teams to build scalable and reliable data platforms supporting automotive business functions such as manufacturing, supply chain, connected vehicles, quality, sales, and operations.

Key Responsibilities

• Design and develop scalable data engineering solutions using Microsoft Fabric.
• Build and maintain Fabric Lakehouse, Data Warehouse, Data Pipelines, and Notebooks.
• Develop robust ETL/ELT pipelines using Microsoft Fabric Data Factory and related Azure services.
• Perform data ingestion, transformation, cleansing, and integration from multiple sources.
• Develop solutions using PySpark, Spark SQL, Python, and T-SQL.
• Implement data models and optimize data storage and processing for large datasets.
• Work with Microsoft Fabric OneLake and implement appropriate data architecture patterns.
• Develop and maintain batch and near-real-time data pipelines.
• Integrate data from enterprise applications, databases, APIs, files, and cloud platforms.
• Implement data quality, monitoring, error handling, and performance optimization.
• Collaborate with data architects and business teams to translate requirements into technical solutions.
• Support Power BI datasets, semantic models, and analytics workloads where required.
• Implement security, governance, and access controls within the data platform.
• Troubleshoot pipeline failures, data issues, and performance bottlenecks.
• Follow CI/CD and DevOps practices for data engineering deployments.
• Participate in technical design, code reviews, testing, deployment, and production support.

Required Skills

• 5+ years of experience in Data Engineering.
• Strong hands-on experience with Microsoft Fabric.
• Experience with:
• Microsoft Fabric Data Factory
• OneLake
• Lakehouse
• Fabric Data Warehouse
• Fabric Notebooks
• Spark / PySpark
• Strong programming experience with Python.
• Strong SQL and T-SQL skills.
• Experience with Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, or similar Azure data services.
• Strong understanding of ETL/ELT, data warehousing, dimensional modeling, and data lake architecture.
• Experience working with large-scale enterprise data environments.
• Understanding of data security, governance, monitoring, and performance tuning.
• Experience with Git, Azure DevOps, CI/CD, or similar DevOps tools.

Preferred Qualifications

• Experience in the automotive industry or manufacturing domain.
• Experience with automotive data such as vehicle, manufacturing, supply chain, quality, warranty, or telematics data.
• Microsoft certifications such as Fabric Analytics Engineer Associate, Azure Data Engineer Associate, or equivalent.
• Experience migrating legacy data platforms to Microsoft Fabric.
• Experience with Power BI and semantic models.
• Knowledge of real-time analytics and streaming technologies.
• Experience with Databricks, Snowflake, or other modern data platforms.

Soft Skills

• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Ability to work effectively with technical and business stakeholders.
• Strong ownership and ability to work independently.
• Comfortable working in a fast-paced enterprise environment.