Data Engineer

Jade Business Services (JBS); Houston (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

Jade Business Services (JBS) seeks a Senior Data Engineer specialized in Microsoft Fabric to lead enterprise-scale data engineering and transformation initiatives in Houston.

You will design and optimize data pipelines, implement governance with Purview, and deliver AI-ready analytics solutions using Lakehouse patterns and Power BI.

Qualifications

• 9+ years of experience in data engineering, ETL/ELT development, or enterprise data platforms.
• Strong hands-on experience with Microsoft Fabric.
• Experience with OneLake, Fabric Lakehouse, Warehouse, and Data Factory pipelines.
• Strong SQL skills and experience with data modelling and performance optimization.
• Hands-on expertise in Python and/or PySpark.
• Strong understanding of Lakehouse architecture and Medallion Architecture.
• Experience building enterprise-scale data integration and transformation pipelines.
• Knowledge of data governance, metadata, lineage, and data quality.
• Working knowledge of Microsoft Purview.
• Experience with Git, CI/CD, monitoring, and production data operations.
• Understanding of cloud security, access controls, and data privacy.
• Strong troubleshooting, analytical, collaboration, and communication skills.

Responsibilities

• Design, develop, and maintain data pipelines using Microsoft Fabric, including OneLake, Lakehouse, Warehouse, and Data Factory.
• Implement scalable ETL/ELT processes for data ingestion, transformation, validation, and consumption.
• Develop and optimize data solutions using SQL, Python, and PySpark.
• Implement Medallion Architecture (Bronze, Silver, and Gold layers) and Lakehouse design patterns.
• Build and maintain reusable data models, semantic models, and datasets for analytics and Power BI.
• Develop and support Data Products aligned with business and domain requirements.
• Implement data quality checks, metadata management, lineage, and governance using Microsoft Purview.
• Apply Data Mesh and Data Fabric principles where appropriate.
• Implement CI/CD pipelines, deployment automation, monitoring, and DataOps best practices.
• Troubleshoot data pipeline failures, optimize query performance, and ensure platform reliability.
• Implement security, access controls, and data protection measures in line with enterprise standards.
• Identify opportunities to use AI and automation to improve data engineering and platform operations.
• Collaborate with architects, business stakeholders, and engineering teams to deliver reliable data solutions.
• Mentor junior data engineers and contribute to code reviews, technical documentation, and engineering standards.

Skills

Data engineering

Microsoft Fabric

OneLake

Fabric Lakehouse

Data Factory

SQL

Python

PySpark

Data governance

Purview

Git

CI/CD

DataOps

Security & privacy

Data mesh

Data products

Lakehouse architecture

Job description

Jade Business Services (JBS) is seeking a Senior Data Engineer – Microsoft Fabric to support enterprise-scale data engineering and transformation initiatives.

We are looking for a hands-on data engineering professional with strong expertise in Microsoft Fabric, SQL, Python/PySpark, data integration, and modern data platform engineering. The ideal candidate will build scalable data pipelines, implement data governance practices, optimize platform performance, and develop reliable, AI-ready data solutions.

Key Responsibilities

• Design, develop, and maintain data pipelines using Microsoft Fabric, including OneLake, Lakehouse, Warehouse, and Data Factory.
• Implement scalable ETL/ELT processes for data ingestion, transformation, validation, and consumption.
• Develop and optimize data solutions using SQL, Python, and PySpark.
• Implement Medallion Architecture (Bronze, Silver, and Gold layers) and Lakehouse design patterns.
• Build and maintain reusable data models, semantic models, and datasets for analytics and Power BI.
• Develop and support Data Products aligned with business and domain requirements.
• Implement data quality checks, metadata management, lineage, and governance using Microsoft Purview.
• Apply Data Mesh and Data Fabric principles where appropriate.
• Implement CI/CD pipelines, deployment automation, monitoring, and DataOps best practices.
• Troubleshoot data pipeline failures, optimize query performance, and ensure platform reliability.
• Implement security, access controls, and data protection measures in line with enterprise standards.
• Identify opportunities to use AI and automation to improve data engineering and platform operations.
• Collaborate with architects, business stakeholders, and engineering teams to deliver reliable data solutions.
• Mentor junior data engineers and contribute to code reviews, technical documentation, and engineering standards.

Required Skills and Qualifications

• 9+ years of experience in data engineering, ETL/ELT development, or enterprise data platforms.
• Strong hands-on experience with Microsoft Fabric.
• Experience with OneLake, Fabric Lakehouse, Warehouse, and Data Factory pipelines.
• Strong SQL skills and experience with data modelling and performance optimization.
• Hands-on expertise in Python and/or PySpark.
• Strong understanding of Lakehouse architecture and Medallion Architecture.
• Experience building enterprise-scale data integration and transformation pipelines.
• Knowledge of data governance, metadata, lineage, and data quality.
• Working knowledge of Microsoft Purview.
• Experience with Git, CI/CD, monitoring, and production data operations.
• Understanding of cloud security, access controls, and data privacy.
• Strong troubleshooting, analytical, collaboration, and communication skills.

Preferred Skills

• Microsoft Fabric or Azure Data certifications.
• Experience migrating Azure Synapse, SQL Server, Databricks, or other data platforms to Microsoft Fabric.
• Experience implementing Data Mesh, Data Products, and domain-oriented data solutions.
• Exposure to AI/ML, Generative AI, or Agentic AI use cases.
• Experience in Energy & Utilities, Healthcare, Financial Services, or Insurance.
• Experience working with US or international enterprise clients.