Data Mesh Engineer: Real-Time Pipelines & Fabric

JE Dunn Construction; Kansas City (MO); On-site; USD 95,000 - 140,000; Full time

Job summary

JE Dunn Construction is seeking a Data Engineer to design, implement, and maintain an enterprise data architecture using Microsoft Fabric. You will build scalable data pipelines, apply medallion architectures within lakehouses, and ensure data quality and accessibility to support the company strategy.

You will collaborate with data consumers and source system owners to create a robust data foundation, monitor performance, and document data pipelines and models, while supporting ML initiatives

Qualifications

• Bachelor's degree in computer science, data engineering, data science or related field.
• Equivalent relevant experience will be considered.

Responsibilities

• Design and implement a data mesh architecture with governance and security measures.
• Establish data transformation processes ensuring data quality and consistency.
• Develop and maintain real-time and batch data integration pipelines with unidirectional and bidirectional data flows.
• Develop and maintain API and delta connections for data interoperability.
• Implement data validation processes to ensure successful data exchange.
• Monitor system performance, compute resources, and storage utilization.
• Troubleshoot and resolve data pipeline failures and bottlenecks.
• Maintain documentation of data architecture, pipelines, and processes.
• Foster cross-departmental collaboration to identify data synergies.
• Monitor and maintain deployed ML models and data dependencies.

Skills

SQL

Python

Spark

MS Office

Communication

Time management

Data governance

REST APIs

Power BI

Microsoft Fabric

Data mesh

Medallion models

Data integration

Education

Bachelor’s degree in computer science / data engineering / data science

Equivalent experience

Tools

Microsoft Fabric

Microsoft Purview

OneLake Lakehouses

Job description

JE Dunn Construction is seeking a Data Engineer to design, implement, and maintain an enterprise data architecture using Microsoft Fabric. You will build scalable data pipelines, apply medallion architectures within lakehouses, and ensure data quality and accessibility to support the company strategy.

You will collaborate with data consumers and source system owners to create a robust data foundation, monitor performance, and document data pipelines and models, while supporting ML initiatives