Senior Data Engineer

Y&L Consulting; United States; Remote; USD 120,000 - 150,000; Full time

Job summary

Y&L Consulting is seeking a hands-on Data Engineer in the United States to build and support a Microsoft Fabric data platform. The role requires leading technical discussions, translating business requirements into data work, and ensuring data quality for Power BI reporting.

You will work closely with client stakeholders and technical teams to design reliable data pipelines, implement Bronze/Silver/Gold datasets, and troubleshoot production issues using version control and CI/CD practices.

Qualifications

• Hands-on data engineer with experience building ingestion and transformation pipelines.
• Experience with bronze/silver/gold data models and reporting-ready datasets.
• Experience with testing, data quality validation, and production issue troubleshooting.

Skills

Data pipelines

SQL

Python

PySpark

Data modeling

Testing & QA

CI/CD

Communications

Tools

Microsoft Fabric

Power BI

Git

Job description

We are seeking a hands-on Data Engineer to build and support our client's Microsoft Fabric data platform. This is not a lead position, but the engineer must be able to lead technical discussions.

Core competencies

• Build and maintain ingestion and transformation pipelines using Microsoft Fabric pipelines, Fabric notebooks, SQL, and Python/PySpark.
• Develop reliable bronze, silver, and gold datasets and reporting-ready data models.
• Perform unit testing, end-to-end testing, and data quality validation; investigate discrepancies and support reconciliation and Power BI reporting. Troubleshoot pipeline failures and production issues using source control, code reviews, documentation, and CI/CD practices.

Communication and collaboration

• Communicate clearly with non-technical client stakeholders, business analysts, and deeply technical team members.
• Translate business requirements into technical work, explain data-quality findings and trade-offs in plain language, and confirm decisions and next steps.Role & responsibilities

Preferred candidate profile