Senior Data Engineer — AI-Driven Data Pipelines (Fabric & Azure)

DataJobs; Plano (TX); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Employee Discount

401(k) Matching*

Growth Opportunities

Education Assistance*

Health Benefits*

Parental Leave*

Paid Time Off*

Daily Pay*

Free Movies*

Job summary

DataJobs in Plano, TX is seeking a Senior Data Engineer to design and operate scalable enterprise data solutions in a Microsoft Fabric and Azure environment on-site in Plano, TX. You will work to build Bronze/Silver/Gold data layers, implement Data Vault 2.0 modeling, and develop dbt models while collaborating with leadership.

The role requires strong SQL and Python skills, experience with Fabric/Azure data platforms, and a track record in CI/CD, DevOps, data quality, and production support.

Qualifications

• Bachelor’s degree in computer science, Engineering, Math or related field is required.
• Master’s degree preferred.
• 5+ years of experience in data engineering, data warehousing, ETL/ELT, or enterprise analytics platforms.
• Strong hands-on SQL skills, plus experience with Python and/or PySpark for data engineering workloads.
• Experience with Microsoft Fabric and Azure data platforms such as Azure Data Factory, Azure Data Lake Storage, Synapse, Databricks, or comparable cloud platforms.
• Strong understanding of data modeling and enterprise architecture concepts.
• Experience implementing data quality, monitoring, observability, automated testing, and production support practices.
• Experience with Git, CI/CD, and DevOps and automated deployment practices.

Responsibilities

• Design, develop, test, deploy, troubleshoot, and optimize enterprise data pipelines and data solutions using Microsoft Fabric, Azure, SQL, Python, Spark, and related technologies.
• Build scalable ingestion, transformation, and data processing frameworks for batch and near-real-time workloads across multiple enterprise data sources.
• Develop and maintain Bronze, Silver, and Gold data layers and implement Data Vault 2.0 and dimensional models.
• Create and maintain dbt models, reusable transformation frameworks, documentation, automated tests, and engineering standards.
• Partner with technical leadership to implement enterprise data architecture patterns, reusable frameworks, platform guardrails, and engineering standards.
• Implement CI/CD, source control, automated testing, deployment pipelines, and DevOps practices for data engineering solutions.
• Build data quality controls, reconciliation processes, monitoring, alerting, lineage, and observability to detect and resolve data issues.
• Support production operations by troubleshooting pipeline failures, performance issues, data defects, and critical incidents; perform root-cause analysis and fixes.
• Optimize data pipelines, SQL queries, Spark workloads, storage, and compute utilization for performance, scalability, reliability, and cost efficiency.
• Implement security, access controls, data protection, and governance in partnership with architecture, governance, and security teams.
• Collaborate with BI, analytics, and business teams to deliver analytics-ready data products and support Power BI semantic models.
• Support migration and modernization of legacy ETL and enterprise data warehouse workloads to Microsoft Fabric, ensuring reconciliation and production readiness.
• Maintain technical documentation including solution designs, data mappings, runbooks, procedures, and production-readiness artifacts.
• Apply AI-assisted engineering to improve developer productivity, accelerate SQL/Python development, and strengthen troubleshooting.

Skills

SQL

Python

PySpark

Spark

Git

CI/CD

DevOps

Agile

Data modeling

Data Vault 2.0

Microsoft Fabric

Azure

Power BI

Education

Bachelor’s degree in computer science, Engineering, Math or related field

Master’s degree

Tools

Microsoft Fabric

Azure Data Factory

Azure Data Lake Storage

Synapse

Databricks

dbt

Git

Power BI

Microsoft Purview

OneLake

Fabric Data Engineering

Fabric Data Factory

Copilot

Job description

DataJobs in Plano, TX is seeking a Senior Data Engineer to design and operate scalable enterprise data solutions in a Microsoft Fabric and Azure environment on-site in Plano, TX. You will work to build Bronze/Silver/Gold data layers, implement Data Vault 2.0 modeling, and develop dbt models while collaborating with leadership.

The role requires strong SQL and Python skills, experience with Fabric/Azure data platforms, and a track record in CI/CD, DevOps, data quality, and production support.