Senior Data Engineer

DataJobs; Plano (TX); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Employee Discount

401(k) Matching*

Growth Opportunities

Education Assistance*

Health Benefits*

Parental Leave*

Paid Time Off*

Daily Pay*

Free Movies*

Job summary

DataJobs in Plano, TX is seeking a Senior Data Engineer to design and operate scalable enterprise data solutions in a Microsoft Fabric and Azure environment on-site in Plano, TX. You will work to build Bronze/Silver/Gold data layers, implement Data Vault 2.0 modeling, and develop dbt models while collaborating with leadership.

The role requires strong SQL and Python skills, experience with Fabric/Azure data platforms, and a track record in CI/CD, DevOps, data quality, and production support.

Qualifications

• Bachelor’s degree in computer science, Engineering, Math or related field is required.
• Master’s degree preferred.
• 5+ years of experience in data engineering, data warehousing, ETL/ELT, or enterprise analytics platforms.
• Strong hands-on SQL skills, plus experience with Python and/or PySpark for data engineering workloads.
• Experience with Microsoft Fabric and Azure data platforms such as Azure Data Factory, Azure Data Lake Storage, Synapse, Databricks, or comparable cloud platforms.
• Strong understanding of data modeling and enterprise architecture concepts.
• Experience implementing data quality, monitoring, observability, automated testing, and production support practices.
• Experience with Git, CI/CD, and DevOps and automated deployment practices.

Responsibilities

• Design, develop, test, deploy, troubleshoot, and optimize enterprise data pipelines and data solutions using Microsoft Fabric, Azure, SQL, Python, Spark, and related technologies.
• Build scalable ingestion, transformation, and data processing frameworks for batch and near-real-time workloads across multiple enterprise data sources.
• Develop and maintain Bronze, Silver, and Gold data layers and implement Data Vault 2.0 and dimensional models.
• Create and maintain dbt models, reusable transformation frameworks, documentation, automated tests, and engineering standards.
• Partner with technical leadership to implement enterprise data architecture patterns, reusable frameworks, platform guardrails, and engineering standards.
• Implement CI/CD, source control, automated testing, deployment pipelines, and DevOps practices for data engineering solutions.
• Build data quality controls, reconciliation processes, monitoring, alerting, lineage, and observability to detect and resolve data issues.
• Support production operations by troubleshooting pipeline failures, performance issues, data defects, and critical incidents; perform root-cause analysis and fixes.
• Optimize data pipelines, SQL queries, Spark workloads, storage, and compute utilization for performance, scalability, reliability, and cost efficiency.
• Implement security, access controls, data protection, and governance in partnership with architecture, governance, and security teams.
• Collaborate with BI, analytics, and business teams to deliver analytics-ready data products and support Power BI semantic models.
• Support migration and modernization of legacy ETL and enterprise data warehouse workloads to Microsoft Fabric, ensuring reconciliation and production readiness.
• Maintain technical documentation including solution designs, data mappings, runbooks, procedures, and production-readiness artifacts.
• Apply AI-assisted engineering to improve developer productivity, accelerate SQL/Python development, and strengthen troubleshooting.

Skills

SQL

Python

PySpark

Spark

Git

CI/CD

DevOps

Agile

Data modeling

Data Vault 2.0

Microsoft Fabric

Azure

Power BI

Education

Bachelor’s degree in computer science, Engineering, Math or related field

Master’s degree

Tools

Microsoft Fabric

Azure Data Factory

Azure Data Lake Storage

Synapse

Databricks

dbt

Git

Power BI

Microsoft Purview

OneLake

Fabric Data Engineering

Fabric Data Factory

Copilot

Job description

Senior Data Engineer to design and operate scalable enterprise data solutions in a Microsoft Fabric and Azure environment on-site in Plano, TX.

Responsibilities

• Design, develop, test, deploy, troubleshoot, and optimize enterprise data pipelines and data solutions using Microsoft Fabric, Azure, SQL, Python, Spark, and related technologies
• Build scalable ingestion, transformation, and data processing frameworks for batch and near-real-time workloads across multiple enterprise data sources
• Develop and maintain Bronze, Silver, and Gold data layers and implement enterprise modeling patterns, including Data Vault 2.0 and dimensional or curated models where appropriate
• Create and maintain dbt models, reusable transformation frameworks, documentation, automated tests, and engineering standards
• Partner with technical leadership to implement enterprise data architecture patterns, reusable frameworks, platform guardrails, and engineering standards
• Implement CI/CD, source control, automated testing, deployment pipelines, and DevOps practices for data engineering solutions
• Build data quality controls, reconciliation processes, monitoring, alerting, lineage, and observability to proactively detect and resolve data issues
• Support production operations by troubleshooting pipeline failures, performance issues, data defects, and critical incidents; perform root-cause analysis and implement permanent fixes
• Optimize data pipelines, SQL queries, Spark workloads, storage, and compute utilization for performance, scalability, reliability, and cost efficiency
• Implement security, access controls, data protection, and governance requirements in partnership with architecture, governance, and security teams
• Collaborate with BI, analytics, and business teams to deliver trusted, analytics-ready data products and support Power BI semantic models and reporting solutions
• Support migration and modernization of legacy ETL and enterprise data warehouse workloads to Microsoft Fabric, ensuring reconciliation, business continuity, and production readiness
• Maintain technical documentation including solution designs, data mappings, operational runbooks, support procedures, and production-readiness artifacts
• Apply AI-assisted engineering capabilities to improve developer productivity, accelerate SQL/Python development, support code quality, automate documentation and testing, and strengthen troubleshooting and root-cause analysis
• Enable AI-ready data products by ensuring data is trusted, well-modeled, governed, documented, and accessible for AI, machine learning, natural-language querying, and advanced analytics use cases

Requirements

• Bachelor’s degree in computer science, Engineering, Math or related field is required
• Master’s degree preferred
• 5+ years of experience in data engineering, data warehousing, ETL/ELT, or enterprise analytics platforms, with experience delivering production-grade data solutions
• Strong hands-on SQL skills, plus experience with Python and/or PySpark for data engineering workloads
• Experience with Microsoft Fabric and Azure data platforms such as Azure Data Factory, Azure Data Lake Storage, Synapse, Databricks, or comparable modern cloud platforms
• Strong understanding of data modeling and enterprise architecture concepts, including dimensional modeling and data lake/lakehouse patterns
• Experience implementing data quality, monitoring, observability, automated testing, and production support practices
• Experience with Git, CI/CD, and DevOps and automated deployment practices
• Strong analytical, troubleshooting, communication, and cross-functional collaboration skills
• Experience with or knowledge of Agile software development methodologies
• Strong aptitude for learning new technologies and analytics techniques
• Communication skills to develop and present solutions to all levels of management
• Must be able to interact effectively and patiently with customers, including while under pressure
• Ability to work on multiple projects/tasks simultaneously to meet deadlines for self and others
• Ability to establish and maintain positive working relationships with employees
• Strong analytical and problem-solving skills with strict attention to accuracy and detail, and ability to evolve data into knowledge
• Passion for delivering highly available, robust BI solutions
• Knowledge of best practices and IT operations in an always-on, always-available service

Technologies

• Microsoft Fabric
• Azure
• SQL
• Python
• Spark
• dbt
• Data Vault 2.0
• Azure Data Factory
• Azure Data Lake Storage
• Synapse
• Databricks
• Git
• CI/CD
• DevOps
• Power BI
• ETL
• ELT
• PySpark
• Microsoft Purview
• OneLake
• Fabric Data Engineering
• Fabric Data Factory
• Copilot
• Microsoft Copilot
• AI/ML
• Generative AI
• Microsoft Purview

Benefits

• Employee Discount
• 401(k) Matching*
• Growth Opportunities
• Education Assistance*
• Health Benefits*
• Parental Leave*
• Paid Time Off*
• Daily Pay*
• Free Movies*

Preferred Skills

• Hands-on experience with Microsoft Fabric, OneLake, Fabric Data Engineering, Fabric Data Factory, and related platform capabilities
• Experience with dbt Core and Data Vault 2.0
• Experience with Microsoft Purview, metadata management, lineage, governance, and data catalog capabilities
• Exposure to AI/ML, generative AI, Microsoft Copilot capabilities, or AI-assisted data and analytics engineering