Senior Database Engineer

Jobtailor; Mountlake Terrace (WA); On-site; USD 140,000 - 190,000; Full time

Job summary

Jobtailor in the United States is seeking a Database/Data Engineer to design and maintain enterprise data warehouses using Microsoft Fabric, PySpark, and Azure services. You will own data models, Medallion architecture, and pipelines across DevOps, ensuring reliability, performance, and security.

You will collaborate with analysts and engineers, implement CI/CD for databases, write advanced T-SQL, and optimize storage and costs in Fabric/Azure.

Qualifications

• 5+ years of production database and pipeline development experience.
• 3+ years PySpark in distributed processing environments.
• 3+ years building data platforms with Microsoft Fabric or comparable modern data platforms (Synapse, Databricks).
• 5+ years of advanced T-SQL experience, including performance tuning and indexing.
• 3+ years managing CI/CD pipelines in Azure DevOps for database/data pipeline deployments.
• 3+ years managing or developing enterprise data warehouses with dimensional modeling.

Responsibilities

• Design, build, and maintain enterprise-grade data warehouses within Microsoft Fabric using PySpark.
• Implement and manage data models including fact and dimension tables supporting operational and analytical workloads.
• Apply Medallion architecture (Bronze, Silver, Gold) to structure scalable data pipelines.
• Optimize storage, query performance, and cost efficiency across Fabric and Azure environments.
• Develop, deploy, and maintain data pipelines using PySpark, SQL, and Azure-native services.
• Engineer scalable ETL/ELT processes across multiple systems.
• Own pipeline reliability, monitoring, alerting, and failure recovery in production environments.
• Troubleshoot issues across ingestion, transformation, and storage layers with minimal escalation.
• Design and manage CI/CD pipelines in Azure DevOps for database changes, data pipelines, and data models.
• Implement version control, automated deployments, and testing strategies for all data assets.
• Maintain release processes for schema changes, stored procedures, and pipeline updates across environments.
• Write, optimize, and maintain advanced T-SQL code (stored procedures, views, functions, indexing strategies).
• Perform query tuning and performance optimization across high-volume workloads.
• Design and enforce database standards, naming conventions, and documentation practices.
• Lead the Database Administrator in best practices around data governance, reliability and security.
• Implement role‑based access controls and data security aligned with HIPAA and internal policies.
• Own backup, restore, and disaster recovery strategies for databases and pipelines.
• Conduct regular validation of data integrity and pipeline outputs.
• Partner with analysts, operations, and engineering teams to translate business requirements into scalable data solutions.
• Provide technical guidance on data modeling, pipeline design, and platform best practices.
• Document systems, pipelines, and processes to ensure maintainability.

Skills

PySpark

Python

Tools

Microsoft Fabric

Azure DevOps

Job description

Responsibilities

• Design, build, and maintain enterprise-grade data warehouses within Microsoft Fabric (Warehouse, Lakehouse) using PySpark.
• Implement and manage data models including fact and dimension tables supporting operational and analytical workloads.
• Apply Medallion architecture (Bronze, Silver, Gold) to structure scalable, maintainable data pipelines.
• Optimize storage, query performance, and cost efficiency across Fabric and Azure environments.
• Develop, deploy, and maintain data pipelines using PySpark, SQL, and Azure-native services to facilitate development across the DevOps team.
• Engineer scalable ETL/ELT processes that ingest, transform, and load data across multiple systems.
• Own pipeline reliability, monitoring, alerting, and failure recovery in production environments.
• Troubleshoot and resolve issues across ingestion, transformation, and storage layers with minimal escalation support.
• Design and manage CI/CD pipelines in Azure DevOps for database changes, data pipelines, and data models.
• Implement version control, automated deployments, and testing strategies for all data assets.
• Maintain release processes for schema changes, stored procedures, and pipeline updates across environments.
• Write, optimize, and maintain advanced T-SQL code (stored procedures, views, functions, indexing strategies).
• Perform query tuning and performance optimization across high-volume transactional and analytical workloads.
• Design and enforce database standards, naming conventions, and documentation practices.
• Lead the Database Administrator in best practices around Data governance, reliability and security.
• Implement role‑based access controls and data security aligned with HIPAA and internal policies.
• Own backup, restore, and disaster recovery strategies for databases and pipelines.
• Conduct regular validation of data integrity and pipeline outputs.
• Partner with analysts, operations, and engineering teams to translate business requirements into scalable data solutions.
• Provide technical guidance on data modeling, pipeline design, and platform best practices.
• Document systems, pipelines, and processes to ensure maintainability despite lean operational support.

Requirements

• 5+ years of experience in a Database Engineer, Data Engineer, or similar role owning database and pipeline development in production environments.
• 3+ years of hands‑on experience working with PySpark in distributed data processing environments.
• 3+ years of experience building and maintaining data platforms in Microsoft Fabric or comparable modern data platforms (e.g., Synapse, Databricks).
• 5+ years of advanced T-SQL experience, including performance tuning, indexing, and complex query development.
• 3+ years of experience managing CI/CD pipelines in Azure DevOps (ADO) for database and data pipeline deployments.
• 3+ years of experience managing or developing enterprise data warehouses, including dimensional modeling and large‑scale data transformations.
• 2+ years of experience operating and supporting high‑impact production data pipelines with limited oversight or support.
• Technical Skills
  • PySpark & Python (required)
  • T‑SQL (required)
  • Microsoft Fabric (required)
  • Azure DevOps (CI/CD pipelines)
• Experience with:
  • Azure data services (Azure SQL, Fabric, Data Factory, Logic Apps, Functions)
  • ETL/ELT pipeline design patterns
  • Data modeling methodologies (Kimball, Medallion)
  • Microsoft PowerBI dashboard builder
  • Familiarity with DAX for analytical modeling
  • Scripting languages (Python, PowerShell)