Consulting Data Platform Engineer — Azure & Databricks

Jobtailor; Town of Montana (WI); On-site; USD 120,000 - 180,000; Full time

Job summary

Jobtailor is seeking a senior data engineering consultant to design, build, and optimize modern data platforms for clients using Microsoft Azure, Fabric, Power BI, and Databricks.

You will lead discovery sessions, translate business goals into scalable architectures, and develop batch and streaming pipelines with medallion/lakehouse patterns for analytics and reporting. Strong Azure Databricks, Spark, and governance experience are essential for success in this client-focused role.

Qualifications

• Bachelor’s degree in computer science or related field.
• 6+ years of experience in data engineering, data platform development, or cloud data solutions.
• 3+ years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies.
• Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB, and Azure Database for PostgreSQL.
• Expertise with Databricks, including enterprise-level strategy and architecture with Unity Catalog, data warehousing, data sharing, and Mosaic AI.
• DevOps for data, GitHub, automated testing, and containers such as AKS, Docker, and registries.
• Excellent communication skills and ability to clearly explain concepts to teammates and customers.
• Ability to quickly learn new concepts and technologies.
• Preferred: experience working directly with clients, business stakeholders, or cross-functional teams in a consulting or professional services environment.
• Preferred: experience building data agents, including NLQ, Databricks Genie, and Fabric Data Agents.
• Preferred: experience with data management, governance, security, master data management, and industry security requirements.
• Preferred: broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts beyond Microsoft.

Responsibilities

• Design, build, and optimize modern data platforms for clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks.
• Work directly with clients to understand business goals, data challenges, and technical requirements.
• Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews.
• Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
• Implement medallion/lakehouse architectures, dimensional models, and data transformation workflows for analytics and reporting.
• Engineer solutions using PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks.
• Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security.
• Contribute to solution architecture and deliver high-quality modern data solutions that drive measurable business value.
• Facilitate design sessions with client stakeholders and present recommendations to leadership teams.

Skills

Microsoft Azure

Databricks

Data Engineering

PySpark

Spark SQL

SQL

Delta Lake

Data Modeling

Data Governance

Data Warehousing

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure Data Factory

Synapse Analytics

Power BI

Azure SQL

Azure Cosmos DB

AKS

Docker

GitHub

Unity Catalog

Job description

Jobtailor is seeking a senior data engineering consultant to design, build, and optimize modern data platforms for clients using Microsoft Azure, Fabric, Power BI, and Databricks.

You will lead discovery sessions, translate business goals into scalable architectures, and develop batch and streaming pipelines with medallion/lakehouse patterns for analytics and reporting. Strong Azure Databricks, Spark, and governance experience are essential for success in this client-focused role.