Senior Data & AI Engineering Consultant

Interlink Cloud Advisors; United States; On-site; USD 180,000 - 240,000; Full time

Job summary

Interlink Cloud Advisors in the United States seeks a senior Microsoft-focused analytics consultant to lead discovery, architecture, and engineering across Azure and Fabric platforms. You will design lakehouse and warehouse architectures, implement data pipelines, and enable clients with governance and scalable data products.

The role emphasizes hands-on data engineering with Spark, PySpark, and KQL, plus strong SQL and Power BI skills, in a client-facing consulting environment.

Qualifications

• Experience designing analytics platforms with lakehouse or data warehouse patterns on Azure and/or Fabric.
• Strong SQL skills with transformations and dimensional/analytical modeling.
• Hands-on Spark (PySpark/Spark SQL) and/or KQL data engineering experience.
• Experience applying software engineering practices to data solutions (modular design, source control, testing, documentation).
• Knowledge of building reliable data pipelines with orchestration, scheduling, and monitoring.
• Familiarity with data quality practices, validation, reconciliation, and incident triage.
• Working knowledge of Power BI and semantic modeling for end-to-end analytics delivery.
• Understanding of security, governance, and lineage across data platforms.

Responsibilities

• Lead client discovery to translate goals into a clear delivery plan.
• Design data architectures on Azure and Fabric aligned to client needs.
• Guide ingestion, transformation, and orchestration pipelines using Fabric and Azure services.
• Integrate data from operational systems and APIs into curated datasets.
• Build analytics-ready data models and reusable data patterns.
• Enable compute engines (SQL, PySpark, Spark SQL, KQL) on shared datasets.
• Deliver governed data products for BI, analytics, and AI use cases.
• Establish data quality practices with validation and monitoring.
• Optimize transformations and pipeline performance to meet SLAs and cost targets.
• Implement logging, runbooks, and enable efficient deployments and handoffs.
• Design security controls, governance, and data lineage across Azure and Fabric.
• Facilitate workshops and communicate architecture tradeoffs with stakeholders.
• Produce design docs, diagrams, and enablement materials for adoption.

Skills

Azure Data Factory

Azure Synapse

Databricks

PySpark

KQL

SQL

Data Modeling

Data Warehousing

Power BI

CI/CD

IaC

Fabric

Security & Governance

Client-facing

Tools

Azure Databricks

OneLake

Lakehouse

Power BI

Job description

Description

A senior Microsoft-focused consulting role spanning discovery, architecture, engineering, governance, and client enablement.

Job Type

Full-time

What You\'ll Do

• Lead client discovery to understand business goals, the data landscape, constraints, and success metrics, then translate findings into a clear delivery plan.
• Design and recommend data lake, lakehouse, data warehouse, and analytical data store architectures on Azure and Microsoft Fabric aligned to client needs.
• Implement, or guide implementation of, ingestion, transformation, and orchestration pipelines using Microsoft Fabric experiences and Azure services such as Data Factory, Synapse, and Databricks.
• Integrate data from operational systems, APIs, and third-party sources and transform raw data into curated datasets ready for consumption.
• Build and maintain analytics-ready data models and schemas; implement enrichment, business rules, and reusable patterns for consistency across projects.
• Enable multiple compute engines - SQL, Spark/PySpark, Spark SQL, and KQL - against shared datasets to support diverse analytics scenarios.
• Prepare governed data products and reusable datasets for BI, advanced analytics, and AI use cases, including retrieval-ready data patterns when relevant.
• Establish data quality practices, including validation, reconciliation, testing, and monitoring; troubleshoot failures and continuously improve pipeline resiliency.
• Optimize transformations, query performance, and pipeline execution to meet client service level and cost objectives.
• Implement logging, metrics, and operational runbooks, and support deployments, cutovers, and hypercare as needed.
• Design and implement security, governance, and compliance controls, including access, least privilege, data protection, and lineage across Azure and Fabric.
• Facilitate workshops and communicate architecture tradeoffs, partnering with client stakeholders, architects, analysts, and BI developers to deliver trusted datasets.
• Produce clear consulting deliverables, including design documents, diagrams, implementation guides, and enablement materials, to support adoption and a smooth handoff.

Requirements

Required Qualifications

• Experience designing and delivering modern analytics platforms using lakehouse and/or data warehouse patterns on Azure and/or Microsoft Fabric, including client-facing delivery.
• Strong SQL skills with experience building transformations and dimensional or analytical models.
• Hands-on experience with Spark (PySpark/Spark SQL) and/or KQL for data engineering and analytics workloads.
• Experience applying software engineering practices to data solutions, including modular design, source control, automated testing, code review, and technical documentation.
• Experience building reliable data pipelines, including orchestration, scheduling, error handling, and automated monitoring.
• Knowledge of data quality practices, including validation, reconciliation, testing, incident triage, and root-cause analysis.
• Working knowledge of Power BI, including semantic modeling concepts, to support end-to-end analytics delivery; Power Apps experience is a plus.
• Understanding of security and governance concepts for data platforms, including access controls, least privilege, compliance, and lineage.
• Strong communication skills, with the ability to present recommendations, align stakeholders, and manage expectations in a client environment.

Preferred Qualifications

• Direct experience with Microsoft Fabric components - OneLake, Lakehouse, Warehouse, Data Factory in Fabric, and Real-Time Analytics/KQL databases - including platform administration, capacity planning, and standards.
• Experience with Azure services commonly used in data platforms, such as Azure Data Factory, Synapse, Databricks, ADLS Gen2, and Key Vault.
• Working knowledge of Azure architecture fundamentals across identity, networking, storage, monitoring, resiliency, and cost management.
• Familiarity with AI-enablement patterns - such as preparing governed enterprise data for Azure AI Search or Microsoft Foundry, retrieval-augmented generation, or agent-based solutions—is valued. Deep agent application development experience is not required.
• Experience implementing CI/CD and Infrastructure as Code, including environment strategy and release management for data solutions.
• Familiarity with semantic modeling and BI enablement patterns, including Power BI datasets, self-service analytics, and governance guardrails.
• Current Microsoft certifications relevant to the role are valued, especially Microsoft Certified: Fabric Data Engineer Associate (DP-700), Microsoft Certified: Power BI Data Analyst Associate (PL-300), and, for broader architecture responsibilities, Microsoft Certified: Azure Solutions Architect Expert (AZ-305). Equivalent current Microsoft credentials and experience mentoring or enabling client teams are also welcome.

About Us

Interlink is a nationally recognized IT consultancy, offering the flexibility of a small company while providing stability and benefits usually found at enterprise firms. We work with a "family first" attitude, so we look to hire motivated individuals who understand that getting work done while having fun is important. As the winner of The Best Places to Work Award for five consecutive years, we know what it takes to care for our employees and clients.

Interlink Advantage

We are the premier Microsoft Cloud consulting company based in Mason, OH. We are a team of trusted experts who know how to navigate the intricacies of Microsoft's technologies, guiding and educating clients to avoid overspending on tech licenses while optimizing their tools. At Interlink, we believe working in an innovative, fun, and collaborative environment is key to success. Get to know us and our company culture more at: http://www.interlink.com/about-us/company-culture.

Interlink Cloud Advisors is an equal-opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability status.