Senior Data Engineer - Microsoft Data & AI

ttecdigital; Austin (TX); Remote; USD 140,000 - 190,000; Full time

Job summary

TTEC Digital seeks an experienced data platform architect to lead end-to-end data platform initiatives across ingestion, cleaning, transformation, analytics, and activation using Azure Data Factory, Fabric, and Databricks. You will own lakehouse patterns and data models, while guiding client engagements and governance practices.

The role requires strong Python/SQL/PySpark skills, Azure stack proficiency, and a proven ability to mentor engineers and communicate architectural trade-offs to clients.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, Statistics, or a related technical discipline.
• 5-8 years of experience in data engineering with ownership of production data pipelines on Azure.
• Expert-level proficiency in Python, SQL, and PySpark for building distributed data pipelines at scale.
• Deep hands-on experience with the Microsoft Azure Data & AI stack (Azure Data Factory, Microsoft Fabric, Synapse, ADLS Gen2) and/or Azure Databricks, including Delta Lake/OneLake and Medallion architecture patterns.
• Strong background in data modeling, schema design, and enterprise data architecture across the full lifecycle from ingestion to activation.

Responsibilities

• Lead the design and build of end-to-end data platforms on Azure technologies.
• Architect lakehouse patterns (Bronze/Silver/Gold) balancing performance and cost.
• Mentor Data Engineers and lead technical design discussions on client engagements.
• Design APIs and MCP-based integrations to exchange data with front-line systems and AI interfaces.
• Support production operations and incident response for critical pipelines and activation services.

Skills

Python

SQL

PySpark

Azure Databricks

Azure Data Factory

Education

Bachelor's or Master's in CS/Engineering/Math/Stats

Tools

Azure Data Factory

Microsoft Fabric

Delta Lake/OneLake

Azure Databricks

Synapse/ADLS Gen2

Job description

End-to-End Platform Architecture

• Lead the design and build of end-to-end data platforms spanning ingestion, cleaning, preparation, transformation, analytics, and activation, using Azure Data Factory, Microsoft Fabric (Lakehouse, Warehouse, OneLake), and/or Azure Databricks with PySpark, Python, and SQL.
• Architect Medallion (Bronze, Silver, Gold) lakehouse patterns using OneLake/Delta Lake, balancing performance, reliability, and cost.
• Own data modeling for client engagements - dimensional, normalized, and semantic layers - so that data is trustworthy, reusable, and analytics-ready across domains.
• Design batch and streaming ingestion patterns, including Fabric Data Factory/pipelines, Azure Databricks Structured Streaming, and event-driven architectures (e.g., Event Hubs).
• Identify and resolve architectural risk and technical debt, and optimize pipelines for performance and cost.

APIs, Data Agents & Activation

• Design and build APIs and data services that activate governed data for client analytics, reporting, and downstream applications.
• Design MCP (Model Context Protocol) and API-based integrations that let front-line business systems, Fabric/Copilot Data Agents, and other agentic AI interfaces securely query and exchange data with the platform.
• Partner with AI/Architecture teams to expose enterprise data to Data Agents and Generative AI applications (e.g., Fabric Data Agents, Azure AI Foundry) in a governed, reusable way.
• Implement data governance patterns using Microsoft Purview and/or Unity Catalog, including access control, metadata, and lineage.
• Support production operations and incident response for critical pipelines and activation services on client engagements.

Technical Leadership & Client Engagement

• Mentor and provide technical direction to Data Engineers, reviewing code, data models, and designs to raise delivery quality.
• Act as a trusted technical resource to client stakeholders, explaining architecture trade-offs and design decisions in clear terms.
• Contribute to reusable frameworks, accelerators, and engineering standards used across engagements.
• Support presales activities where needed, including technical input on estimates, proposals, and solution design.
• Evaluate new capabilities across Fabric and Azure Databricks and recommend where they add value for client platforms.

Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, Statistics, or a related technical discipline.

5-8 years of experience in data engineering, with strong ownership of production data pipelines on Azure.

Expert-level proficiency in Python, SQL, and PySpark for building distributed data pipelines at scale.

Deep hands-on experience with the Microsoft Azure Data & AI stack (Azure Data Factory, Microsoft Fabric, Synapse, ADLS Gen2) and/or Azure Databricks, including Delta Lake/OneLake and Medallion architecture patterns.

Strong background in data modeling, schema design, and enterprise data architecture across the full lifecycle from ingestion to activation.

Experience designing APIs and MCP-based integrations that exchange data with front-line systems, Data Agents, and other agentic AI interfaces.

Experience with orchestration and CI/CD (Fabric pipelines, Azure Data Factory, Databricks Workflows, Azure DevOps).

Strong knowledge of data governance and security tooling, including Microsoft Purview and/or Unity Catalog.

Demonstrated ability to mentor engineers and lead technical design discussions on client-facing engagements.

Strong problem-solving skills and ability to troubleshoot complex, large-scale data issues independently.

Excellent communication skills, with the ability to explain technical trade-offs to both technical and client audiences.

Relevant Microsoft certifications (e.g., Azure Data Engineer Associate, Fabric Analytics Engineer Associate) and/or Databricks certifications preferred.

#LI-DD1

#LI-Remote

Team Overview

For eleven years in a row our Microsoft practice has achieved Microsoft's Inner Circle Award designation and we have been recognized as 'Partner of the year for Microsoft Dynamics 365 Service', ‘Partner of the year for Microsoft Dynamics 365 Marketing’ and as a Partner of the year finalist for ‘Intelligent Sales & Marketing’.

In addition to our ongoing Gold Partner status, our competencies range from software development and deployment of Dynamics 365, to Power Platform, Azure and Microsoft 365. In mid-2022, the team was also named as one of only a handful of launch partners for the Microsoft D365 Contact Center.

Our integrated team approach of experienced CX engineers, developers, data scientists, and solution architects, design, deploy and support complex and fully integrated digital solutions that are focused on creating an exceptional customer experience.

About Us

Avtex is now TTEC Digital. The acquisition aligns to TTEC’s continued focus on fueling experience transformations. Our deep expertise in the most innovative and disruptive brands in the digital industry enables our clients to provide amazing customer experiences.

TTEC Digital, and our 1,700+ employees, pioneer engagement and growth solutions that fuel the exceptional customer experience (CX). TTEC Engage is a 60,000+ employee service company, with customers in more than 80 countries. Together, we utilize a holistic approach, applying solutions from two centers of excellence, Engage and Digital.

TTEC is a proud equal opportunity employer where all qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability. TTEC has fully embraced and is committed to expanding our diverse and inclusive workforce. We strive to reflect the communities we serve while delivering amazing service and technology centered around humanity.

Rarely do applicants meet all desired job qualifications, so if you feel you would succeed in the role above, please take a moment and share your qualifications.