Senior Data Engineer – Azure Fabric Data Platforms & AI Pipelines

K&L Gates; Charleston (SC); On-site; USD 128,000 - 249,000; Full time

Benefits offered by this job

Hybrid/Remote Work Opportunities

401(k) Retirement Plan and Profit Sh}.

Health Insurance

Job summary

K&L Gates in Charleston is seeking a Senior Data Engineer to design scalable data platforms on Microsoft Fabric, building Lakehouse and Warehouse solutions. You will lead standards, mentor staff, and partner with business leaders to deliver governed data products aligned with the firm’s AI strategy.

The role requires expertise in SQL and Python, data governance, and CI/CD within a DevOps context, with travel up to 10% offered.

Qualifications

• Bachelor's degree or equivalent with ability to obtain Microsoft certifications.
• Knowledge of Data Mesh and Purview, governance, and metadata management.
• Willingness to travel up to 10% for offices and events.
• Experience implementing data governance, quality, and security in enterprise solutions.
• Translate complex requirements into scalable architectures and visualize designs.

Responsibilities

• Design scalable data platforms with Microsoft Fabric, including Lakehouse and Warehouse.
• Establish data engineering standards and best practices across the group.
• Develop pipelines using Fabric Data Factory, Dataflow Gen2, and Fabric Notebooks.
• Lead schema design, dimensional modeling, Medallion Architecture, and semantic layer work.
• Optimize performance, reliability, and data quality through governance processes.
• Maintain governance, quality, and security integration into solutions.
• Support Azure AI Foundry workloads with grounding datasets and feature data.
• Mentor junior engineers via reviews and coaching.
• Collaborate with stakeholders in an Agile DevOps model; support CI/CD.
• Model enterprise processes and knowledge-first support within EA teams.
• Define testing strategies and validate data accuracy.

Skills

SQL

Python

Data Modeling

Mentoring

Design leadership

Azure Data Platform

CI/CD

Communication

Education

Bachelor’s degree in a technical field

Microsoft certifications (DP-600, DP-203, AI-900)

Tools

Microsoft Fabric

Fabric Data Factory

Dataflow Gen2

Fabric Notebooks

Azure DevOps

GitHub Actions

OneLake

Copilot/Claude

Job description

K&L Gates in Charleston is seeking a Senior Data Engineer to design scalable data platforms on Microsoft Fabric, building Lakehouse and Warehouse solutions. You will lead standards, mentor staff, and partner with business leaders to deliver governed data products aligned with the firm’s AI strategy.

The role requires expertise in SQL and Python, data governance, and CI/CD within a DevOps context, with travel up to 10% offered.