Data Engineer: Lakehouse & CDP on Azure Fabric

Tata Consultancy Services; San Jose (CA); Hybrid; USD 80,000 - 115,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage (Dental

Vision

401K Plan

Certification & Training Reimbursement

Vacation & Holidays

Parental Leaves

Job summary

Tata Consultancy Services is seeking a data engineer to collaborate with business stakeholders and translate analytics needs into scalable data solutions in a modern Azure/Microsoft Fabric environment.

You will design end-to-end data pipelines using PySpark and SQL, build Lakehouse/Data Warehouse architectures, and implement governance and performance strategies. The role emphasizes cross-functional teamwork and rapid iteration.

Qualifications

• Must have hands-on experience with PySpark, data warehousing concepts, and data modelling.

Responsibilities

• Collaborate with stakeholders to translate analytics requirements into scalable data solutions.
• Design and develop end-to-end data pipelines using PySpark, SQL, and Delta Lake architecture (Bronze/Silver/Gold).
• Build and optimize Lakehouse and Data Warehouse solutions for reporting, analytics and AI workloads.
• Define data models, governance, security, and performance optimization strategies.
• Provide guidance on Microsoft Fabric adoption, migration, and modernization initiatives.
• Design customer data platform (CDP) solutions including identity resolution and real-time activation using Hightouch and Braze.
• Coordinate with cross-functional teams to deliver high-quality data solutions and support CI/CD processes with Azure DevOps and Git.
• Prepare technical documentation and implementation guidelines.
• Stay current with Microsoft Fabric and Azure data technologies to drive innovation.

Skills

PySpark

Data Warehousing

Data Modelling

Big Data Platforms

Data Engineering

Azure Data Factory

CI/CD

Azure DevOps

Git

Advanced SQL

Python

Delta Tables

Tools

Git

Azure DevOps

Hightouch

Braze

Delta Tables

Microsoft Fabric

OneLake

Job description

Tata Consultancy Services is seeking a data engineer to collaborate with business stakeholders and translate analytics needs into scalable data solutions in a modern Azure/Microsoft Fabric environment.

You will design end-to-end data pipelines using PySpark and SQL, build Lakehouse/Data Warehouse architectures, and implement governance and performance strategies. The role emphasizes cross-functional teamwork and rapid iteration.