Senior Engineer Data Services

Tata Consultancy Services; San Jose (CA); On-site; USD 80,000 - 115,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Medical Coverage

Parental Leaves

401K Plan

Performance Bonus

Job summary

Tata Consultancy Services in San Jose, CA seeks a data engineering professional to design end-to-end data solutions using PySpark, SQL, and modern data architectures. You will build pipelines, implement Medallion Architecture, and optimize data platforms for reporting and AI workloads.

You will collaborate with stakeholders to define data models, governance, and security, while driving Microsoft Fabric adoption and CDP initiatives. Strong communication skills required.

Qualifications

• Experience delivering data solutions using PySpark and SQL.
• Design and implement end-to-end data pipelines and data models.
• Strong knowledge of Azure data services and BI tooling.
• Ability to collaborate with stakeholders across teams.

Responsibilities

• Collaborate with stakeholders to translate data needs into scalable technical solutions.
• Design and develop data pipelines using PySpark, SQL, and Medallion Architecture.
• Build Lakehouse and Data Warehouse solutions for reporting and AI workloads.
• Define data models, quality standards, governance, security and performance optimization.
• Provide guidance on Microsoft Fabric adoption and modernization initiatives.
• Design and implement CDP solutions including identity resolution and real-time activation.
• Work with cross-functional teams to deliver high-quality data solutions.
• Support CI/CD, code reviews, testing, deployment and production support.
• Prepare technical documentation and implementation guidelines.
• Stay current with Microsoft Fabric and Azure data technologies.

Skills

PySpark

Data Warehouse

Data Concepts

Data Modelling

Big Data Platforms

Data Engineering

Azure Data Factory

CI/CD

Communication

Azure DevOps

Git

Advanced SQL

Tools

Microsoft Fabric

OneLake

Delta Tables

Power BI

Job description

Must Have Technical/Functional Skills

Digital : PySpark; Data Warehouse; Data Concepts & Data Modelling; Digital : Big Data Platforms; Data Engineering; Azure Data Factory; Continuous Integration and Continuous Delivery (CI/CD); Communication Skills and Cross Team Collaboration Skills; Azure DevOps; Git; Advanced SQL

Roles & Responsibilities

• Collaborate with business stakeholders to understand data, analytics, and reporting requirements and translate them into scalable technical solutions.
• Design and develop end-to-end data solutions using Microsoft Fabric, ADF, OneLake, Lakehouse, and Data Warehouse, including scalable data pipelines using PySpark and SQL and Medallion Architecture (Bronze, Silver, Gold) with Delta Tables.
• Build and optimize Lakehouse and Data Warehouse solutions for reporting, analytics, and AI workloads.
• Define data models, data quality standards, governance, security and performance optimization strategies.
• Provide technical consulting and best practices for Microsoft Fabric adoption, migration, and modernization initiatives.
• Design and implement customer data platform (CDP) solutions including customer profile unification, identity resolution, audience segmentation and real-time data activation using Hightouch and Braze.
• Collaborate with cross-functional teams, including data engineers, architects, analysts, and business stakeholders to deliver high-quality data solutions.
• Support CI/CD implementation, code reviews, testing, deployment, and production support using Azure DevOps and Git.
• Prepare technical documentation, solution designs and implementation guidelines.
• Stay current with Microsoft Fabric, Azure data technologies, and industry best practices to drive continuous innovation.

Generic Managerial Skills, If any

Hightouch; Braze; Customer Data Platforms (CDP); Digital : Microsoft Power BI; PL/SQL; Microsoft Power BI; Prior Experience with Threat Modelling and SDL Assessments

Specific Requirement

• Heavy customer facing experience.
• Should be able to work in agile manner with the customer & stakeholders.

Additional Skills

• Strong analytical skills
• Excellent troubleshooting and problem-solving skills
• Ability to work in a fast paced, agile environment
• Experience working within a geographically dispersed team and flexibility for coordinating between teams.
• Excellent Communication skills, communicate effectively and proactively with partner teams in order to solve problems
• Good Presentation Skills

TCS Employee Benefits Summary

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Opti ons: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
• Salary Range: $80,000 - $115,000 a year