Senior Azure Data Engineer

Tata Consultancy Services; Eden Prairie (MN); On-site; USD 110,000 - 120,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage

Parental Leaves

Auto & Home Insurance

Commuter Benefits

Certification & Training Reimbursement

Vacation, Time Off, Holidays

Job summary

Tata Consultancy Services Limited is seeking a Data Engineer in Eden Prairie, MN. You will design, build, and optimize scalable data pipelines on Azure, using Databricks, PySpark, Delta Lake, and ADF, while ensuring data governance and security.

The role emphasizes ownership of end-to-end delivery and collaboration with stakeholders. Candidates should be proficient in Python, SQL, GitHub, and CI/CD practices, with experience handling large-scale datasets in enterprise settings.

Qualifications

• Experience designing scalable data pipelines on Azure cloud.
• Proficient in Python and SQL.
• Strong ETL/ELT, data modeling, and performance tuning skills.
• Experience with data governance and security practices.
• Independent contributor with ownership of end-to-end delivery.

Responsibilities

• Design, develop, and optimize cloud-based data pipelines.
• Collaborate with cross-functional teams and business stakeholders.
• Deliver end-to-end data solutions in enterprise environments.

Skills

Azure Databricks

PySpark

Delta Lake

Azure Data Factory

ADLS Gen2

REST APIs

GraphQL APIs

Kubernetes AKS

API security

Data governance

CI/CD practices

AI Builder

Education

Bachelor of Computer Science

Tools

GitHub

CI/CD pipelines

Azure DevOps

Job description

Job Description

We are seeking a Data Engineer with strong hands-on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions, with expertise in ETL/ELT processing, data modeling, performance tuning, and data governance. The role requires proficiency in Python, SQL, GitHub, and CI/CD practices, along with experience working with large-scale datasets in enterprise environments. This is an individual contributor role that demands strong analytical and problem-solving skills, the ability to work independently, and ownership of end-to-end solution delivery while collaborating effectively with cross-functional teams and business stakeholders.

Expertise in:

• Azure Databricks, PySpark, Delta Lake
• Azure Data Factory (ADF) and ADLS Gen2
• Experience working on large-scale, cloud-native data platforms (Azure preferred)
• Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)
• Strong experience building REST or GraphQL APIs
• Experience with Kubernetes (AKS preferred) for API deployment
• Understanding of API security, contracts, error handling, and performance
• Strong understanding of data governance, security, and CI/CD practicesPrimary skill for the API Role with AI Builder

Salary Range: $110,000-$120,000 a year

TCS Employee Benefits Summary:

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Location

Eden Prairie, MN

Function

TECHNOLOGY

Role

Engineer

ID

434476

Skills

Artificial Intelligence | Azure

Salary Range

$110,000 - $120,000

Desired Candidate Profile

Qualifications

BACHELOR OF COMPUTER SCIENCE