Senior Azure Data Engineer

Tata Consultancy Services Limited; Eden Prairie (MN); On-site; USD 110,000 - 120,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage

Family Support: Leaves

Insurance Options: Auto & Home

Commuter Benefits & Training Reimburse

Vacation, Time Off, Holidays

401K Plan, Performance Bonus

Job summary

Tata Consultancy Services Limited in Eden Prairie, MN, seeks a Data Engineer to design, develop, and optimize scalable cloud-based data pipelines on Azure. You will work with Azure Databricks, PySpark, Delta Lake, and ADF to deliver end-to-end ELT solutions and data governance.

This individual contributor role requires strong Python/SQL, GitHub, CI/CD, API (REST/GraphQL) experience, and the ability to collaborate with cross-functional teams across the enterprise.

Qualifications

• Bachelor’s degree in CS or related field.
• Hands-on Azure cloud data engineering experience.
• Experience designing large-scale data pipelines and data governance.
• Proficiency in Python, SQL, APIs, GitHub, and CI/CD.

Responsibilities

• Design, develop, and optimize scalable cloud-based data pipelines.
• Implement ETL/ELT processes and data models on Azure stack.
• Collaborate with cross-functional teams and stakeholders.
• Ensure data governance, security, and performance best practices.

Skills

Python

SQL

CI/CD practices

GitHub

Data governance

API development

Problem solving

Independent contributor

Cross-functional collaboration

Education

Bachelor of Computer Science

Tools

Azure Databricks

PySpark

Delta Lake

Azure Data Factory

ADLS Gen2

Kubernetes (AKS)

REST APIs

GraphQL APIs

GitHub

CI/CD

Job description

Job Description

Must Have Technical/Functional Skills

We are seeking a Data Engineer with strong hands‑on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud‑based data solutions, with expertise in ETL/ELT processing, data modeling, performance tuning, and data governance. The role requires proficiency in Python, SQL, GitHub, and CI/CD practices, along with experience working with large‑scale datasets in enterprise environments. This is an individual contributor role that demands strong analytical and problem‑solving skills, the ability to work independently, and ownership of end‑to‑end solution delivery while collaborating effectively with cross‑functional teams and business stakeholders

Expertise In

Azure Databricks, PySpark, Delta Lake

Azure Data Factory (ADF) and ADLS Gen2

Experience Working On Large-scale, Cloud-native Data Platforms (Azure Preferred)

Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)

Strong experience building REST or GraphQL APIs

Experience With Kubernetes (AKS Preferred) For API Deployment

Understanding of API security, contracts, error handling, and performance

Strong understanding of data governance, security, and CI/CD practicesPrimary skill for the API Role with AI Builder

Salary Range: $110,000-$120,000 a year

TCS Employee Benefits Summary

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Qualifications:

BACHELOR OF COMPUTER SCIENCE