Senior Azure Data Engineer - Data Pipelines & Delta Lake

Tata Consultancy Services Limited; Eden Prairie (MN); On-site; USD 110,000 - 120,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage

Family Support: Leaves

Insurance Options: Auto & Home

Commuter Benefits & Training Reimburse

Vacation, Time Off, Holidays

401K Plan, Performance Bonus

Job summary

Tata Consultancy Services Limited in Eden Prairie, MN, seeks a Data Engineer to design, develop, and optimize scalable cloud-based data pipelines on Azure. You will work with Azure Databricks, PySpark, Delta Lake, and ADF to deliver end-to-end ELT solutions and data governance.

This individual contributor role requires strong Python/SQL, GitHub, CI/CD, API (REST/GraphQL) experience, and the ability to collaborate with cross-functional teams across the enterprise.

Qualifications

• Bachelor’s degree in CS or related field.
• Hands-on Azure cloud data engineering experience.
• Experience designing large-scale data pipelines and data governance.
• Proficiency in Python, SQL, APIs, GitHub, and CI/CD.

Responsibilities

• Design, develop, and optimize scalable cloud-based data pipelines.
• Implement ETL/ELT processes and data models on Azure stack.
• Collaborate with cross-functional teams and stakeholders.
• Ensure data governance, security, and performance best practices.

Skills

Python

SQL

CI/CD practices

GitHub

Data governance

API development

Problem solving

Independent contributor

Cross-functional collaboration

Education

Bachelor of Computer Science

Tools

Azure Databricks

PySpark

Delta Lake

Azure Data Factory

ADLS Gen2

Kubernetes (AKS)

REST APIs

GraphQL APIs

GitHub

CI/CD

Job description

Tata Consultancy Services Limited in Eden Prairie, MN, seeks a Data Engineer to design, develop, and optimize scalable cloud-based data pipelines on Azure. You will work with Azure Databricks, PySpark, Delta Lake, and ADF to deliver end-to-end ELT solutions and data governance.

This individual contributor role requires strong Python/SQL, GitHub, CI/CD, API (REST/GraphQL) experience, and the ability to collaborate with cross-functional teams across the enterprise.