Senior Azure Data Engineer — Databricks & ETL Expert

Tata Consultancy Services Limited; Eden Prairie (MN); Presencial; USD 110 000 - 120 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Discretionary Annual Incentive

Comprehensive Medical Coverage

Parental Leaves

Auto & Home Insurance

Commuter Benefits

Certification & Training Reimbursement

Vacation, Time Off, Holidays

Resumo da oferta

Tata Consultancy Services Limited is seeking a Data Engineer in Eden Prairie, MN. You will design, build, and optimize scalable data pipelines on Azure, using Databricks, PySpark, Delta Lake, and ADF, while ensuring data governance and security.

The role emphasizes ownership of end-to-end delivery and collaboration with stakeholders. Candidates should be proficient in Python, SQL, GitHub, and CI/CD practices, with experience handling large-scale datasets in enterprise settings.

Qualificações

• Experience designing scalable data pipelines on Azure cloud.
• Proficient in Python and SQL.
• Strong ETL/ELT, data modeling, and performance tuning skills.
• Experience with data governance and security practices.
• Independent contributor with ownership of end-to-end delivery.

Responsabilidades

• Design, develop, and optimize cloud-based data pipelines.
• Collaborate with cross-functional teams and business stakeholders.
• Deliver end-to-end data solutions in enterprise environments.

Conhecimentos

Azure Databricks

PySpark

Delta Lake

Azure Data Factory

ADLS Gen2

REST APIs

GraphQL APIs

Kubernetes AKS

API security

Data governance

CI/CD practices

AI Builder

Formação académica

Bachelor of Computer Science

Ferramentas

GitHub

CI/CD pipelines

Azure DevOps

Descrição da oferta de emprego

Tata Consultancy Services Limited is seeking a Data Engineer in Eden Prairie, MN. You will design, build, and optimize scalable data pipelines on Azure, using Databricks, PySpark, Delta Lake, and ADF, while ensuring data governance and security.

The role emphasizes ownership of end-to-end delivery and collaboration with stakeholders. Candidates should be proficient in Python, SQL, GitHub, and CI/CD practices, with experience handling large-scale datasets in enterprise settings.