Azure Databricks Data Engineer — Scalable Pipelines & AI

Tata Consultancy Services Limited; Eden Prairie (MN); On-site; USD 110,000 - 120,000; Full time

Benefits offered by this job

Discretionary incentive

Medical coverage

Dental & Vision

Parental leave

Insurance options

Commuter benefits

Training reimbursement

Time off

Job summary

Tata Consultancy Services Limited in Eden Prairie, MN seeks a Data Engineer to design, develop, and optimize scalable data pipelines on Azure cloud platforms. You will handle ETL/ELT, data modeling, performance tuning, and data governance, using Python and SQL, with CI/CD and collaboration with business stakeholders.

The role emphasizes hands-on work with Azure Databricks, PySpark, Delta Lake, ADF, Unity Catalog and API deployment via Kubernetes, delivering end-to-end solutions as an individual

Qualifications

• Bachelor's degree in Computer Science or related field.
• Strong experience with Python and SQL.
• Experience with Azure cloud data services is required.

Responsibilities

• Design and develop scalable data pipelines and data models.
• Implement ETL/ELT processes and data governance practices.
• Collaborate with cross-functional teams and business stakeholders.

Skills

Python

SQL

Education

Bachelor of Computer Science

Job description

Tata Consultancy Services Limited in Eden Prairie, MN seeks a Data Engineer to design, develop, and optimize scalable data pipelines on Azure cloud platforms. You will handle ETL/ELT, data modeling, performance tuning, and data governance, using Python and SQL, with CI/CD and collaboration with business stakeholders.

The role emphasizes hands-on work with Azure Databricks, PySpark, Delta Lake, ADF, Unity Catalog and API deployment via Kubernetes, delivering end-to-end solutions as an individual