Azure Databricks Engineer

Tata Consultancy Services; Eden Prairie (MN); Sur place; USD 110 000 - 120 000; Plein temps

Avantages offerts par ce poste

Discretionary incentive

Medical coverage

Dental & Vision

Parental leave

Insurance options

Commuter benefits

Training reimbursement

Time off

Résumé du poste

Tata Consultancy Services Limited in Eden Prairie, MN seeks a Data Engineer to design, develop, and optimize scalable data pipelines on Azure cloud platforms. You will handle ETL/ELT, data modeling, performance tuning, and data governance, using Python and SQL, with CI/CD and collaboration with business stakeholders.

The role emphasizes hands-on work with Azure Databricks, PySpark, Delta Lake, ADF, Unity Catalog and API deployment via Kubernetes, delivering end-to-end solutions as an individual

Qualifications

• Bachelor's degree in Computer Science or related field.
• Strong experience with Python and SQL.
• Experience with Azure cloud data services is required.

Responsabilités

• Design and develop scalable data pipelines and data models.
• Implement ETL/ELT processes and data governance practices.
• Collaborate with cross-functional teams and business stakeholders.

Connaissances

Python

SQL

Formation

Bachelor of Computer Science

Description du poste

Job Description

seeking a Data Engineer with strong hands-on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions, with expertise in ETL/ELT processing, data modeling, performance tuning, and data governance. The role requires proficiency in Python, SQL, GitHub, and CI/CD practices, along with experience working with large-scale datasets in enterprise environments. This is an individual contributor role that demands strong analytical and problem-solving skills, the ability to work independently, and ownership of end-to-end solution delivery while collaborating effectively with cross-functional teams and business stakeholders.

Expertise in:

• Azure Databricks, PySpark, Delta Lake
• Azure Data Factory (ADF) and ADLS Gen2
• Experience working on large-scale, cloud-native data platforms (Azure preferred)
• Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)
• Strong experience building REST or GraphQL APIs
• Experience with Kubernetes (AKS preferred) for API deployment
• Understanding of API security, contracts, error handling, and performance
• Strong understanding of data governance, security, and CI/CD practicesPrimary skill for the API Role with AI Builder

Salary Range: $110,000-$120,000 a year

TCS Employee Benefits Summary:

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Location

Eden Prairie, MN

Function

TECHNOLOGY

Role

Engineer

ID

434459

Skills

Python | SQL

Salary Range

$110,000 - $120,000

Desired Candidate Profile

Qualifications

BACHELOR OF COMPUTER SCIENCE