Senior Data Engineer

Tata Consultancy Services; Chicago (IL); On-site; USD 100,000 - 120,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage

Maternal & Parental Leaves

Auto & Home Insurance

401K Plan

Job summary

Tata Consultancy Services is seeking a skilled developer in Chicago, Illinois to design and build end-to-end data pipelines. Candidates should have a Bachelor's degree in Computer Science and expertise in SQL, PySpark, and Azure Data Factory.

The role involves optimizing SQL and Python code, working in Azure environments, and ensuring production- grade quality. This full-time position offers a competitive salary ranging from $100,000 to $120,000 per year, along with comprehensive medical coverage and various employee benefits.

Responsibilities

• Design and build end-to-end data pipelines.
• Develop and optimize SQL and PySpark transformations.
• Build production-grade Python components.
• Create and maintain ADF pipelines.
• Work within Azure environments.
• Provision Azure resources using Pulumi.
• Participate in code reviews, documentation, and operational support.

Skills

ETL/ELT concepts

Advanced SQL

Python

PySpark

Azure Data Factory

Databricks

Azure

Pulumi

Azure API Services

Azure Function Apps

Education

Bachelor of Computer Science

Job description

Must Have Technical/Functional Skills

• ETL/ELT concepts (pipelines, incremental loads, validation)
• Advanced SQL (CTEs, joins, performance tuning)
• Python (modular code, testing, CI/CD)
• PySpark (distributed processing, optimization)
• Azure Data Factory (pipelines, triggers, monitoring)
• Databricks (Delta Lake, workflows, clusters)
• Azure (ADLS Gen2, Azure SQL, Resource Groups, Portal)
• Pulumi (Infrastructure as Code)
• Azure API Services
• Azure Function Apps

Roles & Responsibilities

• Design and build end-to-end data pipelines
• Develop and optimize SQL and PySpark transformations
• Build production‑grade Python components
• Create and maintain ADF pipelines
• Work within Azure environments
• Provision Azure resources using Pulumi
• Participate in code reviews, documentation, and operational support

Salary Range: $100,000 - $120,000 a year

TCS Employee Benefits Summary

• Discretionary Annual Incentive
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
• Family Support: Maternal & Parental Leaves
• Insurance Options: Auto & Home Insurance, Identity Theft Protection
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement
• Time Off: Vacation, Time Off, Sick Leave & Holidays
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing

Qualifications

BACHELOR OF COMPUTER SCIENCE