Data Engineer_ Python/pyspark + AWS

Tata Consultancy Services; Hyderabad; On-site; INR 1,400,000 - 2,300,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is seeking an experienced Data Engineer with strong Python and PySpark skills, plus hands-on AWS experience to build scalable data pipelines. The role emphasizes DevOps, IaC, and secure coding practices with SonarQube and Veracode.

Candidates should have 8+ years total experience, including 6+ years in relevant data engineering roles, and be able to join immediately or on short notice. Hyderabad-based on-site role with modern data platforms.

Qualifications

• Total Experience > 8 Years with 6 Years of relevant Experience
• Working experience with Python, PySpark and Spark Framework
• Cloud experience with AWS services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS) for data workloads
• DevOps & IaC tooling: Terraform, CI/CD pipelines, Git
• Python (preferred) or PowerShell scripting
• SonarQube and Veracode
• Proficiency with automated testing tools (e.g. Pytest)
• Knowledge of RESTful and microservice architectures

Responsibilities

• Develop data engineering solutions using Python and PySpark with Spark Framework
• Architect and maintain data pipelines on AWS (Lambda, S3, Glue, Step Functions) and related services
• Implement DevOps and IaC practices with Terraform and CI/CD pipelines
• Create and optimize scripts (Python or PowerShell) for automation
• Ensure code quality with SonarQube and Veracode integration
• Design and work with RESTful/microservice architectures to support services

Skills

Python

PySpark

Spark Framework

RESTful

Microservices

Tools

AWS

Terraform

CI/CD

Git

Pytest

Veracode

Job description

Role & responsibilities

Total Experience > 8 Years with 6 Years of relevant Experience

Should have working experience:

• Development: Python, PySpark & with Spark Framework
• Cloud: 2+ years experience AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS)

• DevOps & IaC tooling: Terraform, CI/CD pipelines, Git
• Python (preferred) or PowerShell scripting
• SonarQube and Veracode.
• Proficiency with automated testing tools (e.g. Pytest, Scalates).
• Knowledge of RESTful and microservice architectures.

Preferred candidate profile

• Looking for immediate joiners or candidates serving notice period of upto 15 days for Data Engineer (Python, PySpark with Spark Framework & AWS)role in Hyderabad.