python ,pyspark with aws

Tata Consultancy Services; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services in Hyderabad seeks a senior developer to drive data engineering initiatives using Python and PySpark on Spark Framework, with AWS cloud services.

The role demands >7 years total, >6 years relevant, including DevOps practices with Terraform, CI/CD, and Git. You will work on REST/microservice architectures and automated testing tools.

Join a fast-paced environment in India, contributing to scalable data pipelines and cloud-native solutions.

Qualifications

• Total Experience > 7 Years with 6 Years of relevant Experience
• Proficient in Python and PySpark with Spark Framework
• Cloud experience: AWS services including Lambda, S3, Glue, Step Functions, EventBridge, ECS, EKS

Skills

Python

PySpark

Spark Framework

AWS

Lambda

S3

Glue

Step Functions

EventBridge

ECS

EKS

Tools

Terraform

CI/CD pipelines

Git

PowerShell

Job description

Desired Skills -Technical/Behavioral

Primary Skill

Total Experience > 7Years with 6Years of relevant Experience

Should have working experience:

• Development: Python, PySpark & with Spark Framework
• Cloud: 2+ years experience AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS)

Secondary Skill

• DevOps & IaC tooling: Terraform, CI/CD pipelines, Git
• Python (preferred) or PowerShell scripting
• SonarQube and Veracode.
• Proficiency with automated testing tools (e.g. Pytest, Scalates).
• Knowledge of RESTful and microservice architectures.