AWS with Scala Engineer

Tata Consultancy Services; Hyderabad; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Tata Consultancy Services in Hyderabad (India) is seeking a Data Engineer (Senior/ Mid) to design and implement scalable data pipelines using Python, PySpark, Scala and Spark framework. The role requires strong AWS experience and hands-on with DevOps/IaC tooling.

You'll work on cloud-based data platforms, collaborate with cross-functional teams, and deliver reliable data solutions. 5+ years total experience with 4+ years in relevant data engineering, located in India with Hyderabad preference.

Qualifications

• Total Experience > 5 Years with 4 Years of relevant Experience
• Experience with Python, PySpark or Scala and Spark Framework
• Working experience with AWS services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS)
• Familiarity with DevOps tools and IaC tooling like Terraform, CI/CD pipelines, Git

Skills

Python

PySpark

Scala

Spark Framework

AWS

Terraform

CI/CD pipelines

Git

RESTful & microservices

Tools

Terraform

CI/CD pipelines

Git

Job description

1

Role

Data engineer (Senior/ Mid)

2

No of Requirements

3

3

Desired Experience Range

5+ Years with 4 Years of relevant Experience

4

Desired Designation

C2 / C3A/C3B

5

Location of Requirement

India based -Hyderabad (preferred)

Desired Skills -Technical/Behavioral

Primary Skill

Total Experience > 5 Years with 4 Years of relevant Experience

Should have working experience:

• Development: Python(preferred) or Pyspark or Scala & with Spark Framework


• Cloud: AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS)


• DevOps & IaC tooling: Terraform, CI/CD pipelines, Git

Secondary Skill

• Python (preferred) or PowerShell scripting


• SonarQube and Veracode.


• Proficiency with automated testing tools (e.g. Pytest, Scalates).


• Knowledge of RESTful and microservice architectures.