Senior AWS Data Engineer

Tata Consultancy Services Limited; Bengaluru; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services Limited in Bengaluru seeks a Senior AWS Data Engineer to design and deliver robust AWS cloud data platforms. You will lead a team building scalable, secure data pipelines and collaborate with architects, product owners, and stakeholders to migrate on-prem data to AWS.

The role requires 6–12 years of experience in AWS data services, data lake architecture, and CI/CD with CloudFormation/Terraform. Strong Python/SQL skills and DevOps culture are essential.

Qualifications

• Deep hands-on expertise with AWS Cloud Data Services.
• End-to-end Data Pipeline Design - ingestion, transformation, orchestration, and delivery.
• Strong experience in Data Lake / Lakehouse architecture on AWS.
• Proficient in Python and SQL for data processing and automation.
• Exposure to CI/CD pipelines, DevOps tools, and Infrastructure-as-Code (CloudFormation/Terraform).
• Advanced understanding of Cloud-native and Serverless architecture.
• Strong knowledge of Docker, Kubernetes, Amazon EKS.
• Cloud migration and modernization experience.
• In-depth understanding of networking, IAM, security, compliance, and DR in AWS.
• Performance tuning, monitoring, and cost optimization in data solutions.
• Collaborate closely with delivery teams to bridge gaps between design, implementation, and business expectations.
• Lead CI/CD automation, DevOps integration, and infrastructure-as-code deployment (CloudFormation/Terraform).
• Provide technical leadership, conduct code reviews, and enforce engineering best practices.
• Deliver technical presentations, knowledge-sharing sessions, and training to internal and external teams.
• Contribute to RFPs/RFIs, and support pre-sales activities with solution inputs.
• Build, configure, and optimize Informatica MDM Hub components and workflows (ActiveVOS, Match Rules, Survivorship).
• Provide support on technical issues during implementation.

Responsibilities

• Architect and implement robust AWS Cloud data platforms aligned with business goals.
• Lead a team of engineers to build scalable, secure, and high-performance data pipelines.
• Collaborate with solution architects, product owners, and business stakeholders to define requirements.
• Oversee migration of on-premise data systems to AWS Cloud environments.
• Design and implement ETL / ELT processes, orchestrations, and real-time data streaming.
• Define and enforce best practices in coding, deployment, and monitoring.
• Lead implementation of DevOps and CI/CD automation in data engineering projects.
• Ensure data security, backup, DR, and compliance across all cloud environments.
• Provide technical guidance, mentorship, and conduct code and architecture reviews.
• Prepare technical responses to RFPs/RFIs, deliver presentations, and knowledge-sharing sessions.
• Manage customer communications, clarify requirements, and resolve technical issues during implementation.
• Build and configure Informatica Hub components and related workflows where required.

Skills

AWS Data Services

Data Pipeline Design

Data Lake / Lakehouse

Python

SQL

CI/CD

DevOps

Infrastructure as Code

Cloud-native & Serverless

Docker

Kubernetes

Amazon EKS

Networking & IAM

Security & Compliance

Cost Optimization

Tools

CloudFormation

Terraform

Informatica MDM Hub

ActiveVOS

Job description

Greetings from Tata Consultancy Services (TCS)!!!

Job Title : Senior AWS Data Engineer

Experience : 6- 12 Years

Technical/Functional Skills -MUST HAVE SKILLS

• Deep hands-on expertise with AWS Cloud Data Services:
• End-to-end Data Pipeline Design - ingestion, transformation, orchestration, and delivery.
• Strong experience in Data Lake / Lakehouse architecture on AWS.
• Proficient in Python and SQL for data processing and automation.
• Exposure to CI/CD pipelines, DevOps tools, and Infrastructure-as-Code (CloudFormation/Terraform).
• Advanced understanding of Cloud-native and Serverless architecture.
• Strong knowledge of Docker, Kubernetes, Amazon EKS.
• Cloud migration and modernization experience.
• In-depth understanding of networking, IAM, security, compliance, and DR in AWS.
• Performance tuning, monitoring, and cost optimization in data solutions..
• Collaborate closely with delivery teams to bridge gaps between design, implementation, and business expectations.
• Lead CI/CD automation, DevOps integration, and infrastructure-as-code deployment (CloudFormation/Terraform).
• Provide technical leadership, conduct code reviews, and enforce engineering best practices.
• Deliver technical presentations, knowledge-sharing sessions, and training to internal and external teams.
• Contribute to RFPs/RFIs, and support pre-sales activities with solution inputs.
• Build, configure, and optimize Informatica MDM Hub components and workflows (ActiveVOS, Match Rules, Survivorship).
• Provide support on technical issues during implementation phase.

Responsibilities

• Architect and implement robust AWS Cloud data platforms aligned with business goals.
• Lead a team of engineers to build scalable, secure, and high-performance data pipelines.
• Collaborate with solution architects, product owners, and business stakeholders to define requirements.
• Oversee migration of on-premise data systems to AWS Cloud environments.
• Design and implement ETL / ELT processes, orchestrations, and real-time data streaming.
• Define and enforce best practices in coding, deployment, and monitoring.
• Lead implementation of DevOps and CI/CD automation in data engineering projects.
• Ensure data security, backup, DR, and compliance across all cloud environments.
• Provide technical guidance, mentorship, and conduct code and architecture reviews.
• Prepare technical responses to RFPs/RFIs, deliver presentations, and knowledge-sharing sessions.
• Manage customer communications, clarify requirements, and resolve technical issues during implementation.
• Build and configure Informatica Hub components and related workflows where required.