Senior AWS Data Engineer

Tata Consultancy Services; Hyderabad; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Tata Consultancy Services is seeking a senior data engineering leader to design and implement AWS cloud data solutions. You will guide Data Lake/Lakehouse projects, architect end-to-end pipelines, and mentor teams across delivery engagements.

Key duties include ensuring security/compliance, optimizing performance, and collaborating with architects and clients to align technology with business goals.

Qualifications

• Experience leading design and development of AWS cloud data solutions.
• Strong track record in Data Lake / Lakehouse architectures on AWS.
• Hands-on Python and SQL for data processing and automation.
• Exposure to CI/CD pipelines, DevOps, and Infrastructure as Code.
• Experience with data governance, security, and compliance in cloud data solutions.

Responsibilities

• Lead design and development of AWS cloud data solutions for clients.
• Drive architecture for Data Lake / Lakehouse implementations and data pipelines.
• Mentor data engineering teams on AWS best practices and delivery governance.
• Manage large-scale data ingestion, transformation, and orchestration pipelines.
• Engage with clients, discuss solutions, and support pre-sales activities.
• Provide technical leadership, code reviews, and training to teams.

Skills

AWS Cloud Data

Data Lake / Lakehouse

Data Engineering Leadership

Python

SQL

CI/CD automation

DevOps

CloudFormation

Terraform

Docker

Kubernetes

Amazon EKS

Informatica MDM Hub

ActiveVOS

Data governance

Data modeling

Data quality

Metadata management

Security & Compliance

Networking

IAM

DR

Tools

Docker

Kubernetes

Amazon EKS

CloudFormation

Terraform

Informatica MDM Hub

ActiveVOS

Job description

• Lead design and development of AWS Cloud Data Solutions.
• Drive architecture and implementation for Data Lake / Lakehouse solutions.
• Lead and mentor data engineering teams on AWS cloud best practices.
• Handle large-scale data ingestion, transformation, and orchestration pipelines.
• Manage client interactions, solution discussions, and delivery governance.
• Ensure security, compliance, and performance optimization in cloud data solutions.
• Collaborate with architects and delivery teams for end-to-end implementation.
• Deep hands-on expertise with AWS Cloud Data Services:
• End-to-end Data Pipeline Design – ingestion, transformation, orchestration, and delivery.
• Strong experience in Data Lake / Lakehouse architecture on AWS.
• Proficient in Python and SQL for data processing and automation.
• Exposure to CI/CD pipelines, DevOps tools, and Infrastructure-as-Code (CloudFormation/Terraform).
• Advanced understanding of Cloud-native and Serverless architecture.
• Strong knowledge of Docker, Kubernetes, Amazon EKS.
• Cloud migration and modernization experience.
• In-depth understanding of networking, IAM, security, compliance, and DR in AWS.
• Performance tuning, monitoring, and cost optimization in data solutions..
• Collaborate closely with delivery teams to bridge gaps between design, implementation, and business expectations.
• Lead CI/CD automation, DevOps integration, and infrastructure-as-code deployment (CloudFormation/Terraform).
• Provide technical leadership, conduct code reviews, and enforce engineering best practices.
• Deliver technical presentations, knowledge-sharing sessions, and training to internal and external teams.
• Contribute to RFPs/RFIs, and support pre-sales activities with solution inputs.
• Build, configure, and optimize Informatica MDM Hub components and workflows (ActiveVOS, Match Rules, Survivorship).
• Provide support on technical issues during implementation phase.
• Working knowledge of Informatica MDM Hub, ActiveVOS, and data governance frameworks.
• Exposure to data modeling, data quality, and metadata management concepts.