Senior AWS Data Engineer

Tata Consultancy Services; Bengaluru; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Tata Consultancy Services in Bengaluru seeks an experienced Senior Data Engineer to lead AWS cloud data platform design, build scalable pipelines, and mentor data engineering teams. You will collaborate with architects and delivery teams to ensure secure, compliant, and high-performance data solutions across modern cloud environments.

The role emphasizes end-to-end implementation, data governance, and cost optimization while delivering client-focused data engineering solutions on AWS.

Qualifications

• Deep hands-on expertise with AWS cloud data services and data pipelines.
• Strong Python and SQL for data processing and automation.
• Experience with CI/CD, DevOps tools, and IaC (CloudFormation/Terraform).
• Data Lake/Lakehouse architecture on AWS, and security/compliance focus.

Responsibilities

• Architect and implement robust AWS cloud data platforms aligned with business goals.
• Lead a team of engineers to build scalable, secure data pipelines.
• Collaborate with solution architects and stakeholders to define requirements.
• Oversee migration of on-premise data systems to AWS Cloud environments.
• Design and implement ETL/ELT processes, orchestration, and real-time streaming.

Skills

AWS Cloud Data Services

Data Pipeline Design

Data Lake / Lakehouse

Python & SQL

CI/CD & IaC

Docker & Kubernetes

Tools

Informatica MDM Hub

ActiveVOS

CloudFormation

Terraform

Job description

• (in Yrs.)
• Lead design and development of AWS Cloud Data Solutions.
• Drive architecture and implementation for Data Lake / Lakehouse solutions.
• Lead and mentor data engineering teams on AWS cloud best practices.
• Handle large-scale data ingestion, transformation, and orchestration pipelines.
• Manage client interactions, solution discussions, and delivery governance.
• Ensure security, compliance, and performance optimization in cloud data solutions.
• Collaborate with architects and delivery teams for end-to-end implementation.

Key words to search in resume

AWS, Senior Data Engineer, Cloud, Glue, Lambda, Redshift, S3, EMR, Athena, Kinesis, DMS, Kubernetes, EKS, DevOps, Informatica, Data Lake, Data Pipeline, Lakehouse, Cloud Migration, Serverless

Technical/Functional Skills

MUST HAVE SKILLS

• Deep hands-on expertise with AWS Cloud Data Services:
• S3, Glue, Lambda, DMS, Redshift, Athena, EMR, Kinesis, Secret Manager
• End-to-end Data Pipeline Design – ingestion, transformation, orchestration, and delivery.
• Strong experience in Data Lake / Lakehouse architecture on AWS.
• Proficient in Python and SQL for data processing and automation.
• Exposure to CI/CD pipelines, DevOps tools, and Infrastructure-as-Code (CloudFormation/Terraform).
• Advanced understanding of Cloud-native and Serverless architecture.
• Strong knowledge of Docker, Kubernetes, Amazon EKS.
• Cloud migration and modernization experience.
• In-depth understanding of networking, IAM, security, compliance, and DR in AWS.
• Performance tuning, monitoring, and cost optimization in data solutions..
• Collaborate closely with delivery teams to bridge gaps between design, implementation, and business expectations.
• Lead CI/CD automation, DevOps integration, and infrastructure-as-code deployment (CloudFormation/Terraform).
• Provide technical leadership, conduct code reviews, and enforce engineering best practices.
• Deliver technical presentations, knowledge-sharing sessions, and training to internal and external teams.
• Contribute to RFPs/RFIs, and support pre-sales activities with solution inputs.
• Build, configure, and optimize Informatica MDM Hub components and workflows (ActiveVOS, Match Rules, Survivorship).
• Provide support on technical issues during implementation phase.

Secondary Skills

• Java programming experience.
• Working knowledge of Informatica MDM Hub, ActiveVOS, and data governance frameworks.
• Exposure to data modeling, data quality, and metadata management concepts.

Responsibilities

• Architect and implement robust AWS Cloud data platforms aligned with business goals.
• Lead a team of engineers to build scalable, secure, and high-performance data pipelines.
• Collaborate with solution architects, product owners, and business stakeholders to define requirements.
• Oversee migration of on-premise data systems to AWS Cloud environments.
• Design and implement ETL / ELT processes, orchestrations, and real-time data streaming.
• Define and enforce best practices in coding, deployment, and monitoring.
• Lead implementation of DevOps and CI/CD automation in data engineering projects.
• Ensure data security, backup, DR, and compliance across all cloud environments.
• Provide technical guidance, mentorship, and conduct code and architecture reviews.
• Prepare technical responses to RFPs/RFIs, deliver presentations, and knowledge-sharing sessions.
• Manage customer communications, clarify requirements, and resolve technical issues during implementation.
• Build and configure Informatica Hub components and related w