Senior AWS Data Engineer- Python, Golang & Snowflake

Tata Consultancy Services Limited; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Tata Consultancy Services Limited is seeking a Senior AWS Data Engineer to build and operate high-performance data pipelines using Python, Golang, and Snowflake. You will work across distributed teams to implement scalable data solutions on AWS, with a focus on reliability, security, and governance.

The role requires 8–10 years of IT experience with strong expertise in backend and data engineering, including Docker, CI/CD, and observability tools like Datadog and Grafana.

Qualifications

• 8–10 years of IT experience (Mandatory).
• 3+ years focused on data engineering or distributed data platforms.
• Experience with Golang, Python, AWS services, SQL/NoSQL and Kafka in production.
• RESTful API and data service design experience.
• Experience building highly available distributed systems on AWS and Docker.
• Strong cloud security practical knowledge (IAM, encryption, secrets management).

Responsibilities

• Build and maintain high-performance, event-driven data pipelines.
• Define engineering standards, patterns, and governance.
• Design canonical data models to standardize data domains.
• Build and manage CI/CD pipelines for reliable delivery.
• Enhance observability with Datadog and Grafana for reliability.
• Collaborate with distributed teams to translate requirements into scalable data solutions.
• Design and manage AWS infrastructure for high availability and low latency.

Skills

Golang

Python

AWS

Data engineering

API design

CI/CD

Docker

Kafka

Observability

Security best practices

Education

15 years of Full Time Education

Tools

Docker

Git

Jenkins

GitLab CI

Datadog

Grafana

Kafka

RabbitMQ

Job description

TCS Hiring for Senior AWS Data Engineer- Python, Golang & Snowflake

Experience Range: - 08 To 10 Years (Mandatory)

(Note: Candidates below 8 years of IT experience shall not be considered)

Notice Period: 60-90 days

JOB DESCRIPTION

Key responsibilities:

• Build and maintain high-performance, event-driven integration pipelines, applying strong debugging and performance optimization skills to ensure resilient data flows.
• Define and enforce technical standards, design patterns, and engineering best practices across development, security and data governance.
• Design and enforce canonical data models and schemas to standardize complex organizational data domains across systems.
• Build and manage CI/CD pipelines to enable reliable, repeatable, and automated software delivery.
• Drive observability and monitoring using tools such as Datadog and Grafana to ensure system reliability and performance.
• Collaborate with distributed engineering teams and cross-functional stakeholders to translate business requirements into scalable data solutions delivered within agreed timelines.
• Design and manage AWS infrastructure to ensure high availability, scalability, and low-latency processing for data workloads.

Must Have Skills:

• Strong hands-on experience in Golang and Python for backend and data engineering use cases.
• Strong hands-on experience with AWS cloud services – AWS Lambda, S3, API Gateway, RDS, Glue, SQS, SNS, EC2, ECS, IAM, CloudWatch and cloud-native architecture patterns.
• Strong experience with relational databases (e.g., PostgreSQL, MS SQL) and NoSQL stores (e.g., DynamoDB).
• Strong hands-on experience with message brokers and event-driven architectures (e.g., Kafka, RabbitMQ).
• Hands-on experience designing and implementing RESTful APIs and data services.
• Hands-on experience with CI/CD tools (e.g., Jenkins, GitLab CI), distributed version control system like Git.
• Experience building highly available, distributed systems on AWS, including containerization using Docker.
• Hands on experience building highly available distributed systems in AWS and containerization using Docker.
• Experience with observability platforms such as Datadog, Prometheus, or equivalent.
• Strong understanding of cloud security best practices including IAM, encryption, secrets management, vulnerability scanning, and compliance controls.

Qualifications:

• Software engineering experience, with at least 3+ years focused on data engineering or distributed data platforms.
• Experience working with Golang, Python, AWS Services, SQL/NoSQL and Kafka in production environments.

Nice to Have: AWS certifications such as AWS Certified Data Engineer – Associate, AWS Certified Solutions Architect – Associate, AWS Certified Developer Associate.

15 years of Full Time Education