AI/ML with Bedrock and Python Data Engineer

Tata Consultancy Services; Pune District, Bengaluru, Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services seeks a skilled data engineering professional with strong AWS data ecosystem experience, Python, Py-Spark and SQL for data transformation. You will work on ML/AI workflows, vector databases and RAG pipelines, leveraging SageMaker and Kendra, with Docker/EKS for containerization.

Deep knowledge of data modeling, schema design, and performance tuning is essential, along with hands-on experience in CI/CD and IaC (Terraform/CloudFormation) to deliver scalable data solutions

Qualifications

• Experience with AWS data ecosystem and ML/AI workflows.
• Proficiency in Python, Py-Spark and SQL for data transformation.
• Knowledge of data modeling, schema design and performance tuning.
• Experience with CI/CD and IaC (Terraform/CloudFormation).
• Familiarity with vector databases and RAG pipelines.
• Exposure to ML/AI solutions on AWS (SageMaker, Kendra).
• Understanding of containerization (Docker/EKS).

Skills

AWS data ecosystem

Python

Py-Spark

SQL

Data transformation

CI/CD

Terraform

CloudFormation

OpenSearch

Pinecone

FAISS

RAG pipelines

SageMaker

Kendra

Docker

EKS

Tools

Docker

Kubernetes (EKS)

OpenSearch

Pinecone

FAISS

Job description

• Strong handson experience with AWS data ecosystem: Glue, Athena, Lambda, S3, Redshift, Kinesis.
• Experience with Amazon Bedrock, LLM integration, and GenAI workflows.
• Expertise in Python, Py-Spark, SQL, and data transformation.
• Good understanding of data modeling, schema design, and performance tuning.
• Experience with CI/CD and IaC (Terraform/CloudFormation).
• Knowledge of vector databases (OpenSearch, Pinecone, FAISS).
• Experience building RAG pipelines.
• Exposure to ML/AI solutions on AWS (SageMaker, Kendra).
• Knowledge of containerization (Docker/EKS). Role & responsibilities