AWS OpenSearch Platform Engineer

Tata Consultancy Services; Greater London; On-site; GBP 75,000 - 110,000; Full time

Benefits offered by this job

Pension

Health insurance

Company laptop

Learning budget

Job summary

Tata Consultancy Services UK is seeking an experienced OpenSearch/Cloud data engineer to design, implement, and optimize OpenSearch clusters for enterprise-scale search and observability within a major UK retail environment.

You will work on indexing strategies, data retention, and real-time ingestion pipelines using Kafka, Terraform and AWS services, ensuring performance, resilience and security in cloud-native architectures.

Qualifications

• Hands-on AWS OpenSearch cluster administration in enterprise environments.
• Experience building and supporting Kafka-based ingestion pipelines for real-time search and observability.
• Proficiency with Terraform for infrastructure provisioning and automation.
• OpenSearch indexing, query optimization, shard management and performance tuning.
• Experience with monitoring/observability tools (CloudWatch, Grafana, Prometheus).
• Strong troubleshooting skills and incident handling in production environments.

Responsibilities

• Design AWS OpenSearch cluster solutions aligned with business needs.
• Engineer and support scalable OpenSearch solutions for search, analytics and monitoring across retail platforms.
• Develop indexing and data retention strategies for large-scale datasets.
• Build Kafka-driven data ingestion pipelines for real-time workloads.
• Automate deployment and configuration using Terraform and AWS services.
• Monitor performance, scalability and reliability, and apply improvements.

Skills

OpenSearch admin

Kafka pipelines

Terraform

OpenSearch tuning

Monitoring tools

Troubleshooting

Tools

Terraform

CloudFormation

Job description

Tata Consultancy Services UK is seeking an experienced OpenSearch/Cloud data engineer to design, implement, and optimize OpenSearch clusters for enterprise-scale search and observability within a major UK retail environment.

You will work on indexing strategies, data retention, and real-time ingestion pipelines using Kafka, Terraform and AWS services, ensuring performance, resilience and security in cloud-native architectures.