AWS Open Search Engineer

Tata Consultancy Services; Greater London; On-site; GBP 75,000 - 110,000; Full time

Benefits offered by this job

Pension

Health insurance

Company laptop

Learning budget

Job summary

Tata Consultancy Services UK is seeking an experienced OpenSearch/Cloud data engineer to design, implement, and optimize OpenSearch clusters for enterprise-scale search and observability within a major UK retail environment.

You will work on indexing strategies, data retention, and real-time ingestion pipelines using Kafka, Terraform and AWS services, ensuring performance, resilience and security in cloud-native architectures.

Qualifications

• Hands-on AWS OpenSearch cluster administration in enterprise environments.
• Experience building and supporting Kafka-based ingestion pipelines for real-time search and observability.
• Proficiency with Terraform for infrastructure provisioning and automation.
• OpenSearch indexing, query optimization, shard management and performance tuning.
• Experience with monitoring/observability tools (CloudWatch, Grafana, Prometheus).
• Strong troubleshooting skills and incident handling in production environments.

Responsibilities

• Design AWS OpenSearch cluster solutions aligned with business needs.
• Engineer and support scalable OpenSearch solutions for search, analytics and monitoring across retail platforms.
• Develop indexing and data retention strategies for large-scale datasets.
• Build Kafka-driven data ingestion pipelines for real-time workloads.
• Automate deployment and configuration using Terraform and AWS services.
• Monitor performance, scalability and reliability, and apply improvements.

Skills

OpenSearch admin

Kafka pipelines

Terraform

OpenSearch tuning

Monitoring tools

Troubleshooting

Tools

Terraform

CloudFormation

Job description

If you need support in completing the application or if you require a different format of this document, please get in touch with [e-mail] or call TCS London Office number 02031552100 / [phone] with the subject line: “Application Support Request”.

Careers at TCS: It means more

TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.

• Join a dynamic engineering team building scalable, secure, and highly available search and observability platforms that power critical retail services.
• Work with cutting-edge AWS OpenSearch technologies, Kafka-based event streaming, cloud-native platforms, and infrastructure automation solutions.

The Role

This role will play a key part in delivering enterprise-scale search, observability, and data platform solutions for one of the UK's leading retailers. You will be responsible for engineering, optimizing, and supporting AWS OpenSearch environments while working with technologies including Kafka, Terraform, AWS services, Kotlin, Java Spring Boot, and cloud-native architectures. The role requires strong hands-on expertise in performance tuning, automation, scalability, reliability, and operational excellence.

Your responsibilities:

• Design and implement AWS OpenSearch cluster solutions aligned with business and operational requirements.
• Engineer and support scalable AWS OpenSearch solutions that enable search, analytics, and operational monitoring across retail platforms.
• Design and implement efficient indexing strategies, query optimization techniques and data lifecycle management processes.
• Build and maintain Kafka-driven data ingestion pipelines for real-time search and observability workloads.
• Automate infrastructure deployment and configuration management using Terraform and AWS-native services.
• Analyze platform performance metrics and proactively improve scalability, resilience and operational efficiency.
• Work closely with cross-functional engineering teams to deliver secure, reliable and cloud-native solutions.
• Act as a technical SME for OpenSearch, providing guidance on best practices, troubleshooting, and platform optimization.

Your Profile

Key Responsibilities:

• Design and implement AWS OpenSearch cluster solutions aligned with business and operational requirements.
• Develop indexing, search and data retention strategies for large-scale datasets.
• Drive OpenSearch performance tuning, upgrades, patching and platform improvements.
• Develop and maintain infrastructure automation using Terraform and AWS services.
• Implement observability frameworks including monitoring, logging, dashboards and alerting.
• Support incident management, problem resolution, and platform stability initiatives.
• Apply security, governance and operational best practices across OpenSearch environments.

Skills Required

• Strong hands-on experience administering and supporting AWS OpenSearch clusters in enterprise environments.
• Experience implementing Kafka-based ingestion pipelines and log analytics solutions.
• Proficiency in Terraform for infrastructure provisioning and environment management.
• Hands-on expertise in OpenSearch indexing, query optimization, shard management and performance tuning.
• Experience with monitoring and visualization tools for platform observability and operational support.
• Strong troubleshooting skills with the ability to resolve complex production issues.
• Knowledge of security controls, access management, encryption, backup and disaster recovery strategies.

Technologies

• Programming Languages: Java, Kotlin, Python, Shell Scripting
• Infrastructure as Code: Terraform, CloudFormation
• Messaging & Streaming: Kafka, Confluent Cloud
• Monitoring & Observability: CloudWatch, Grafana, Prometheus, OpenSearch Dashboards

TCS is consistently voted as a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.

We offer health & wellness initiatives and sports events; we are the proud sponsor of the London Marathon.

Diversity, Inclusion and Wellbeing

Tata Consultancy Services UK&I is committed to meeting the accessibility needs of all individuals in accordance with the UK Equality Act 2010 and the UK Human Rights Act 1998.

We welcome and embrace diversity in race, nationality, ethnicity, disability, neurodiversity, gender identity, age, physical ability, gender reassignment, sexual orientation. We are a disability inclusive employer and encourage disabled people to apply for this role.

As a Disability Confident Employer, we offer an interview to applicants with disabilities or long-term conditions who meet the minimum criteria for the role. Please email us at [e-mail] if you would like to opt in.

If you are an applicant who needs any adjustments to the application process or interview, please contact us at [e-mail] with the subject line: “Adjustment Request” or call TCS London Office 02031552100 / [phone] to request an adjustment. We welcome requests prior to you completing the application and at any stage of the recruitment process.