FBS Data Engineer - Elastic

Capgemini; Maharashtra; Hybrid; INR 1,500,000 - 2,700,000; Full time

Benefits offered by this job

Flexible work arrangements

Private Health Insurance

Pension Plan

Paid Time Off

Training & Development

Job summary

Capgemini seeks an experienced ELK engineer to design, implement and optimize scalable ELK-based solutions on AWS. The role involves building data ingestion pipelines, developing Java Spring Boot REST APIs and ensuring secure, high-performance search and analytics across large datasets.

You will collaborate with architecture teams and participate in Agile ceremonies while driving CI/CD pipelines with Jenkins and GitHub Actions. Remote/office-based work arrangements available in India.

Qualifications

• Must have ELK stack solutions on AWS Cloud, RESTful APIs, Java Spring Boot/Python, JSON, Logstash, message queues, Java batch processes, Kafka, Apache Flink, and Aurora DB.
• Total Experience - 07 - 09 Years.

Responsibilities

• Design and develop robust ELK solutions on AWS.
• Evaluate and optimize Elasticsearch clusters and indexing strategies.
• Build data ingestion pipelines via Logstash, MQ/ACE, and Java batch processes on AWS.
• Develop RESTful APIs using Java Spring Boot for AWS Lambda-hosted apps.
• Implement CI/CD pipelines and DevOps practices with Jenkins and GitHub Actions.
• Collaborate with Architecture teams to secure and maintain ELK-based solutions.
• Troubleshoot production issues related to search, indexing, and backend performance.

Tools

ELK stack

AWS

Java Spring Boot

Python

JSON

Logstash

Kafka

Apache Flink

Aurora DB

Jenkins

GitHub Actions

Maven

Job description

Design and develop robust, highly scalable, and efficient ELK (Elasticsearch, Logstash, Kibana) stack solutions hosted on AWS Cloud. Evaluate and optimize Elasticsearch clusters, including configuration parameters, indexing strategies, search, relevancy tuning, query performance tuning, security, scalability, and administration. Design data structures and models tailored for Elasticsearch. Develop complex queries with joins across large datasets using both RDBMS and Elasticsearch. Build data ingestion pipelines integrating Elasticsearch with various sources via Logstash, MQ via IBM Integration Bus/ACE, and Java based batch processes scheduled on AWS EC2. Develop and expose RESTful APIs using Java Spring Boot for applications hosted on AWS Lambda. Write clean, high-quality, and maintainable Java code using the Spring Boot framework. Collaborate with Integration and Architecture teams to design, document, build, secure, and maintain ELK based solutions. Deploy applications utilizing AWS services such as EC2, S3, Lambda, Step functions, IAM, SNS, API Gateway, VPC, Transit Gateway, and Cloud Watch. Manage CI/CD pipelines and DevOps process with using Jenkins and GitHub Actions. Oversee build and release process with tools like Maven and Jenkins. Actively participate in Agile ceremonies, providing status updates and technical insights during sprint meetings. Work cross-functionally to coordinate efforts and deliver projects on time. Troubleshoot and resolve production issues related to search, indexing, and backend performance. Stay current with industry trends and best practices related to Elasticsearch, Java development and cloud-based architectures.

Requirements

Must to have Skills : ELK stack solutions on AWS Cloud, RESTful APIs, Java Spring Boot/Python, JSON, Logstash, message queues, Java batch processes, Kafka, Apache Flink, and Aurora DB, Jenkins, GitHub Actions,Maven

Total Experience - 07 - 09 Years

Work Timings (India) - 01:00 PM to 10:00 PM IST

Benefits

Competitive compensation and benefits package:

• Competitive salary and performance-based bonuses
• Comprehensive benefits package
• Career development and training opportunities
• Flexible work arrangements (remote and/or office-based)
• Dynamic and inclusive work culture within a globally renowned group
• Private Health Insurance
• Pension Plan
• Paid Time Off
• Training & Development

Note: Benefits differ based on employee level.

About Capgemini

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 340,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group €22.5 billion in revenues in 2023.

https://www.capgemini.com/us-en/about-us/who-we-are/