Lead Software Enginner- Java Bigdata + Spark - IT (Information Technology) - Bangalore, India

SGS Société Générale de Surveillance SA; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

SGS Société Générale de Surveillance SA in Bengaluru is seeking a Data Engineer to build scalable data architectures, automate pipelines, and deliver streaming ingestion and transformation solutions in a banking context.

You will collaborate with universal analysts, platform engineers and data scientists to optimize data platforms, understand cost levers, and deploy cost-effective, strategic data solutions using Java, Spark, Azure services, and modern CI/CD practices.

Qualifications

• 8–10 years of experience in Java, Spring Framework and Spring Boot.
• Hands-on Spark with Java (2+ years).
• RESTful APIs experience and unit testing (JUnit or similar).
• Azure Cloud Services exposure like AKS.
• Nice to have Spark Streaming, Kafka and data modelling capabilities.

Responsibilities

• Build scalable data pipelines and data architecture.
• Deliver streaming data ingestion and transformation solutions.
• Collaborate with analysts, platform engineers and data scientists.
• Improve data platform cost efficiency and governance.

Skills

Java

Spring Framework

Spring Boot

Spark with Java

RESTful API

JUnit

Azure Kubernetes Service

Spark Streaming

Kafka

Data modelling

Docker

Kubernetes

Maven

Jenkins

Agile/CD

Tools

Docker

Kubernetes

Maven

Jenkins

Job description

Responsibilities

As a Data Engineer,Working closely with universal analysts, platform engineers and data scientists, you’ll carry out data engineering tasks to build a scalable data architecture, including data extractions and data transformation.Building automated data engineering pipelinesDelivering streaming data ingestion and transformation solutionsParticipating in the data engineering community to deliver opportunities to support the bank's strategic direction.Developing a clear understanding of data platform cost levers to build cost effective and strategic solutions.

Profile required

Mandatory Skills

Require minimum of 8 to 10 years of experience on Java, Spring Framework, Spring BootDeep expertise and hands on programing experience in Core Java (Java 8+).Hands-on experience with at least 2 years in Spark using Java.Should have experience in RESTful API,Experience in creating & executing unit tests and follow test driven approach with JUnit or any other equivalent frameworks.Experience of working on Azure Cloud Services like Azure Kubernetes ServiceGood to have Experience of Spark Streaming, Kafka and data modelling capabilities.

Required Skills

Responsible for technical deliverables and handle L3 technical support.Having experience in RDBMS like PostgreSQL is added advantage.Good knowledge of container technologies such as Docker and KubernetesGood experience on Maven, Jenkins and building CI/CD pipelines and must follow IT craftsmanship principles.Would be great if worked on Agile or Continuous Delivery (CD) based projects before.Good interpersonal skills and should be able to mentor team on BAU activities.Good to have exposure to Investment banking domain.Resourcefulness and troubleshooting aptitude combined with good communication skills.

Why join us

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran statusBusiness insightAt Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!Still hesitating?You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.