Lead Software Engineer - Spark Scala - IT (Information Technology) - Bangalore, India

Societe Generale SA; Bengaluru; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Societe Generale SA in Bengaluru seeks an experienced Senior Data Engineer to design, implement, and lead data lake solutions. You will work within a dynamic data team, shaping the data platform with Hadoop stack expertise, delivering scalable pipelines and technical guidance across projects.

The role requires 8+ years of hands-on experience and strong Linux, Spark, Scala, and CI/CD skills, with Agile practices guiding daily work.

Qualifications

• 8+ years of relevant experience in data engineering.
• Hands-on with Hadoop stack including Scala, Hive, HDFS, Spark, Yarn.
• Strong knowledge of Linux, Git, SQL, and SSAS.

Responsibilities

• Understand business needs and transform them into technical solutions.
• Implement and maintain new Big Data solutions in the data ecosystem.
• Lead and coordinate onsite/offshore delivery and drive offshore deliverables.

Skills

Scala

Hive

HDFS

Spark

Yarn

Linux

Git

CI/CD

Jenkins

SQL

SSAS

Tools

Git

Jenkins

CI/CD Pipeline

Job description

Responsibilities

• Understand the business needs and transform it to a technical solution
• implement new solution in BigData ecosystem
• maintain the existing solution by enhancing and providing support technically
• follow the agile methodology and best practices in day to day work
• Lead and steer the Datalake team techno - functionally
• Work along with BA and AMs to refine and give technical insights for Data engineering topics
• Propose new solutions to improve the efficiency wherever possible
• Understand functional requirements and raise clarifications with BAs and others concerned.
• Should have experience in coordinating onsite/offshore team members. Delivery ownership for offshore deliverables.
• Should be able to estimate from high level requirement and do an independent estimate from detailed functionalspecification
• Capability to provide technical design and implement on complex requirement.
• Understand Agile practices (daily scrum, iteration planning, retrospective, test driven, model storming) and follow the same.
• Meticulously review the design, test cases and code
• Coding, Unit Testing and Integration Testing.

Profile required

Requires 8+ years relevant experience.

Should have experience in leading activities and also hands on experience on the technical stack mentioned below

• Hadoop stack :- Scala, Hive, HDFS, Spark, Yarn – Mandatory skill - ScalaAwareness in Parallel computing, Data storage, Resource Mgmt.
• Very comfortable in Linux.
• Experience of GIT & CI / CD
• Delivery of reliable, scalable, modular and quality software that fully meets client expectations.
• Individual is independent and accountable for the results
• Good knowledge in Jenkins, GIT, SQL,SSAS

Why join us

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status

Business insight

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.

Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating? You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices and sharing their skills with charities. There are many ways to get involved.