Software Engineer - Big Data

SGS Société Générale de Surveillance SA; Bengaluru; On-site; INR 1,200,000 - 1,500,000; Full time

Job summary

SGS Société Générale de Surveillance SA is seeking a software developer to contribute to the Octoflow project. You will implement code and test cases, deliver clean, reusable designs, and collaborate with multiple teams to define APIs and data access rules.

The role requires 2–3 years of hands-on experience with Scala, Spark, SQL, and big data tools, in an Agile, international setting. A performance-driven, rigorous approach is essential.

Qualifications

• Hands-on experience 2-3 years is required.
• Experience with Scala, Shell, Spark, SQL, PostgreSQL, Hive, Starburst, Hadoop and Kafka.
• Proactive in optimizing development and able to work in an international environment.
• Agile, backlog management, and collaborative work practices.
• Rigor and adherence to group standards (security, quality, compliance).

Responsibilities

• Develop code and test case scenarios following SDLC and Agile practices.
• Deliver high-quality clean code and reusable design.
• Define and implement APIs and data access rules with other dev teams.
• Run and maintain test suites and produce test/defect reports.
• Support data models, data dictionary, and metadata storage.

Skills

Scala

Shell

Spark

SQL

PostgreSQL

Hive

Starburst

Hadoop

Kafka

Jenkins

Ansible

Control-M

Agile

Backlog management

Collaboration

Security compliance

Tools

Jenkins

Ansible

Control-M

Starburst

Job description

Responsibilities

About project: The Octoflow project is a tool for mapping and certifying network flows. Octoflow collects information via APIs from data sources (IPAM, DNS, etc.) to perform ingestion and mapping of flows. It will also be responsible for adding business-related features around the data.

JD: Develop code and test case scenarios by applying relevant software craftsmanship principles and meet the acceptance criteria. Complete the assigned learning path and contribute to daily meetings. Deliver on all aspects of Software Development Lifecyle (SDLC) in-line with Agile and IT craftsmanship principles. Take part in team ceremonies be it agile practices or chapter meetings. Deliver high-quality clean code and design that can be re-used. Actively, work with other Development teams to define and implement API's and rules for data access. Perform bug-free release validations and produce test and defect reports. Contribute to developing scripts, configuring quality and automating framework usage. Run and maintain test suites with the guidance of seniors. Support existing data models, data dictionary, data pipeline standards, storage of source, process and consumer metadata.

Technical Skills

Languages: Scala, Shell

Data Processing: Spark, SQL

Databases: PostgreSQL, Hive, Starburst (query tools)

Big Data: Hadoop, Kafka

CI/CD: Jenkins, Ansible, Control-M

Methodology: Agile, backlog management, collaborative work

Soft Skills

Rigor and adherence to group standards (security, quality, compliance)

Ability to work in an international environment

Proactive in optimizing development

Hands on experience 2-3 years is required. Profile required

Technical Skills

Languages: Scala, Shell

Data Processing: Spark, SQL

Databases: PostgreSQL, Hive, Starburst (query tools)

Big Data: Hadoop, Kafka

CI/CD: Jenkins, Ansible, Control-M

Methodology: Agile, backlog management, collaborative work

Soft Skills

Rigor and adherence to group standards (security, quality, compliance)

Ability to work in an international environment

Proactive in optimizing development

Why join us

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

Business insight

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating? You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.

We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.