Specialist Software Engineer - Bigdata

SGS Société Générale de Surveillance SA; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

SGS Société Générale de Surveillance SA in Bengaluru is seeking an experienced Data Engineer to contribute as an individual contributor on a Big Data Lakehouse migration project. You will migrate and test applications on Snowflake, Snowpark, Spark, and Hive in a retail banking data environment, leveraging DBT where applicable.

The role demands strong SQL skills, proficiency in Python or Scala, and the ability to collaborate with globally distributed teams, participate in agile ceremonies, and

Qualifications

• 3–7 years of experience on big data platform and 2+ years implementing DWH on Snowflake.
• Cloud platforms experience, preferably Azure data services.
• Strong SQL and at least one of Scala or Python.

Responsibilities

• Will work as an Individual contributor on Big Data Migration Project to Lakehouse migration project.
• Perform tasks related to migrating & testing applications on Snowflake, Snowpark, Apache Spark, Hive , on new retail banking data Lakehouse.
• Good to have knowledge on DBT.
• Perform extensive testing of the migrated code, debugging & fixing issues.
• Manage DevOPS as required & defined on the project
• Automate processes wherever required to improve efficiency of testing team.
• Co-ordinate with diverse geographically located teams to complete assigned activities.
• Participate in daily various agile ceremonies during the ongoing sprint and complete tasks as required.
• Conduct bug‑free release validations and produce metrics, tests, and defect reports.
• Assist in developing and enforcing team guidelines.
• Being spoc for the team and provide information/status on ongoing activities on regular basis to management whenever needed.

Tools

Snowflake

Snowpark

Azure

Apache Spark

Hadoop

SQL

Python/Scala

ETL/ELT

DBT

Job description

Responsibilities

• Will work as an Individual contributor on Big Data Migration Project to Lakehouse migration project.
• Perform tasks related to migrating & testing applications on Snowflake, Snowpark, Apache Spark, Hive , on new retail banking data Lakehouse.
• Good to have knowledge on DBT.
• Perform extensive testing of the migrated code, debugging & fixing issues.
• Manage DevOPS as required & defined on the project
• Automate processes wherever required to improve efficiency of testing team.
• Co-ordinate with diverse geographically located teams to complete assigned activities.
• Participate in daily various agile ceremonies during the ongoing sprint and complete tasks as required.
• Conduct bug‑free release validations and produce metrics, tests, and defect reports.
• Assist in developing and enforcing team guidelines.
• Being spoc for the team and provide information/status on ongoing activities on regular basis to management whenever needed.

Profile required

ACE can help you write this job description (go/ACE)

• At least 3 to 7 Years of experience on big data platform and at least 2 years of experience in implementing DWH on Snowflake
• Proven experience with cloud platforms preferable Azure particularly on data services
• Good understanding of distributed computing frameworks like Apache Spark, Hadoop etc
• Perform Analysis on existing data storage systems Big Data & development of data solutions in Snowflake
• High Proficiency in SQL and at least one of the following languages Scala / Python
• Experience in working on migrating data from on-premise databases preferably Big Data platformto Snowflake
• Expertise in building robust ELT/ETL processes , performance tuning of the data pipelines in Snowflake and should be able to trouble shoot the issues quickly
• Strong Knowledge on Integration concepts and design best practices
• Data Modeling & data integration, Advanced SQL skills for analysis, standardizing queries
• Proven experience in managing and mentoring data engineering teams
• Excellent interpersonal skills, with the ability to work across teams and communicate effectively with technical and nontechnical stake holders
• Strong analytical and trouble shooting skills with proven ability to find solutions in complex data environments

Why join us

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status

Business insight

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!Still hesitating?You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.