Specialist Software Engineer - Bigdata

Societe Generale Global Solution Centre; Bengaluru; On-site; INR 3,000,000 - 5,400,000; Full time

Job summary

Societe Generale Global Solution Centre in Bengaluru is seeking an experienced data engineer to drive big data migrations to Snowflake and Lakehouse architectures. You will implement ELT/ETL pipelines, validate releases, and collaborate with cross-geo teams to ensure quality and timely delivery.

The role requires deep SQL, Spark, and Snowflake expertise, with Python/Scala skills and a background in DWH migrations from on-premise systems.

Qualifications

• 3–7 years of experience on big data platforms.
• 2+ years implementing DWH on Snowflake.
• Proven experience with cloud platforms, preferably Azure.
• Strong SQL and at least one of Scala/Python.
• Experience migrating data from on-premise databases to Snowflake.
• Expertise in building robust ELT/ETL processes and performance tuning in Snowflake.
• Strong knowledge of integration concepts and data modeling.
• Experience mentoring data engineering teams.

Responsibilities

• Migrate and test applications on Snowflake and Lakehouse.
• Migrate data to Snowflake, test and debug.
• Perform data testing and bug fixing.
• Coordinate with geographically distributed teams.
• Participate in daily agile ceremonies.
• Conduct release validations and produce metrics.
• Help enforce team guidelines.
• Act as single point of contact for the team.
• Manage DevOps activities as defined.
• Automate testing processes to improve efficiency.

Skills

SQL

Snowflake

Spark

Python

Scala

Hadoop

Azure

ETL/ELT

Data Modeling

DWH

DBT

DevOps

Tools

DBT

Job description

Responsibilities

Will work as an Individual contributor on Big Data Migration Project to Lakehouse migration project.

• Perform tasks related to migrating & testing applications on Snowflake, Snowpark, Apache Spark, Hive , on new retail banking data Lakehouse.
• Good to have knowledge on DBT.
• Perform extensive testing of the migrated code, debugging & fixing issues.
• Manage DevOPS as required & defined on the project
• Automate processes wherever required to improve efficiency of testing team.
• Co-ordinate with diverse geographically located teams to complete assigned activities.
• Participate in daily various agile ceremonies during the ongoing sprint and complete tasks as required.
• Conduct bug-free release validations and produce metrics, tests, and defect reports.
• Assist in developing and enforcing team guidelines.
• Being spoc for the team and provide information/status on ongoing activities on regular basis to management whenever needed.

Required

Profile required

ACE can help you write this job description (go/ACE)

At least 3 to 7 Years of experience on big data platform and at least 2 years of experience in implementing DWH on Snowflake

• Proven experience with cloud platforms preferable Azure particularly on data services
• Good understanding of distributed computing frameworks like Apache Spark, Hadoop etc
• Perform Analysis on existing data storage systems Big Data & development of data solutions in Snowflake
• High Proficiency in SQL and at least one of the following languages Scala / Python &
• Experience in working on migrating data from on-premise databases preferably Big Data platformto Snowflake
• Expertise in building robust ELT/ETL processes , performance tuning of the data pipelines in Snowflake and should be able to trouble shoot the issues quickly
• Strong Knowledge on Integration concepts and design best practices
• Data Modeling & data integration, Advanced SQL skills for analysis, standardizing queries
• Proven experience in managing and mentoring data engineering teams
• Excellent interpersonal skills, with the ability to work across teams and communicate effectively with technical and nontechnical stake holders
• Strong analytical and trouble shooting skills with proven ability to find solutions in complex data environments

Why join us

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status

Business insight

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.

We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.