Senior Software Engineer Data Engineer Databricks PySpark

Societe Generale; Bengaluru; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Société Générale à Bengaluru, Inde, recherche un Data Engineer Azure expérimenté pour concevoir et optimiser des pipelines de données end-to-end. Vous travaillerez sur Synapse Analytics, Databricks et ADLS Gen2, en garantissant la qualité, la sécurité et la scalabilité des données.

Profil: maîtrise SQL et Python, expérience avec Databricks, Terraform, Docker/Kubernetes, CI/CD et Linux. Maîtrise l'anglais requise; le rôle offre un cadre européen dynamique et possibilités d'évolution.

Qualifications

• Maîtrise de SQL et Python pour concevoir des pipelines robustes.
• Expérience avec Azure data services et ELT/ETL.
• Connaissance de Databricks, Synapse Analytics et sécurité des données.
• Bonne compréhension des modèles de données et de la gouvernance.

Responsibilities

• Concevoir et déployer des pipelines de données end-to-end sur Azure.
• Effectuer l'intégration, la transformation et le stockage des données (ADLS Gen2).
• Collaborer avec les équipes DevOps et data pour assurer la qualité et la scalabilité.
• Assurer la sécurité et la conformité des données.

Skills

SQL

Python

English fluency

Data modeling

Analytical thinking

Teamwork

Tools

Databricks

Synapse Analytics

ADLS Gen2

Terraform

Docker

Kubernetes

Linux

Git

Job description

• Creating effective and scalable data structures in SQL & Python
• Azure Cloud Fundamentals and ETL/Data Pipelines focusing on integrating, transforming, building and managing end-to-end data pipelines, combining data from several sources and storing data using services like ADLS Gen2
• Synapse Analytics
• Databricks
• Proficiency in administering Azure databases, and securing data, plus strong data modeling and big data tech (Spark)

Vos missions au quotidien

Azure Data Engineer needs core skills in:

• Creating effective and scalable data structures in SQL & Python
• Azure Cloud Fundamentals and ETL/Data Pipelines focusing on integrating, transforming, building and managing end-to-end data pipelines, combining data from several sources and storing data using services like ADLS Gen2
• Synapse Analytics
• Databricks
• Proficiency in administering Azure databases, and securing data, plus strong data modeling and big data tech (Spark)

Core Technical Skills

• A proven track record of delivering complex data products.
• Expertise in ELT flows using Databricks (PySpark), ADLS, ADF, SQL, and Python.
• Experience with DevOps CI/CD and GIT.
• Experience with infra as code approaches such as Terraform.
• Experience with Linux, Docker and Kubernetes.
• A software engineering background as a plus.
• Fluency in English (written and spoken); additional languages are a plus.

Foundational Knowledge

Data Modeling: Designing efficient data structures (star/snowflake schemas).

Data Architecture: Understanding data lakes vs. warehouses.

Security: Data encryption, access control, compliance within Azure.

Important Tools & Concepts

Microsoft Fabric;

DevOps: CI/CD practices.

Soft Skills

Problem-solving, analytical thinking, communication, teamwork.

Preferred Knowledge of

Hadoop, MapReduce, Oracle DB.

Et si c’était vous ?

Azure Data Engineer needs core skills in:

• Creating effective and scalable data structures in SQL & Python
• Azure Cloud Fundamentals and ETL/Data Pipelines focusing on integrating, transforming, building and managing end-to-end data pipelines, combining data from several sources and storing data using services like ADLS Gen2
• Synapse Analytics
• Databricks
• Proficiency in administering Azure databases, and securing data, plus strong data modeling and big data tech (Spark)

Core Technical Skills

• A proven track record of delivering complex data products.
• Expertise in ELT flows using Databricks (PySpark), ADLS, ADF, SQL, and Python.
• Experience with DevOps CI/CD and GIT.
• Experience with infra as code approaches such as Terraform.
• Experience with Linux, Docker and Kubernetes.
• A software engineering background as a plus.
• Fluency in English (written and spoken); additional languages are a plus.

Foundational Knowledge

Data Modeling: Designing efficient data structures (star/snowflake schemas).

Data Architecture: Understanding data lakes vs. warehouses.

Security: Data encryption, access control, compliance within Azure.

Important Tools & Concepts

Microsoft Fabric;

DevOps: CI/CD practices.

Soft Skills

Problem-solving, analytical thinking, communication, teamwork.

Preferred Knowledge of

Hadoop, MapReduce, Oracle DB.

Plus qu’un poste, un tremplin

“We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”.

Pourquoi nous choisir ?

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.

We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.

Diversité et inclusion

Nous sommes un employeur garantissant l'égalité des chances et nous sommes fiers de faire de la diversité une force pour notre entreprise. Le groupe s’engage à reconnaître et à promouvoir tous les talents, quels que soient leurs croyances, âge, handicap, parentalité, origine ethnique, nationalité, identité de genre, orientation sexuelle, appartenance à une organisation politique, religieuse, syndicale ou à une minorité, ou toute autre caractéristique qui pourrait faire l’objet d’une discrimination.