Principal Technical Lead - Databricks

Societe Generale Global Solution Centre; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Societe Generale Global Solution Centre in Bengaluru is seeking a senior Data Engineering professional to build reusable enterprise assets on the Databricks platform. You will define platform standards, integrate Databricks with AWS/Azure, and implement Unity Catalog, data lineage, and governance in a banking context.

The role requires 10–16 years IT experience with 6–8 years in Data Engineering or big data platforms, plus 2–4 years in large-scale data processing.

Qualifications

• Build reusable enterprise assets for Data Engineering CoE.
• Define platform standards and best practices for DBX usage.
• Integrate Databricks with Cloud Services (AWS/Azure) including storage, IAM, and event services.
• Implement Unity Catalog, Data Lineage, Access Governance, and Auditing Standards.
• Define and enforce data quality, observability, and FinOps monitoring.
• Profile : 10–16 years of IT experience with 6-8 yrs exp in Data Engineering / Big Data Platform, and 2-4 yrs in large-scale data processing solutions on the Databricks Platform
• Skills: DBX, PySpark, Spark SQL, Delta Lake, SQL Warehouse, AWS Cloud Platform, CI/CD, Data Governance
• Preferred: DBX Certification, MLFlow
• Functional background: Experience in Banking and Financial Services
• Methodology: Agile
• Behavioural Skills:
• Ability to work in a cross-cultural team with multi geographical locations.
• Ability to communicate (verbal and written) effectively with counterparts in SG Paris

Responsibilities

• Build reusable enterprise assets for Data Engineering CoE.
• Define platform standards and best practices for DBX usage.
• Integrate Databricks with Cloud Services (AWS/Azure) including storage, IAM, and event services.
• Implement Unity Catalog, Data Lineage, Access Governance, and Auditing Standards.
• Define and enforce data quality, observability, and FinOps monitoring.
• Profile : 10–16 years of IT experience with 6-8 yrs exp in Data Engineering / Big Data Platform, and 2-4 yrs in large-scale data processing solutions on the Databricks Platform
• Skills: DBX, PySpark, Spark SQL, Delta Lake, SQL Warehouse, AWS Cloud Platform, CI/CD, Data Governance
• Preferred: DBX Certification, MLFlow
• Functional background: Experience in Banking and Financial Services
• Methodology: Agile
• Behavioural Skills:
• Ability to work in a cross-cultural team with multi geographical locations.
• Ability to communicate (verbal and written) effectively with counterparts in SG Paris

Skills

DBX

PySpark

Spark SQL

Delta Lake

SQL Warehouse

AWS Cloud Platform

CI/CD

Data Governance

DBX Certification

MLFlow

Agile

Tools

Databricks

Job description

Responsibilities

Mission : Building modern data platforms that underpin bank’s ambitions for next phase of growth.

Main Responsibilities

• Build Reusable Enterprise Assets for Data Engineering CoE
• Define platform standards and best practices for DBX usage
• Integrate Databricks with Cloud Services (AWS/Azure) including storage, IAM, and event services.
• Implement Unity Catalog, Data Lineage, Access Governance, and Auditing Standards.
• Define and enforce data quality, observability, and FinOps monitoring.
• Profile : 10–16 years of IT experience with 6-8 yrs exp in Data Engineering / Big Data Platform, and 2-4 yrs in large-scale data processing solutions on the Databricks Platform
• Skills: DBX, PySpark, Spark SQL, Delta Lake, SQL Warehouse, AWS Cloud Platform, CI/CD, Data Governance
• Preferred: DBX Certification, MLFlow
• Functional background: Experience in Banking and Financial Services
• Methodology: Agile
• Behavioural Skills:
• Ability to work in a cross-cultural team with multi geographical locations.
• Ability to communicate (verbal and written) effectively with counterparts in SG Paris

Required

Profile required

• Build Reusable Enterprise Assets for Data Engineering CoE
• Define platform standards and best practices for DBX usage
• Integrate Databricks with Cloud Services (AWS/Azure) including storage, IAM, and event services.
• Implement Unity Catalog, Data Lineage, Access Governance, and Auditing Standards.
• Define and enforce data quality, observability, and FinOps monitoring.
• Profile : 10–16 years of IT experience with 6-8 yrs exp in Data Engineering / Big Data Platform, and 2-4 yrs in large-scale data processing solutions on the Databricks Platform
• Skills: DBX, PySpark, Spark SQL, Delta Lake, SQL Warehouse, AWS Cloud Platform, CI/CD, Data Governance
• Preferred: DBX Certification, MLFlow
• Functional background: Experience in Banking and Financial Services
• Methodology: Agile
• Behavioural Skills:
• Ability to work in a cross-cultural team with multi geographical locations.
• Ability to communicate (verbal and written) effectively with counterparts in SG Paris

Why join us

“We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”.

Business insight

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.

Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA.

If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

Benefits

• Employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices and sharing their skills with charities. There are many ways to get involved.
• We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.