Specialist Software Engineer - Azure /PySpark

SGS Société Générale de Surveillance SA; Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

SGS Société Générale de Surveillance SA is seeking a senior data engineer with extensive Microsoft Azure experience to design, develop and optimize PySpark-based data pipelines. You will work with Databricks, Data Factory, Delta Lake and dbt, building scalable ETL/data warehousing solutions while ensuring data quality and timeliness.

You will collaborate with global teams, apply design patterns and best practices, and contribute to the evolution of our data platform.

Qualifications

• 6+ years of experience in Microsoft Azure environment.
• Strong ETL and data warehousing knowledge.
• Experience with PySpark and design patterns/principles.
• Hands-on with Databricks, DataFactory, ADLS.
• Knowledge of MS SQL and Power BI is a plus.

Responsibilities

• Work with Microsoft Azure stack including Databricks, Data Factory, Delta Lake and dbt.
• Develop code on PySpark and apply design patterns and functional programming concepts.
• Implement ETL processes and data warehousing solutions.
• Ensure data quality, testing, and validation; troubleshoot issues.
• Collaborate with cross-cultural teams and stakeholders; communicate effectively.

Skills

Analytical

Proactive

Team player

Solution-oriented mindset

Curious

Tools

Microsoft Azure

Databricks

Data Factory

Delta Lake

dbt

Power BI

MS SQL

Azure DevOps

Job description

Responsibilities

• Microsoft Azure with good knowledge on Data Bricks, Data factory ,Delta Lake ,slowflake, dbt and google analytics
• 6+ years of experience on Microsoft Azure environment.
• Design, Develop code on Pyspark, Design Patterns, Design Principles and Functional Patterns .
• Good understanding of ETL Processes and data warehousing concepts
• Good hands-on Pyspark, Databricks, DataFactory and ADLS.
• Good hands on Azure Devops, understanding of build and release pipeline will be added advantage.
• Good hands-on MS SQL, experience of Power BI will be added advantage.
• Knowledge on Developing scalable and reusable frameworks for ingesting and enhancing datasets.
• Good analytical and troubleshooting skills to resolve the issues in timebound manner.
• Ensure data quality and accuracy through testing and validation.
• Effective team player with ability to work autonomously and in team with cross-cultural environment
• Effective verbal and written communication to work closely with all the stakeholders

Profile requiredCOMPETENCIES/SKILLS:

• Analytical
• Proactive
• Team player
• Solution-oriented mindset
• Curious

WORK EXPERIENCE REQUIREMNTS:

• 6+ years

Why join us

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status

Business insight

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us! Still hesitating? You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved. We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.