Data Engineer with Databricks (Mid to Senior Level)

Indra Philippines, Inc.; Pasig; On-site; PHP 700,000 - 1,100,000; Full time

Job summary

Indra Philippines, Inc. is seeking a Data Engineer to design and implement solution architecture, extract data from various sources, and build robust DataMart solutions using Azure data services and Power BI.

You'll develop data pipelines, set up CI/CD, collaborate with IT teams, and ensure timely delivery of project objectives while transitioning from onsite to a hybrid work setup in Metro Manila.

Qualifications

• Bachelor's degree in Computer Science/Information Systems or Information Technology/Accounting.
• 3-5 years of experience as a data engineer preferably for the banking sector and financial services sector.
• Experience in data technologies and systems such as SQL, PowerBI, Python, Azure DevOps, etc.
• Experience with Azure Data Ecosystem with tools such as Azure Data Factory, Azure Data Lake, Databricks, Azure Blob storage, Azure SQL Databases and PowerBI.
• Experience in setting up DataMarts and able to liaise with relevant IT teams to develop effective solutions
• Strong communication skills in both spoken and written English.
• Experience working with ITIL and/or Scrum/Agile frameworks.
• Must be willing work on an initial full onsite then transition to hybrid work set-up.

Responsibilities

• Support the design of an adequate solution architecture.
• Extract data from relevant online sources using various ingestion methods.
• Build a stable and performing DataMart solution conform functional and technical requirements.
• Build data pipelines that feed data into the data marts according to the data model.
• Set-up CI/CD pipelines to deploy solution components.
• Leverage technical components such as Azure Data Factory, Azure Data Lake, Databricks, Azure Blob storage, Azure SQL Databases and PowerBI.
• Participate in project cycle and complete project artefacts where applicable.
• Work with the IADA team to ensure the timely delivery of project objectives.

Skills

Strong communication skills in English

Experience with ITIL and Scrum/Agile

Data engineering fundamentals

Education

Bachelor's degree in Computer Science/Information Systems or Information Technology/Accounting

Tools

Azure Data Factory

Azure Data Lake

Databricks

Azure Blob storage

Azure SQL Databases

PowerBI

Azure DevOps

Job description

About the role

A Data Engineer role supporting the design of adequate solution architecture, extracting data from relevant online sources, and building stable and performing DataMart solutions. The role involves working with Azure technologies and data platforms to ensure compliance with client standards and timely delivery of project objectives.

Key responsibilities

• Support the design of an adequate solution architecture.

• Extract data from relevant online sources using various ingestion methods.

• Build a stable and performing DataMart solution conform functional and technical requirements.

• Build data pipelines that feed data into the data marts according to the data model.

• Set-up CI/CD pipelines to deploy solution components.

• Leverage technical components such as Azure Data Factory, Azure Data Lake, Databricks, Azure Blob storage, Azure SQL Databases and PowerBI.

• Participate in project cycle and complete project artefacts where applicable.

• Work with the IADA team to ensure the timely delivery of project objectives.

About you

• Bachelor's degree in Computer Science/Information Systems or Information Technology/Accounting.

• 3-5 years of experience as a data engineer preferably for the banking sector and financial services sector.

• Experience in data technologies and systems such as SQL, PowerBI, Python, Azure DevOps, etc.

• Experience with Azure Data Ecosystem with tools such as Azure Data Factory, Azure Data Lake, Databricks, Azure Blob storage, Azure SQL Databases and PowerBI.

• Experience in setting up DataMarts and able to liaise with relevant IT teams to develop effective solutions

• Strong communication skills in both spoken and written English.

• Experience working with ITIL and/or Scrum/Agile frameworks.

• Must be willing work on an initial full onsite then transition to hybrid work set-up.