Senior Databricks Engineer - Hybrid Azure Data Pipelines

weSource Management Consultancy Firm; Taguig; Hybrid; PHP 166,500 - 203,500; Full time

Job summary

A leading consultancy firm in Taguig is seeking a Databricks Engineer to design and develop data processing workflows using Azure Databricks. The role requires 8+ years of IT experience and strong proficiency in Python, PySpark, and Apache Spark. You will be responsible for ETL processes, collaborating with data teams, and creating necessary documentation. This hybrid position offers an attractive salary of up to 185K PHP.

Qualifications

• 8+ years of experience in the IT industry.
• 3+ years of hands-on experience in data engineering/ETL using Databricks Notebook programming on Azure.
• Solid Databricks development experience with significant Python, PySpark, Spark SQL, Pandas, NumPy.

Responsibilities

• Responsible for designing and developing data processing workflows using Azure Databricks.
• Create technical, functional, and operational documentation for data applications.
• Develop and maintain ETL pipelines with Databricks.

Skills

Databricks

Python

PySpark

Spark SQL

ETL

Collaboration with data engineers

Education

B.S. in Computer Science/Engineering or relevant field

Tools

Azure

Apache Spark

Job description

A leading consultancy firm in Taguig is seeking a Databricks Engineer to design and develop data processing workflows using Azure Databricks. The role requires 8+ years of IT experience and strong proficiency in Python, PySpark, and Apache Spark. You will be responsible for ETL processes, collaborating with data teams, and creating necessary documentation. This hybrid position offers an attractive salary of up to 185K PHP.