Databricks Engineer - Hybrid BGC - Up to 185K

weSource Management Consultancy Firm; Taguig; On-site; PHP 166,500 - 203,500; Full time

Job summary

A leading consultancy firm in Taguig is seeking a Databricks Engineer to design and develop data processing workflows using Azure Databricks. The role requires 8+ years of IT experience and strong proficiency in Python, PySpark, and Apache Spark. You will be responsible for ETL processes, collaborating with data teams, and creating necessary documentation. This hybrid position offers an attractive salary of up to 185K PHP.

Qualifications

• 8+ years of experience in the IT industry.
• 3+ years of hands-on experience in data engineering/ETL using Databricks Notebook programming on Azure.
• Solid Databricks development experience with significant Python, PySpark, Spark SQL, Pandas, NumPy.

Responsibilities

• Responsible for designing and developing data processing workflows using Azure Databricks.
• Create technical, functional, and operational documentation for data applications.
• Develop and maintain ETL pipelines with Databricks.

Skills

Databricks

Python

PySpark

Spark SQL

ETL

Collaboration with data engineers

Education

B.S. in Computer Science/Engineering or relevant field

Tools

Azure

Apache Spark

Job description

Databricks Engineer - Hybrid BGC - Up to 185K

Overview

We have an urgent opening for

Location: Taguig/Hybrid

Salary: Up to 185K

Years Required: 5

The Role

• The Azure Databricks Developer, will be responsible for designing, developing, and maintaining data processing workflows and analytics solutions using Azure Databricks.
• Use business requirements to drive the design of data solutions/applications and technical architecture. Create technical, functional, and operational documentation for data pipelines and applications.
• Develop and maintain ETL (Extract, Transform, Load) pipelines using Databricks to process and transform large datasets.
• Collaborate with data engineers and data scientists to design and implement scalable and efficient data processing workflows.
• Build and optimize Apache Spark jobs and clusters on the Databricks platform.
• Develop and maintain data ingestion processes to acquire data from various sources and systems.

The Requirements

• B.S. in Computer Science/Engineering or relevant field
• 8+ years of experience in the IT industry
• 3+ years of hands-on experience in data engineering/ETL using Databricks Notebook programming on Azure or any cloud infrastructure and functions
• Solid Databricks development experience with significant Python, PySpark, Spark SQL, Pandas, NumPy in Azure environment.
• Hands on experience of building data pipelines using Databricks and Apache Spark.

Experience:

• Databricks: 3 years (Required)
• Azure: 3 years (Required)
• Cloud development: 5 years (Required)
• Python: 3 years (Required)

If you are interested, please email your detailed and updated CV at [e-mail] and include the below details