Data Engineer – Azure & Databricks, PySpark

SID Global Solutions; Makati; On-site; PHP 900,000 - 1,400,000; Full time

Job summary

SID Global Solutions is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines using Azure, Databricks, SQL, Python, and PySpark.

The ideal candidate has delivered at least one end-to-end data project and understands data ingestion, transformation, cleansing, warehousing, and data platform operations, with a focus on performance optimization, governance, and SDLC.

Qualifications

• Experience delivering at least one end-to-end data engineering project.
• Strong hands-on experience with Databricks and Microsoft Azure.
• Strong programming experience in Python and PySpark.
• Strong proficiency in SQL, including query development and optimization.
• Good understanding of Data Warehouse and Data Mart concepts.
• Knowledge of SQL and data processing performance optimization techniques.
• Experience developing and maintaining data ingestion and transformation pipelines.
• Experience with data cleansing, preparation, testing, and troubleshooting.
• Understanding of data governance, security, and SDLC processes.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.
• Azure and/or Databricks certifications are preferred.

Skills

End-to-end data projects

Python

PySpark

SQL

Data ingestion

Data transformation

Data governance

SDLC processes

Problem solving

Communication

Tools

Azure

Databricks

Job description

SID Global Solutions is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines using Azure, Databricks, SQL, Python, and PySpark.

The ideal candidate has delivered at least one end-to-end data project and understands data ingestion, transformation, cleansing, warehousing, and data platform operations, with a focus on performance optimization, governance, and SDLC.