Data Engineer (Azure Databricks & Spark)

PT Arbeit Infotech Indonesia; Taguig; On-site; PHP 1,000,000 - 1,600,000; Full time

Benefits offered by this job

Company Social Events

Bereavement Leave

Sick Leave

Wedding Leave

Work from Home

Job summary

Arbeit Group in Taguig, Philippines, is seeking an experienced Data Engineer to join a leading multinational company. You will build and maintain large-scale data pipelines using Azure Databricks and Spark, and design robust ETL workflows.

The role requires TB-scale data processing, strong Python/PySpark and SQL skills, and deep knowledge of Data Lakes, data quality, and governance. Collaboration with business users and cross-functional teams is essential.

Qualifications

• Minimum 5+ years of hands-on experience with Azure Databricks and Apache Spark.
• Strong Python, PySpark and SQL skills.
• Experience with TB-scale data processing and Data Lake architectures.
• Familiarity with Azure Data Analytics services and data governance.

Responsibilities

• Build, develop, and maintain large-scale data pipelines using Azure Databricks and Spark.
• Design and optimize ETL processes and data ingestion workflows.
• Develop high-performance Python/PySpark and SQL solutions for TB-scale datasets.
• Design and maintain modern Data Lake architectures.
• Ensure data quality, validation, integrity, and governance across data platforms.
• Utilize Azure data services for analytics, storage, and processing.
• Prepare technical documentation, requirements documents, and testing artifacts.
• Collaborate with business users, stakeholders, and technical teams to deliver data solutions.
• Support production environments and performance optimization initiatives.
• Manage source control and code versioning using Git.

Skills

Azure Databricks

Apache Spark

Python

PySpark

SQL

Data quality

ETL

Data governance

Stakeholder mgmt

Git

Education

Bachelor's degree

Tools

Git

Job description

On-site - Taguig 5-10 Yrs Exp Bachelor Full-time

Job Description

Insurance Health & Wellness

Dental Insurance, Health Insurance, Life Insurance, Occupational Accident Insurance, Retiree Health & Medical

Others

Company Social Events

Bereavement Leave, Sick Leave, Wedding Leave

Work-Life Balance

Work from Home

Work Setup: Onsite - Taguig, Philippines

Industry: Multinational Company (MNC)

Employment Type: Permanent

Only for local candidates in the Philippines

Arbeit Group is currently looking for an experienced Data Engineer to join a leading multinational company in Taguig, Philippines.

We're looking for candidates with proven production-level experience in Azure Databricks and Spark. Strong expertise in PySpark, SQL, Data Lakes, ETL, and data quality is essential for this role.

Key Responsibilities

• Build, develop, and maintain large-scale data pipelines using Azure Databricks and Spark
• Design and optimize ETL processes and data ingestion workflows
• Develop high-performance Python/PySpark and SQL solutions for TB-scale datasets
• Design and maintain modern Data Lake architectures
• Ensure data quality, validation, integrity, and governance across data platforms
• Utilize Azure data services for analytics, storage, and processing
• Prepare technical documentation, requirements documents, and testing artifacts
• Collaborate with business users, stakeholders, and technical teams to deliver data solutions
• Support production environments and performance optimization initiatives
• Manage source control and code versioning using Git

Requirements

• Minimum 5+ years of hands-on experience with Azure Databricks and Apache Spark
• Strong expertise in Python, PySpark, and SQL
• Proven experience handling and optimizing TB-scale data processing workloads
• Strong knowledge of Data Lake architecture and ETL frameworks
• Experience with Azure Data Analytics services
• Strong understanding of data quality, validation, and governance practices
• Experience creating technical documentation and solution designs
• Excellent communication and stakeholder management skills
• Experience with Git version control
• Ability to work effectively with cross-functional teams

Preferred Qualifications

• Strong requirements gathering and testing documentation experience
• Exposure to complex analytics and business intelligence environments