Data Engineer (Databricks)

Xurpas Incorporated; Philippines; On-site; PHP 900,000 - 1,300,000; Full time

Job summary

Xurpas Incorporated is seeking a Data Engineer to design, develop, and maintain scalable data pipelines and data solutions. You will handle data generation, ingestion, transformation, and processing, ensuring data quality across diverse systems and platforms.

Collaboration with cross-functional teams is essential to improve data accessibility, reliability, and business insights. The role emphasizes building efficient ETL/ELT processes, data governance, and documentation, while supporting

Qualifications

• Proficient with data processing and big data concepts.
• Strong programming skills in Python and PySpark.
• Experience with SQL and data modeling principles.

Responsibilities

• Serve as SME for data engineering solutions and platforms.
• Collaborate with stakeholders to deliver high-quality data pipelines.
• Own technical decisions and contribute to key project initiatives.
• Develop, optimize, and maintain scalable data pipelines and workflows.
• Design and implement ETL/ELT processes for structured and unstructured data.
• Monitor, troubleshoot, and resolve data quality and pipeline performance issues.
• Implement best practices for data governance, security, and compliance.
• Create and maintain technical documentation for data processes and architectures.
• Work with data analysts, data scientists, and business teams to support reporting.

Skills

Python / PySpark

SQL

Data processing concepts

Big data concepts

Tools

Databricks

Azure Data Factory

Job description

We are hiring a Data Engineer!

Summary

As a Data Engineer, you will design, develop, and maintain scalable data solutions that support data generation, ingestion, transformation, and processing. You will be responsible for building efficient data pipelines, ensuring data quality, and implementing ETL/ELT processes across various systems and platforms. The role requires close collaboration with cross-functional teams to improve data accessibility, reliability, and overall business insights.

Roles & Responsibilities

• Serve as a Subject Matter Expert (SME) for data engineering solutions and platforms.
• Collaborate with team members and stakeholders to deliver high-quality data solutions.
• Take ownership of technical decisions and contribute to key project initiatives.
• Develop, optimize, and maintain scalable data pipelines and workflows.
• Design and implement ETL/ELT processes for structured and unstructured data.
• Monitor, troubleshoot, and resolve data quality and pipeline performance issues.
• Implement best practices for data governance, security, and compliance.
• Create and maintain technical documentation for data processes, architectures, and workflows.
• Work closely with data analysts, data scientists, and business teams to support reporting and analytics requirements.

Professional & Technical Skills

Must-Have Skills

• Minimum of 4 years of experience in Databricks and data engineering technologies.
• Experience working with large-scale data processing and distributed systems is preferred.
• Experience in Databricks (Unity Catalog, Delta Live Tables, Auto Loader)
• Experience in Python / PySpark
• Experience in SQL
• Experience in Azure Data Factory

Good-to-Have Skills

• Experience with cloud-based data platforms and services, preferably Azure.
• Strong understanding of data modeling and database design principles.
• Knowledge of data warehousing concepts and best practices.
• Experience with performance tuning and optimization of big data workloads.
• Familiarity with CI/CD processes and DevOps practices in data engineering.