Data Engineer (Databricks)

Xurpas, Inc.; Taguig; On-site; PHP 700,000 - 1,100,000; Full time

Job summary

Xurpas, Inc. is seeking a Data Engineer to design, develop, and maintain data solutions, building pipelines, ensuring data quality, and implementing ETL processes across systems.

You will work with cross-functional teams to enhance data accessibility and usability, contributing to the data strategy of the organization in the Philippines.

Qualifications

• 4+ years in data engineering.
• Strong Python and SQL skills.
• Experience with ETL and data integration.
• Familiar with cloud platforms for data engineering.

Responsibilities

• Develop and optimize data pipelines for efficient data flow.
• Monitor and troubleshoot data quality issues.
• Collaborate with cross-functional teams on data strategy.
• Lead and support data engineering SME initiatives.
• Provide solutions to team and cross-team data problems.
• Document data processes and workflows.
• Engage in data migration and deployment across systems.
• Ensure data accessibility and usability across platforms.
• Oversee data governance and best practices.

Skills

Databricks

Python

Data modeling

ETL tools

Cloud platforms

Data warehousing

Unity Catalog

Delta Live Tables

Tools

Azure Data Factory

SQL

PySpark

Databricks

Job description

Summary

As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to enhance data accessibility and usability, contributing to the overall data strategy of the organization.

Roles & Responsibilities

Expected to be an SME.

Summary

As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to enhance data accessibility and usability, contributing to the overall data strategy of the organization.

Roles & Responsibilities

• Expected to be an SME.
• Collaborate and manage the team to perform.
• Responsible for team decisions.
• Engage with multiple teams and contribute on key decisions.
• Provide solutions to problems for their immediate team and across multiple teams.
• Develop and optimize data pipelines to ensure efficient data flow and processing.
• Monitor and troubleshoot data quality issues, implementing corrective actions as necessary.
• Document data processes and workflows to ensure clarity and compliance with best practices

Professional & Technical Skills

• Must have 4+ years of experience in data engineering
• Expert proficiency in Databricks Unified Data Analytics Platform
• Experience with Python (Programming Language)
• Strong understanding of data modeling and database design principles.
• Experience with ETL tools and data integration techniques.
• Familiarity with cloud platforms and services related to data engineering.
• Proficient in data warehousing concepts and practices.
• Must have skills: Databricks (Unity Catalog, Delta Live Tables, Auto Loader) -Python, Pyspark -SQL -Azure Data Factory