Databricks Engineer (Python, SQL, Delta Lake)

Quess Philippines Corp.; Taguig; Hybrid; PHP 1,500,000 - 2,100,000; Full time

Job summary

Quess Philippines Corp. in Metro Manila leads the search for a senior Data Engineering Lead to oversee the design, development, and deployment of complex automated data pipelines.

You will coordinate with the Data Engineering team to prioritize resources and deliver end-to-end solutions that support critical business initiatives. The role requires deep expertise in data architectures, SQL/NoSQL, Redshift or Snowflake, and experience with vendor engagements.

Qualifications

• 15+ years of application delivery experience in the financial services industry.
• 10+ years of experience managing complex projects involving the implementation of digital or online-transaction solutions.
• Experienced in handling vendor and third-party SI engagements.
• Expertise in database technologies (SQL, NoSQL, etc.) and data warehouse platforms (e.g., Redshift, Snowflake).
• Experience with ETL tools and data pipeline frameworks.
• Candidate must be willing to work in Ortigas or Makati.

Responsibilities

• Defines, prioritizes and allocates resources; tracks and provides status reports of work assignments, projects, and programs performed in support of the Data Engineering team.
• Lead design, development, and implementation of end-to-end complex automated data pipeline system using common Big Data Tools.
• Design and implement robust data architectures and data pipelines for large-scale data processing.
• Review business and technical requirements and ensure the data integration platform meets requirements
• Identifying bottlenecks and optimizing data processing and storage systems for improved performance and efficiency; implement monitoring and measurement of data quality as defined by business rules
• Collaborating with other departments such as data science, analytics, and IT to understand their data needs and requirements, and aligning data engineering efforts to support organizational goals and initiatives.
• Ensuring compliance with data privacy regulations and implementing robust security measures to protect sensitive data from unauthorized access or breaches.

Skills

Financial services domain

Program/project management

Vendor and SI engagements

SQL

NoSQL

Data warehousing (Redshift/Snowflake)

ETL tools

Tools

Redshift

Snowflake

Job description

Roles & Responsibilities

• Defines,prioritizesandallocatesresources; tracks and provides status reports of work assignments, projects, and programs performed in support of the Data Engineering team.
• Lead design, development, and implementation of end-to-end complex automated data pipelinesystemusing common Big Data Tools.
• Design and implement robust data architectures and data pipelines for large-scale data processing.
• Review business and technical requirements and ensure the data integration platform meets requirements
• Identifyingbottlenecks andoptimizingdata processing and storage systems for improved performance and efficiencyimplement monitoring and measurement of data quality as defined by business rules
• Collaborating with other departments such as data science, analytics, and IT to understand their data needs and requirements, and aligning data engineering efforts to support organizational goals and initiatives.
• Ensuring compliance with data privacy regulations and implementing robust security measures to protect sensitive data from unauthorized access or breaches.

Must Have Skills & Experience

• 15 or more years of application delivery experience in the financial services industry
• 10 or more years of experience in managing complex projects involving the implementation of digital or online-transaction solutions
• Experienced in handling vendor and third-party SI engagements
• Expertisein database technologies (SQL, NoSQL, etc.) and data warehouse platforms (e.g., Redshift, Snowflake).
• Experience with ETL tools and data pipeline frameworks.
• Candidate must be willing to work in Ortigas or Makati.