Remote Data Lake Engineer | Azure, PySpark & Pipelines

Comrise; Taguig; Remote; PHP 480,000 - 800,000; Full time

Job summary

Comrise is seeking a CRB Data Lake Support Associate to join the Data, Acquisition, Validation, and Enrichment team. You will help ingest, enrich, and distribute data across pipelines, collaborating with global teams and ensuring data flows remain uninterrupted.

You will work with Python, PySpark notebooks, and Azure Cloud tools to design, implement, and monitor data solutions, while developing your technical expertise within CRB’s data ecosystem.

Qualifications

• Proficiency in Python and PySpark notebooks.
• Experience designing and evolving data solutions in Azure Cloud.
• Experience with large data sets and data integration for analytics.
• Experience with Azure SQL DB or Synapse Analytics (or AWS equivalents).
• Experience presenting data using Power BI for quality reviews.
• Knowledge of Data Modeling and data retrieval for consumption.
• DevOps experience with Git and deployment to production.

Responsibilities

• Support data lake pipelines and monitoring of data flows.
• Configure deployments and monitoring for pipelines across regions.
• Troubleshoot pipeline failures and propose improvements.
• Review Synapse notebooks and communicate issues to development teams.
• Provide onboarding and configuration support for new data sources.
• Assist DevOps deployments to core data lake repositories.
• Apply security access governance in line with company practices.
• Produce and update Access reports quarterly.

Skills

Python

PySpark notebooks

Azure Cloud tools

Azure SQL DB

Azure Synapse Analytics

Power BI

Data Modeling

DevOps (Git)

Collaboration

Problem solving

Tools

Azure Cloud

Power BI

Git

Job description

Comrise is seeking a CRB Data Lake Support Associate to join the Data, Acquisition, Validation, and Enrichment team. You will help ingest, enrich, and distribute data across pipelines, collaborating with global teams and ensuring data flows remain uninterrupted.

You will work with Python, PySpark notebooks, and Azure Cloud tools to design, implement, and monitor data solutions, while developing your technical expertise within CRB’s data ecosystem.