Monroe Consulting Group Philippines, an executive search firm, is recruiting on behalf of the #1 global market leader in digital shopper marketing. Our client is looking for a highly skilled and hands-on Senior Data Engineer to join its growing technology team.
This role follows a hybrid work arrangement (3 days onsite, 2 days work-from-home), is based in Makati City, and operates on a night shift schedule.
Position Overview
We are seeking a highly technical Senior Data Engineer to own and scale our SQL data ecosystem, architect modern data pipelines, and lead data enrichment initiatives across an Azure-first platform.
This role requires deep expertise in Python, SQL, Azure Data Services, and Data Architecture, with responsibility for establishing best practices in data modeling, quality, governance, security, observability, and cost optimization. You will work closely with Data Science, Analytics, Product, and Engineering teams to build scalable and reliable data solutions that power business intelligence, machine learning, search capabilities, and customer-facing applications.
Key Responsibilities
SQL Database Architecture & Engineering
- Design, build, and optimizescalable OLTP and OLAP data architectures across:
- Azure SQL Database
- Azure Synapse Analytics
- Delta Lake
- Develop and evolve database schemas with appropriate:
- Partitioning strategies
- Indexing frameworks
- Row-Level Security (RLS) for multi-tenant environments
- Establish data contracts, schema versioning standards, and governance processes.
- Implement and maintain:
- Change Data Capture (CDC)
- Slowly Changing Dimensions (SCD)
- Drive database performance optimization through:
- Query tuning
- Execution plan analysis
- Resource management
- Caching strategies
- Cost optimization guardrails
Data Pipeline Development
- Architect, develop, and maintain scalable ELT/ETL solutions for both batch and real-time processing.
- Build data pipelines utilizing:
- Azure Data Factory
- Azure Synapse Analytics
- Azure Databricks
- Azure Functions
- Azure Event Hubs
- Azure Service Bus
- Azure Container Apps
- Azure Kubernetes Service (AKS)
- Develop highly reliable pipelines that are:
- Idempotent
- Retryable
- Observable
- Lineage-aware
- SLA/SLO compliant
- Create operational runbooks and monitoring frameworks for production environments.
- Implement CI/CD processes for data assets, including:
- SQL Projects
- dbt Models
- PySpark Jobs
- Automated Testing Frameworks
- Infrastructure as Code (Terraform/Bicep)
- GitHub Actions
Data Enrichment & Semantic Layer Management
- Design and manage enterprise data enrichment frameworks.
- Build enrichment layers leveraging:
- UPC/GS1 Standards
- OCR Data Extraction
- EXIF Metadata
- Product Taxonomies
- Embeddings
- Third-Party Data Sources
- Develop and maintain:
- Gold Data Layers
- Semantic Models
- Analytics Data Products
- Product APIs
- Define and govern metrics, business definitions, and feature catalogs.
- Partner with Data Science and Machine Learning teams to operationalize:
- Feature Stores
- Model Outputs
- Drift Monitoring
- Evaluation Datasets
Azure Data Platform Architecture & Governance
- Own and maintain reference architecture across:
- Azure Data Lake Storage Gen2 (ADLS Gen2)
- Azure Synapse Analytics
- Azure Databricks
- Azure SQL / SQL Server
- Cosmos DB (including Vector Search)
- Azure AI Search
- Azure Key Vault
- Microsoft Purview
- Establish security and compliance controls including:
- Encryption Standards
- Secrets Management
- RBAC and ABAC Access Controls
- Data Retention Policies
- GDPR Compliance
- SOC 2 Controls
- Implement observability practices using:
- OpenTelemetry
- Azure Monitor
- Application Insights
- Data Quality Frameworks
- Data Freshness Monitoring
- Data Lineage through Purview
What You will Build
Image Ingestion & Enrichment Platform
- Develop scalable pipelines that:
- Validate digital assets
- Extract OCR and UPC information
- Generate embeddings
- Capture lineage metadata
- Publish search-ready datasets and APIs
Hybrid Search & Recommendation Platform
- Build vector-enabled retrieval systems using:
- Cosmos DB
- Azure AI Search
- Enable:
- Similarity Search
- Recommendation Engines
- Hybrid Retrieval (Vector + Metadata Filtering)
Minimum Qualifications
Experience
- 7+ years of experience in Data Engineering, Data Architecture, or related disciplines.
- Proven ownership of production-grade SQL databases and enterprise data pipelines.
- Demonstrated experience delivering scalable cloud-based data platforms.
Technical Expertise
Programming
- Expert-level Python development.
- Expert-level SQL development.
- Strong proficiency in:
Azure Ecosystem
Deep hands-on experience with:
- Azure Data Lake Storage Gen2 (ADLS Gen2)
- Azure Data Factory
- Azure Synapse Analytics
- Azure Databricks
- Azure SQL Database
- SQL Server
- Azure Functions
- Event Hubs
- Service Bus
- Azure Key Vault
Data Architecture
Proven expertise in:
- Star Schema Modeling
- Snowflake Schema Modeling
- Data Vault Architecture
- Lakehouse Architecture
- CDC and SCD Methodologies
- Semantic Modeling
- dbt or Equivalent Transformation Frameworks
Governance & Security
- Experience implementing enterprise-scale:
- Data Quality Frameworks
- Data Lineage Solutions
- Cost Optimization Controls
- Governance Programs
- Strong understanding of:
- Multi-Tenant SaaS Architectures
- GDPR Principles
- Data Privacy and Security Controls
Nice to Have
Advanced Data & AI Technologies
- Cosmos DB (including Vector Search)
- Azure AI Search
- Embedding Pipelines for Images and Text
- Retrieval-Augmented Generation (RAG) Concepts
- Feature Stores
- MLflow
- Model Registries
- Real-Time Inference Architectures
Database Expertise
- SQL Server Internals
- PolyBase
- Serverless SQL Pools
- PostgreSQL
Governance & Data Management
- Microsoft Purview Implementations
- Enterprise Data Governance Programs
- Data Product Operating Models
- Metadata and Catalog Management Frameworks
Our Technology Stack
Data Platform
- Azure Data Lake Storage Gen2 (ADLS Gen2)
- Azure Data Factory
- Azure Synapse Analytics
- Azure Databricks
- Azure Functions
- Azure Event Hubs
- Azure Key Vault
- Azure Monitor
Data Storage & Retrieval
- Delta Lake
- Parquet
- Azure SQL Database
- SQL Server
- Cosmos DB (Vector Search)
- Azure AI Search
Development & Data Engineering
- Python
- dbt (or equivalent)
- GitHub Actions
- Terraform
- Bicep
Observability
- OpenTelemetry
- Azure Monitor
- Application Insights
- Sentry
- Datadog
Core Competencies
Technical Competencies
- Data Engineering & Architecture
- Advanced SQL Optimization
- Azure Data Services
- Data Modeling & Warehousing
- Cloud-Native Data Platforms
- Data Quality & Governance
- DevOps & Infrastructure Automation
- Machine Learning Data Enablement
- Observability & Monitoring
Leadership Competencies
- Technical Ownership
- Solution Design
- Strategic Problem Solving
- Stakeholder Management
- Cross-Functional Collaboration
- Continuous Improvement
- Innovation Mindset
- Mentorship & Knowledge Sharing
Diversity, Equity & Inclusion
We are committed to fostering a diverse and inclusive workplace. We are an equal opportunity employer and welcome applicants regardless of race, color, religion, age, sex, national origin, disability, sexual orientation, gender identity or expression, genetic information, veteran status, citizenship status, or any other legally protected characteristic.
Ideal Candidate
The ideal candidate is a highly accomplished Senior Data Engineer with deep expertise in Python, SQL, and Azure cloud technologies, who thrives on building scalable data platforms, enforcing data governance standards, and delivering reliable data products that drive analytics, machine learning, and business growth.