Cloud Data Engineer

Lewis Personnel Management; Makati; On-site; PHP 1,339,000 - 2,567,000; Full time

Job summary

Lewis Personnel Management is seeking a Senior Data Engineer to design, build, and maintain scalable data platforms and pipelines using Microsoft Azure technologies. The role focuses on automated data transformation solutions, collaborating with architects, analysts, data scientists, and business stakeholders.

The ideal candidate has 7+ years of experience in data engineering, with strong ETL/ELT design background and agile software development experience.

Qualifications

• Bachelor's degree or equivalent professional experience.
• 7+ years of experience as a Data Engineer or in a similar data platform engineering role.
• Experience designing and supporting enterprise-scale ETL/ELT solutions.
• Experience working in Agile software development environments.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Microsoft Azure services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Microsoft Fabric.
• Build and manage data solutions utilizing Azure Data Lake Storage Gen2 and Azure Blob Storage.
• Collaborate with Data Architects, Data Scientists, Analysts, and business stakeholders to translate business requirements into technical solutions.
• Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
• Implement data quality validation, monitoring, and governance best practices.
• Monitor, troubleshoot, and resolve production data pipeline issues.
• Develop technical documentation, architecture diagrams, and operational procedures.
• Implement and maintain CI/CD pipelines for automated deployment and testing of data solutions.
• Evaluate emerging technologies and recommend improvements to the organization's data platform.

Skills

Azure Data Factory

Azure Synapse Analytics

Azure Databricks

Microsoft Fabric

SQL

CI/CD

Automated testing

Relational databases

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field

Job description

Location: Makati City, Philippines (Hybrid - 2-3 days onsite per week)

Job Summary

We are seeking a Senior Data Engineer to design, build, and maintain scalable, resilient, and cost-effective data platforms and pipelines that support enterprise analytics and business intelligence initiatives. You will leverage Microsoft Azure technologies and software engineering best practices to develop automated data transformation solutions while collaborating with architects, analysts, data scientists, and business stakeholders.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Microsoft Azure services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Microsoft Fabric.

• Build and manage data solutions utilizing Azure Data Lake Storage Gen2 and Azure Blob Storage.

• Collaborate with Data Architects, Data Scientists, Analysts, and business stakeholders to translate business requirements into technical solutions.

• Optimize data pipelines for performance, scalability, reliability, and cost efficiency.

• Implement data quality validation, monitoring, and governance best practices.

• Monitor, troubleshoot, and resolve production data pipeline issues.

• Develop technical documentation, architecture diagrams, and operational procedures.

• Implement and maintain CI/CD pipelines for automated deployment and testing of data solutions.

• Evaluate emerging technologies and recommend improvements to the organization's data platform.

Required Experience

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field (or equivalent professional experience).

• 7+ years of experience as a Data Engineer or in a similar data platform engineering role.

• Experience designing and supporting enterprise-scale ETL/ELT solutions.

• Experience working in Agile software development environments.

Nice-to-Have Experience

• Experience leading technical initiatives or mentoring engineers.

• Experience working directly with business stakeholders or consulting teams.

• Experience developing cloud-native Spark applications.

• Experience supporting enterprise data governance initiatives.

Required Skills

• Microsoft Azure Data Engineering (Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Microsoft Fabric)

• SQL and relational database development (SQL Server, PostgreSQL)

• Data pipeline engineering using software engineering best practices (CI/CD, version control, automated testing)