Tech Lead: Spark & Azure Data Pipelines, Power BI

V2 Solutions; Hinoba-an; On-site; PHP 600,000 - 1,000,000; Full time

Job summary

V2 Solutions is seeking a data engineer to design, develop, and maintain robust data pipelines and ETL processes. You will collaborate with stakeholders to translate reporting needs into scalable pipelines and Power BI reports, ensuring data quality and integrity throughout the workflow.

The role focuses on optimizing Spark and data ingestion for performance and reliability, with close collaboration with DevOps to automate deployment of Spark notebooks and pipelines.

Qualifications

• Experience with PySpark, SQL, and Power BI to build scalable data pipelines.

Responsibilities

• Design, develop, deploy, and maintain robust data pipelines and ETL processes.
• Collaborate with stakeholders to understand reporting requirements and translate them into scalable pipelines and Power BI reports.
• Identify and implement best practices for Spark application development, data ingestion, and data transformation.

Skills

Pyspark

SQL

Power BI

Tools

Microsoft Fabric

Job description

V2 Solutions is seeking a data engineer to design, develop, and maintain robust data pipelines and ETL processes. You will collaborate with stakeholders to translate reporting needs into scalable pipelines and Power BI reports, ensuring data quality and integrity throughout the workflow.

The role focuses on optimizing Spark and data ingestion for performance and reliability, with close collaboration with DevOps to automate deployment of Spark notebooks and pipelines.