Technology Lead

V2 Solutions; Hinoba-an; On-site; PHP 600,000 - 1,000,000; Full time

Job summary

V2 Solutions is seeking a data engineer to design, develop, and maintain robust data pipelines and ETL processes. You will collaborate with stakeholders to translate reporting needs into scalable pipelines and Power BI reports, ensuring data quality and integrity throughout the workflow.

The role focuses on optimizing Spark and data ingestion for performance and reliability, with close collaboration with DevOps to automate deployment of Spark notebooks and pipelines.

Qualifications

• Experience with PySpark, SQL, and Power BI to build scalable data pipelines.

Responsibilities

• Design, develop, deploy, and maintain robust data pipelines and ETL processes.
• Collaborate with stakeholders to understand reporting requirements and translate them into scalable pipelines and Power BI reports.
• Identify and implement best practices for Spark application development, data ingestion, and data transformation.

Skills

Pyspark

SQL

Power BI

Tools

Microsoft Fabric

Job description

• Design, develop, deploy, and maintain robust data pipelines and ETL (Extract, Transform, Load) processes to transform data into actionable insights
• Collaborate with stakeholders to understand reporting requirements and translate them into scalable pipelines, queries, and Power BI reports
• Identify and implement best practices for Spark application development, data ingestion, and data transformation
• Implement data quality checks and ensure data accuracy, consistency, and integrity
• Optimize Spark MS Fabric jobs for performance, scalability, and reliability
• Collaborate with DevOps teams to automate deployment and management of Spark notebooks and pipelines

Mandatory Skills(ONLY 2 or 3)

• Microsoft Fabric / Azure Data stack
• Pyspark
• SQL
• Power BI