Lead Data Engineer — Big Data & Spark Platforms

V2 Solutions; Hinoba-an; On-site; PHP 2,009,000 - 3,125,000; Full time

Job summary

V2 Solutions is seeking a Lead Software Engineer Data to design, build, and optimize large-scale data solutions while guiding a team through the full lifecycle of Big Data implementation.

The role requires deep expertise in distributed computing and modern data processing frameworks, along with strong leadership to drive projects in an Agile environment across the Philippines and with global cloud services.

Qualifications

• 8-14 years of experience in Big Data and related technologies.
• Expertise in distributed computing and Apache Spark.
• Proficiency with Hadoop v2, MapReduce, HDFS, and Sqoop.
• Experience with Kafka or RabbitMQ and Hive/Impala.
• Strong AGILE methodology and leadership skills.

Responsibilities

• Lead design and implementation of Big Data solutions across the organization.
• Develop and optimize distributed data processing pipelines using Apache Spark.
• Write efficient, scalable code in Python to support data engineering initiatives.
• Build stream-processing systems leveraging technologies such as Apache Storm or Spark-Streaming.
• Integrate data from multiple sources, including RDBMS, ERP systems, and file-based inputs.
• Apply ETL techniques and frameworks to ensure reliable data transformation and delivery.
• Tune and optimize Spark job performance to meet business and technical requirements.
• Guide the team in adopting native cloud data services on Azure or AWS with Databricks.
• Manage and mentor a team of engineers to deliver high-quality data solutions efficiently.
• Drive Agile practices throughout the software development lifecycle.

Skills

Big Data

Distributed computing

Apache Spark

Python

Data pipelines

Azure AWS Databricks

Agile

Mentoring

Team leadership

SQL

NoSQL databases

Kafka

Hadoop

Tools

Apache Storm

Spark-Streaming

Databricks

Azure

AWS

HBase

Cassandra

MongoDB

Job description

V2 Solutions is seeking a Lead Software Engineer Data to design, build, and optimize large-scale data solutions while guiding a team through the full lifecycle of Big Data implementation.

The role requires deep expertise in distributed computing and modern data processing frameworks, along with strong leadership to drive projects in an Agile environment across the Philippines and with global cloud services.