Data Engineer Apache Iceberg And Databricks

NCS Group; Taguig; On-site; PHP 700,000 - 1,100,000; Full time

Job summary

NCS Group is seeking a data engineer to design, build, and optimize scalable data pipelines and platforms in a cloud-centric environment. You will leverage Databricks, Apache Iceberg, Spark/PySpark, and Delta Lake to deliver reliable data flows for analytics and business use.

The role requires 3+ years in data engineering, strong SQL/Python skills, and experience with data lake/lakehouse architectures. Collaboration with cross-functional teams and governance practices are essential for success.

Qualifications

• 3+ years of experience in Data Engineering or a related role.
• Hands-on experience with Databricks and Apache Iceberg.
• Strong SQL and Python skills.
• Experience with Spark/PySpark and distributed data processing.
• Strong understanding of Data Lake/Lakehouse architecture.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Knowledge of ETL/ELT, data modeling, and data pipeline development.
• Experience with Delta Lake, Kafka, or other data technologies is an advantage.

Responsibilities

• Design, build, and maintain scalable data pipelines and data platforms.
• Develop and optimize data processing workflows using Databricks and Apache Iceberg.
• Build and manage batch and streaming data pipelines.
• Work with data lake/lakehouse architectures and ensure data quality, reliability, and performance.
• Integrate data from multiple sources and transform it for analytics and business use.
• Implement data governance, security, monitoring, and optimization practices.
• Collaborate with Data Architects, Analysts, and other engineering teams to deliver data solutions.

Skills

Databricks

Apache Iceberg

SQL

Python

Spark

Data Lake

Lakehouse

Cloud Platforms

ETL/ELT

Data Modeling

Data Pipelines

Kafka

Tools

Delta Lake

Kafka

Job description

Job Description:

Requirements

• 3+ years of experience in Data Engineering or a related role.
• Hands-on experience with Databricks and Apache Iceberg.
• Strong SQL and Python skills.
• Experience with Spark/PySpark and distributed data processing.
• Strong understanding of Data Lake/Lakehouse architecture.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Knowledge of ETL/ELT, data modeling, and data pipeline development.
• Experience with Delta Lake, Kafka, or other data technologies is an advantage.

Responsibilities

Minimum Qualifications:

• Design, build, and maintain scalable data pipelines and data platforms.
• Develop and optimize data processing workflows using Databricks and Apache Iceberg.
• Build and manage batch and streaming data pipelines.
• Work with data lake/lakehouse architectures and ensure data quality, reliability, and performance.
• Integrate data from multiple sources and transform it for analytics and business use.
• Implement data governance, security, monitoring, and optimization practices.
• Collaborate with Data Architects, Analysts, and other engineering teams to deliver data solutions.