Real-Time Data Engineer: Cloud & On-Prem Pipelines

Hunter's Hub Inc.; Taguig; On-site; PHP 669,600 - 1,004,400; Full time

Job summary

A technology solutions firm in Metro Manila seeks an experienced data engineer to implement data ingestion processes and design solutions on Cloud platforms. The ideal candidate has extensive knowledge of data integration technologies and streaming frameworks like Kafka, along with a strong background in data analytics. This role involves working with both structured and unstructured data, requiring a bachelor's degree in a relevant field and at least 3 years of industry experience.

Qualifications

• 3+ years of experience integrating data into analytical platforms.
• Proficient in streaming frameworks like Kafka.
• Familiarity with data profiling and SQL optimization.

Responsibilities

• Implement requests for ingestion and preparation of data sources.
• Design solutions on On-premises and Cloud platforms.
• Profile source data and validate it for use.

Skills

Data ingestion technologies

Python

Cloud platforms

SQL optimization

Streaming frameworks (Kafka/Spark Streaming)

ETL development

Education

Bachelor’s degree in relevant field

Tools

Hadoop

Jenkins

Bitbucket

Cloud storage solutions

Job description

A technology solutions firm in Metro Manila seeks an experienced data engineer to implement data ingestion processes and design solutions on Cloud platforms. The ideal candidate has extensive knowledge of data integration technologies and streaming frameworks like Kafka, along with a strong background in data analytics. This role involves working with both structured and unstructured data, requiring a bachelor's degree in a relevant field and at least 3 years of industry experience.