Data Engineer

ECLARO; Taguig; On-site; PHP 600,000 - 1,200,000; Full time

Job summary

ECLARO is seeking a data engineer to design and implement data solutions across cloud, DevOps and data engineering domains. You will own data ingestion, governance, and collaboration with IT and business units to onboard new sources.

The role emphasizes documentation, testing, and scalable ETL design, with strong communication and teamwork required to succeed.

Qualifications

• Familiar with Python and SQL development and scripting.
• Experience with Azure services including Blob Storage, Snowflake and Databricks is a plus.
• Excellent communication and teamwork skills, organized and able to work independently.

Responsibilities

• Design and implement innovative data solutions across Cloud, DevOps and Data Engineering.
• Own data management and governance for in-house data sources from vendors.
• Collaborate with business units and IT to onboard new data sources and improve ingestion.
• Refine data ingestion processes with robust governance and controls.
• Help design scalable data storage and ETL architectures.
• Coordinate with AIM's GSO partner to improve ad hoc data ingestion tasks.
• Document data pipelines and processes for clarity and continuity.
• Develop and run tests to ensure data pipeline reliability and accuracy.

Skills

Python

SQL

Education

BS in Engineering

BS in Computer Science

Tools

Azure Services

Azure Blob Storage

Snowflake

Databricks

Job description

• Innovative Solutions: Design and implement cutting-edge solutions across Cloud, DevOps, and Data Engineering to streamline our processes.
• Data Stewardship: Take ownership of all data managed in-house, sourced from top-tier vendors like BlackRock, Clearwater, Bloomberg, ICE, BONY, and external managers.
• Collaborative Onboarding: Partner with business units and IT together to onboard new data sources and enhance our ingestion processes.
• Process Enhancement: Continuously develop and refine data ingestion processes, emphasizing robust data governance and control mechanisms.
• Architectural Design: Play a pivotal role in designing our data storage systems and ETL processes to ensure efficiency and scalability.
• Strategic Collaboration: Work closely with AIM's GSO partner to oversee and improve manual or ad hoc data ingestion tasks.
• Comprehensive Documentation: Maintain detailed documentation of all data engineering processes and solutions to ensure clarity and continuity.
• Quality Assurance: Develop and execute rigorous test plans to guarantee the reliability and accuracy of our data pipelines and systems. Required.

Skills/Experience

• Familiar with script coding in Python and SQL.
• Experience with Azure Services, Azure Blob Storage, Snowflake and Databrick is a plus.
• Well-functioning team player and strong oral and written communicatorExcellent organizational skills with the ability to work on own initiative and follow instructions.
• Comfortable with tracing data flow and troubleshooting issues under limited
• time restriction Desired Skills/Experience.

Education

BS in Engineering, Computer Science, Information Technology degree, Data Analytics or equivalent