Senior Data Engineer

Cobden & Carter International; Quezon City; On-site; PHP 900,000 - 1,800,000; Full time

Job summary

Cobden & Carter International is actively seeking a Data Engineer to design, develop, and manage data pipelines and architectures that support business analysis and decision-making. You will ensure seamless data flows from multiple sources into databases, data lakes or warehouses, and optimize large-scale systems for performance and cost efficiency.

The ideal candidate brings strong software engineering skills, experience with data processing frameworks, and the ability to scale data

Qualifications

• Design, build, and maintain scalable data pipelines for collection, transformation, and integration from various sources.
• Maintain databases, data warehouses, data lake ensuring data integrity, scalability, and reliability.
• Implement ETL/ELT (Extract, Transform, Load) processes to automate data collection, cleaning, and transformation tasks.
• Integrate data from various internal and external sources, including APIs, cloud storage, third-party systems, and databases.
• Optimize data architectures for performance, scalability, and cost efficiency. Ensure fast and reliable data retrieval.
• Work closely with the data team to understand data needs and deliver reliable, clean, and accessible data solutions.
• Implement data validation and monitoring processes to ensure data accuracy and integrity. Identify and troubleshoot data issues and bottlenecks.
• Manage and optimize cloud-based infrastructure (e.g., AWS, Azure) to support data storage, processing, and retrieval.
• Automate repetitive tasks and processes using scripting languages (e.g., Python and SQL) and workflows.
• Document data architectures, pipelines, and workflows that will be understood by the Information Technology (IT) department. Provide technical support and troubleshooting to the team.
• Demonstrating a strong track record of interacting with the business and technology partners to drive the requirement, technical process into acceptance criteria.

Responsibilities

• Design, build, and maintain scalable data pipelines that support data collection, transformation, and integration from various sources.
• Maintain databases, data warehouses, data lake ensuring data integrity, scalability, and reliability.
• Implement efficient ETL/ELT processes to automate data collection, cleaning, and transformation tasks.
• Integrate data from various internal and external sources, including APIs, cloud storage, third-party systems, and databases.
• Collaborate with the data team to understand data needs and deliver reliable, clean data solutions.

Skills

Python

SQL

Data modeling

Data visualization

Education

Degree in Computer Engineering

Degree in Data Science

Degree in Statistics

Degree in Physics

Tools

Github

Databricks

AWS

PowerBI

Linux

Azure

Job description

The Data Engineer will be responsible for designing, developing, and managing data pipelines and architectures. S/he will ensure that data flows seamlessly from multiple sources into databases, data lakes or warehouses and is processed in a way that supports business analysis and decision-making. The ideal candidate will have strong software engineering skills, experience with data processing frameworks, and the ability to optimize and scale large data systems.

Essential Duties and Responsibilities

• Design, build, and maintain scalable data pipelines that support data collection, transformation, and integration from various sources.
• Maintain databases, data warehouses, data lake ensuring data integrity, scalability, and reliability.
• Implement efficient ETL/ELT (Extract, Transform, Load) processes to automate data collection, cleaning, and transformation tasks.
• Integrate data from various internal and external sources, including APIs, cloud storage, third-party systems, and databases.
• Optimize data architectures for performance, scalability, and cost efficiency. Ensure fast and reliable data retrieval.
• Work closely with the data team to understand data needs and deliver reliable, clean, and accessible data solutions.
• Implement data validation and monitoring processes to ensure data accuracy and integrity. Identify and troubleshoot data issues and bottlenecks.
• Manage and optimize cloud-based infrastructure (e.g., AWS, Azure) to support data storage, processing, and retrieval.
• Automate repetitive tasks and processes using scripting languages (e.g., Python and SQL) and workflows.
• Document data architectures, pipelines, and workflows that will be understood by the Information Technology (IT) department. Provide technical support and troubleshooting to the team.
• Demonstrating a strong track record of interacting with the business and technology partners to drive the requirement, technical process into acceptance criteria.

Performance Indicators

• Data Pipeline Efficiency and Reliability
• Data Quality and Integrity
• Data Processing
• Data Storage Optimization
• Data Compliance & Governance
• Scalability of Systems
• Cost Efficiency of Data Infrastructure
• Time to Resolve Data Issues
• Automation and Process Improvement
• Collaboration and Communication
• System Downtime and Availability
• Documentation and Knowledge Sharing
• Innovation and Problem-Solving
• Learning & Development

Qualifications

• Degree in Computer Engineering / Data Science / Statistics / Physics or any other related field in IT.
• Knowledge in Agile methodology (e.g., Scrum & Kanban)
• Experienced in using cloud computing platforms (Azure)

Coding Languages

• SQL
• DAX

File types

Systems / Softwares / Platforms

• Github
• Databricks
• AWS
• PowerBI
• Linux

Other Qualifications

• ETL/ELT
• Integration
• API
• Statistics
• Code/Performance Optimization
• Data Wrangling

Nice to have but not required

Shift: Dayshift
Setup: Onsite
Location: Libis, Quezon City

By Applying, you give consent to collect, store, and/or process personal and/or sensitive information for the purpose of recruitment and employment may it be internal to Cobden & Carter International and/or to its clients.