Senior Data Engineer

Hammerjack Pty Ltd; Philippines; On-site; PHP 1,200,000 - 2,000,000; Full time

Job summary

Kroll is seeking a Senior Data Engineer to design, build, and optimize data pipelines in a Lakehouse environment, supporting AI workloads and analytics for major clients.

You will collaborate with international teams, implement robust data infrastructure, and mentor junior engineers while adopting modern data engineering practices and tools.

Qualifications

• Bachelor's or Master's degree in CS/Engineering or related field.
• 5+ years of data engineering experience delivering enterprise software.
• Experience writing ETL/ELT jobs and working with Azure/Databricks.
• Proficiency in Python, SQL, and REST APIs.

Responsibilities

• Design and build scalable data infrastructure and lakehouse architecture.
• Develop robust ETL/ELT applications for analytics and AI workloads.
• Collaborate with cross-functional teams to deliver data models and insights.
• Monitor, troubleshoot, and optimize data pipelines for performance and cost efficiency.
• Mentor junior engineers and promote continuous learning.

Skills

Data engineering

ETL/ELT development

Communication

International collaboration

Education

Bachelor's/Master's in CS/Engineering

Tools

Azure

Databricks

Python

SQL

REST APIs

FastAPI

Pydantic

Polars

Pandas

Delta Lake

Docker

Kubernetes

CI/CD

Git

Infrastructure as Code

Job description

We are hiring a Senior Data Engineer to join our team. At Kroll, we are building a strong, forward-looking data practice that integrates artificial intelligence, machine learning, and advanced analytics. You will be designing, building, and integrating data pipelines from diverse sources and collaborate with teams that serve the world's largest financial institutions, law enforcement bodies, and government agency

The Day-to-day Responsibilities Include But Not Limited To

• Design and build scalable organizational data infrastructure and Medallion architecture within a Lakehouse environment
• Develop robust, fault-tolerant ETL/ELT applications for seamless data ingestion, transformation, and distribution to enable analytics, reporting, and AI workloads
• Work with different stakeholders and teams to assist with data related technical solutions and support their data infrastructure needs
• Explore and experiment with new use cases, frameworks, and tools to enhance AI capabilities, ensuring data integrity, quality, and reliability
• Identify and implement infrastructure re-designs to improve scalability, optimize data delivery, and automate manual workflows
• Choose the best tools/services/resources to build robust data pipelines
• Collaborate with cross-functional teams to understand data requirements, create robust data models, and deliver actionable insights
• Monitor, troubleshoot, and optimize jobs for performance, addressing data pipeline bottlenecks and ensuring cost efficiency
• Continuously improve engineering processes, balancing speed, quality, and business impact
• Coach, mentor, and provide technical guidance to junior engineers, fostering a culture of continuous learning and development
• Stay updated on emerging technologies and trends in data engineering, recommending and implementing innovative solutions

Requirements

• Bachelor's/Master's degree in computer science, engineering, or a related field
• 5+ years of proven experience in data engineering, delivering business-critical software solutions for large enterprises with a consistent track record of success
• Experience writing ETL/ELT jobs
• Experience with Azure and Databricks Platform
• Experience with Python, SQL, and REST APIs
• Excellent communication and the ability to reason about trade-offs
• Ability to work with an international team

Desired Skills

• Cloud architecture principles: compute, storage, networks, security, cost
• Proficiency in using open-source tools, frameworks like FastAPI, Pydantic, Polars, Pandas, Delta Lake, Docker, Kubernetes
• Knowledge of CI/CD, Git, or infrastructure-as-code concepts
• Strong project management skills, with the ability to prioritize tasks and manage multiple projects simultaneously in an Agile environment
• Understanding of how data engineering feeds into Business Intelligence and reporting tools (Power BI/Tableau)
• Strong problem-solving and analytical skills