Senior Data Engineer

Kroll; New Delhi; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Kroll is seeking a Senior Data Engineer to enhance its data practice, integrating AI and analytics. You will design data pipelines for large enterprises, ensuring data quality and reliability.

The ideal candidate has over 5 years of experience in data engineering, strong skills in ETL/ELT, and knowledge of Azure and Databricks. Join an international team committed to continuous learning and diversity.

Qualifications

• 5+ years of proven experience in data engineering.
• Experience writing ETL/ELT jobs.
• Excellent communication skills and ability to work with international teams.

Responsibilities

• Design and build scalable organizational data infrastructure.
• Develop robust, fault-tolerant ETL/ELT applications.
• Collaborate with teams to assist with data-related technical solutions.

Skills

Data engineering

ETL/ELT

Azure

Databricks

Python

SQL

REST APIs

Cloud architecture

Agile project management

Data quality

Education

Bachelor’s/Master’s degree in computer science or engineering

Tools

FastAPI

Pydantic

Polars

Pandas

Delta Lake

Docker

Kubernetes

Job description

We are hiring a Senior Data Engineer to join our team. At Kroll, we are building a strong, forward-looking data practice that integrates artificial intelligence, machine learning, and advanced analytics. You will be designing, building, and integrating data pipelines from diverse sources and collaborate with teams that serve the world’s largest financial institutions, law enforcement bodies, and government agency.

Day-to-day Responsibilities

• Design and build scalable organizational data infrastructure and Medallion architecture within a Lakehouse environment
• Develop robust, fault-tolerant ETL/ELT applications for seamless data ingestion, transformation, and distribution to enable analytics, reporting, and AI workloads
• Work with different stakeholders and teams to assist with data related technical solutions and support their data infrastructure needs
• Explore and experiment with new use cases, frameworks, and tools to enhance AI capabilities, ensuring data integrity, quality, and reliability
• Identify and implement infrastructure re-designs to improve scalability, optimize data delivery, and automate manual workflows
• Choose the best tools/services/resources to build robust data pipelines
• Collaborate with cross-functional teams to understand data requirements, create robust data models, and deliver actionable insights
• Monitor, troubleshoot, and optimize jobs for performance, addressing data pipeline bottlenecks and ensuring cost efficiency
• Continuously improve engineering processes, balancing speed, quality, and business impact
• Coach, mentor, and provide technical guidance to junior engineers, fostering a culture of continuous learning and development
• Stay updated on emerging technologies and trends in data engineering, recommending and implementing innovative solutions

Requirements

• Bachelor’s/Master’s degree in computer science, engineering, or a related field
• 5+ years of proven experience in data engineering, delivering business-critical software solutions for large enterprises with a consistent track record of success
• Experience writing ETL/ELT jobs
• Experience with Azure and Databricks Platform
• Experience with Python, SQL, and REST APIs
• Excellent communication and the ability to reason about trade-offs
• Ability to work with an international team

Desired Skills

• Cloud architecture principles: compute, storage, networks, security, cost
• Proficiency in using open-source tools, frameworks like FastAPI, Pydantic, Polars, Pandas, Delta Lake, Docker, Kubernetes
• Knowledge of CI/CD, Git, or infrastructure-as-code concepts
• Strong project management skills, with the ability to prioritize tasks and manage multiple projects simultaneously in an Agile environment
• Understanding of how data engineering feeds into Business Intelligence and reporting tools (Power BI/Tableau)
• Strong problem-solving and analytical skills
• Strategic thinker and strong execution orientation
• Ability to work in cross-functional teams
• Attention to detail and data quality

Kroll is committed to equal opportunity and diversity, and recruits people based on merit.