Senior Data Engineer

Kroll; Mumbai; Vor Ort; INR 2.800.000 - 4.200.000; Vollzeit

Zusammenfassung

Kroll is seeking a Senior Data Engineer to design, implement, and govern enterprise data platforms that enable secure, scalable data solutions. You will partner with stakeholders and cross-functional teams to build modern cloud-native ecosystems with enterprise standards for architecture, data quality, governance, security, and platform operations.

The role combines strategic architecture with hands-on engineering to support analytics, AI, and regulatory compliance across the organization.

Qualifikationen

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 5+ years of experience in Data Engineering, Data Architecture, Platform Engineering, or related disciplines.
• Extensive experience designing enterprise-scale cloud data platforms.
• Strong understanding of data architecture principles including Lakehouse, Data Mesh, and Data Fabric.
• Experience implementing enterprise data governance and security frameworks.
• Proven ability to lead large-scale technical initiatives from design through production.

Aufgaben

• Design and maintain enterprise data architecture aligned with business strategy and technology roadmaps.
• Define data models across operational and analytical platforms.
• Develop scalable patterns for data lakes, data warehouses, lakehouses, and modern analytics.
• Establish standards for metadata, lineage, master data, and data lifecycle management.
• Drive cloud-based data platform evaluations and architectural decisions.
• Design, build, and optimize data platforms using cloud-native technologies.
• Develop and maintain scalable ETL/ELT pipelines for structured and semi-structured data.
• Implement infrastructure automation and CI/CD practices.
• Monitor and optimize platform performance, reliability, and cost.

Kenntnisse

Spark

PySpark

SQL

Python

ETL/ELT

Streaming

Batch processing

Ausbildung

Bachelor's degree in CS/IS/Engineering

Tools

Databricks

Microsoft Fabric

Snowflake

Azure Synapse Analytics

Azure Data Lake Storage

Azure

AWS

Jobbeschreibung

Job Description

We are seeking a Senior Data Engineer responsible for designing, implementing, and governing enterprise data platforms that enable secure, scalable, and high-quality data solutions across the organization. This role combines strategic architecture with hands‑on engineering, ensuring that data platforms support analytics, AI, operational reporting, regulatory compliance, and business transformation initiatives. The ideal candidate partners closely with business stakeholders, data engineers, application teams, security, and governance functions to build modern cloud‑native data ecosystems while establishing enterprise standards for architecture, data quality, governance, security, and platform operations.

Key Responsibilities

Enterprise Data Architecture

• Design and maintain enterprise data architecture that aligns with business strategy and technology roadmaps.
• Define logical, conceptual, and physical data models across operational and analytical platforms.
• Develop scalable architecture patterns for data lakes, data warehouses, lakehouses, and modern analytics platforms.
• Establish standards for metadata, lineage, master data, reference data, and data lifecycle management.
• Drive technology evaluations and architectural decisions for cloud-based data platforms.

Data Platform Engineering

• Design, build, and optimize enterprise data platforms using cloud-native technologies.
• Develop and maintain scalable ETL/ELT pipelines for structured and semi-structured data.
• Implement infrastructure automation and deployment pipelines using Infrastructure as Code and CI/CD practices.
• Optimize platform performance, reliability, scalability, and cost across cloud environments.
• Troubleshoot platform issues and continuously improve operational resilience.

Data Governance & Security

• Design and implement enterprise data governance frameworks.
• Lead initiatives involving confidential data identification, classification, masking, tokenization, encryption, and access control.
• Define and implement data retention, auditing, and compliance standards.
• Collaborate with Security, Risk, Legal, and Compliance teams to ensure adherence to regulatory requirements.
• Establish enterprise metadata management and data lineage capabilities.

Data Quality & Reliability

• Develop enterprise data quality frameworks including validation, reconciliation, completeness, accuracy, and monitoring.
• Implement automated quality controls within ingestion and transformation pipelines.
• Define KPIs and metrics to measure platform health and data quality.
• Lead initiatives that improve trust in enterprise data assets.

Cloud Platform Administration

• Administer enterprise analytics platforms including Databricks, Microsoft Fabric, Snowflake, Azure and AWS environments
• Manage workspace provisioning, Unity Catalog governance, compute optimization, storage management, and platform security.
• Implement role-based access controls and least-privilege security models.
• Monitor platform utilization, capacity planning, and cost optimization.

Analytics Enablement

• Partner with BI teams to enable trusted enterprise reporting.
• Support semantic models, reporting platforms, and self-service analytics capabilities.
• Ensure data products are discoverable, reusable, and governed.

Architecture Leadership

• Lead architecture reviews and technical design sessions.
• Provide technical leadership to engineering teams and mentor junior architects and engineers.
• Define enterprise best practices, standards, and reusable design patterns.
• Review solution designs for scalability, maintainability, security, and performance.

Operational Excellence

• Improve platform reliability through monitoring, automation, observability, and incident response.
• Develop operational runbooks and disaster recovery strategies.
• Drive continuous improvement initiatives across platform operations.
• Support production deployments and release management.

Cross-Functional Collaboration

• Partner with Finance, HR, Operations, Product, Security, and Engineering teams to understand business requirements.
• Translate business objectives into scalable technical solutions.
• Communicate architecture decisions and technical strategy to both technical and executive audiences.
• Lead cross-functional initiatives involving multiple business units and external vendors.

Requirements

• Bachelor's degree in Computer Science/ Information Systems/Engineering, or related field.
• 5+ years of experience in Data Engineering, Data Architecture, Platform Engineering, or related disciplines.
• Extensive experience designing enterprise-scale cloud data platforms.
• Strong understanding of modern data architecture principles including Lakehouse, Data Mesh, and Data Fabric concepts.
• Experience implementing enterprise data governance and security frameworks.
• Proven ability to lead large-scale technical initiatives from design through production.

Technical Skills

• Cloud Platforms: Microsoft Azure (Preferred), AWS
• Data Platforms: Databricks (Required), Microsoft Fabric, Snowflake, Azure Synapse Analytics, Azure Data Lake Storage
• Databases: SQL Server, Oracle, PostgreSQL, Azure SQL, Delta Lake
• Data Engineering: Spark, PySpark, SQL, Python, ETL/ELT pipeline development, Streaming and batch processing
• Governance & Metadata: Microsoft Purview, Unity Catalog, Data Catalogs, Data Lineage, Data Classification, Data Masking, Data Quality Frameworks
• DevOps & Automation: Git, Azure DevOps, GitHub Actions, Terraform, ARM/Bicep, CI/CD Pipelines
• Reporting & Analytics: Power BI, Semantic Models, DAX, Data Modeling

About Kroll

In a world of disruption and increasingly complex business challenges, our professionals bring truth into focus with the Kroll Lens. Our sharp analytical skills, paired with the latest technology, allow us to give our clients clarity - not just answers - in all areas of business. We value the diverse backgrounds and perspectives that enable us to think globally. As part of One team, One Kroll, you’ll contribute to a supportive and collaborative work environment that empowers you to excel.

Kroll is the premier global valuation and corporate finance advisor with expertise in complex valuation, disputes and investigations, M&A, restructuring, and compliance and regulatory consulting. Our professionals balance analytical skills, deep market insight and independence to help our clients make solid decisions. As an organization, we think globally—and encourage our people to do the same.

Kroll is committed to equal opportunity and diversity, and recruits people based on merit.