Senior Data Engineer – Data Governance (Apache Atlas)

Edgematics Technologies LLC; Pune District; Hybrid; INR 1,200,000 - 2,000,000; Full time

Job summary

Edgematics Technologies LLC is looking for an experienced Governance Engineer to manage enterprise metadata and Data Governance frameworks within large-scale Telecom Datalake environments. The ideal candidate will have 6–8 years of experience, particularly with Apache Atlas, and will oversee metadata operationalization and compliance.

This role emphasizes governance engineering ownership and involves responsibilities such as lineage validation and integrations with tools like Spark and NiFi, ensuring alignment with corporate standards.

The position offers a hybrid work model located in Pune, India.

Qualifications

• 6–8 years of experience in Data Governance and metadata management ecosystems.
• Strong hands‑on expertise with Apache Atlas in enterprise environments.
• Deep understanding of metadata models and governance best practices.

Responsibilities

• Configure, administer, and optimize enterprise metadata repositories using Apache Atlas.
• Implement automated metadata harvesting across NiFi, Spark, Iceberg, and Trino.
• Design and validate end-to-end data lineage.

Skills

Apache Atlas

Metadata Management

Data Lineage

Data Governance

Telecom PII

Tools

Spark

Hive

NiFi

Trino

Iceberg

Ranger

Job description

Experience

6–8 Years

Location

Pune / Hybrid

Company

Edgematics Group

About Edgematics

Edgematics is a global data and AI consulting company helping Fortune 500 enterprises modernize their data ecosystems across the Middle East, Europe, the UK, North America, and India. We deliver advanced data and AI solutions through our proprietary platforms — PurpleCube AI and Axoma — enabling large-scale Datalake, analytics, and governance transformations.

Job Description

We are seeking an experienced Governance Engineer (Metadata & Lineage – Atlas) to manage enterprise metadata and Data Governance frameworks within large-scale Telecom Datalake environments. Aligned with Vodafone-scale delivery expectations, this role focuses on operationalizing metadata, lineage validation, business glossary governance, and regulatory compliance using Atlas integrated across ingestion, transformation, storage, and query layers. The role emphasizes governance engineering ownership rather than standalone administrative management to ensure streamlined execution.

Key Responsibilities

• Configure, administer, and optimize enterprise metadata repositories using Apache Atlas.
• Implement automated metadata harvesting across NiFi, Spark, Iceberg, Trino, and related platform components.
• Design and validate end-to‑to‑end data lineage across ingestion, transformation, and consumption layers.
• Implement and govern enterprise business glossary frameworks aligned with telecom domain standards.
• Perform lineage validation during data migration and Lakehouse modernization initiatives.
• Define and enforce data classification policies, including Telecom PII tagging and compliance controls.
• Integrate Atlas with Ranger for aligned metadata‑driven access governance.
• Support stewardship workflows, audit tracking, and regulatory compliance reporting.
• Collaborate with Platform Engineers, Data Architects, and Security teams to ensure governance alignment.

Requirements

• 6–8 years of experience in Data Governance and metadata management ecosystems.
• Strong hands‑on expertise with Apache Atlas in enterprise environments.
• Deep understanding of metadata models, lineage frameworks, and governance best practices.
• Must have experience in:
  • Automated metadata harvesting.
  • Business glossary implementation.
  • Lineage validation during migration.
  • Data classification for telecom PII.
• Experience integrating governance tools with Spark, Hive, Iceberg, Trino, and Ranger.
• Experience in Telecom or BFSI regulated environments preferred.
• Strong documentation, compliance alignment, and stakeholder coordination skills.