Technical Lead

Tata Consultancy Services; Cleveland (OH); On-site; USD 90,000 - 110,000; Full time

Job summary

Tata Consultancy Services seeks a Data Lineage Expert/Lead to design and operationalize enterprise-scale lineage across complex data ecosystems. You will enable traceability, impact analysis, and governance by implementing OpenLineage, OpenMetadata, and cloud data pipelines.

The role requires strong metadata engineering skills, hands-on experience with modern data platforms, and collaboration with data governance, engineering, and business teams.

Qualifications

• Experience leading enterprise-scale data lineage initiatives.
• Hands-on with OpenLineage/OpenMetadata.
• Experience with Collibra or Alation.
• Strong SQL and data pipeline experience.
• Experience with ETL/ELT, data lakes, warehouses, cloud data architectures.
• Excellent stakeholder communication and leadership skills.

Responsibilities

• Design and implement end-to-end enterprise data lineage across source systems, transformation layers, cloud data platforms, and reporting environments.
• Implement automated lineage using OpenLineage, OpenMetadata, or comparable platforms.
• Capture table-level, column-level, pipeline-level, job-level, and transformation-level lineage.
• Develop lineage ingestion and integration patterns using APIs, connectors, and event-driven frameworks.
• Integrate lineage across ETL/ELT, data lakes, warehouses, BI platforms, streaming systems, and cloud services.
• Enable impact analysis, root-cause analysis, data traceability, and change-risk assessment.
• Define technical and business lineage standards, procedures, controls, and coverage metrics.
• Partner with Data Governance, Data Engineering, Architecture, Risk, and business teams to map data elements.
• Support migration of metadata and lineage from legacy catalogs to modern metadata-management solutions.
• Design scalable lineage architecture for batch, real-time, and streaming workloads.
• Integrate lineage with AWS services like S3, Glue, Redshift, Athena, Lambda, and EMR.
• Identify gaps, improve lineage quality, and provide leadership to engineering and governance teams.

Skills

Data lineage

Metadata engineering

Data governance

OpenLineage

OpenMetadata

Collibra

Alation

SQL

REST APIs

Data pipelines

Education

Bachelor's degree in Computer Science

Tools

AWS S3

AWS Glue

Amazon Redshift

Amazon Athena

AWS Lambda

Amazon EMR

Job description

Skill: Data Lineage Expert / Lead

Must Have Technical/Functional Skill:

• We are seeking an experienced Data Lineage Expert to design, implement, and operationalize enterprise-scale data lineage capabilities.
• The role will establish end-to-end technical and business lineage across complex data ecosystems, enabling traceability, impact analysis, root-cause analysis, governance, and regulatory compliance.
• The ideal candidate combines strong metadata engineering skills with hands-on expertise in OpenLineage, OpenMetadata, cloud data platforms, and modern data pipelines.

Roles & Responsibilities:

• Design and implement end-to-end enterprise data lineage across source systems, transformation layers, cloud data platforms, and reporting or analytics environments.
• Implement automated lineage using OpenLineage, OpenMetadata, or comparable enterprise metadata and catalog platforms.
• Capture table-level, column-level, pipeline-level, job-level, and transformation-level lineage.
• Develop lineage ingestion and integration patterns using APIs, connectors, metadata extraction, scanners, and event-based frameworks.
• Integrate lineage across ETL/ELT, data lakes, warehouses, BI platforms, streaming systems, and cloud-native services.
• Enable impact analysis, root-cause analysis, data traceability, dependency analysis, and change-risk assessment.
• Define technical and business lineage standards, operating procedures, controls, and coverage metrics.
• Partner with Data Governance, Data Engineering, Architecture, Risk, and business teams to map critical data elements and business processes.
• Support migration of metadata and lineage from legacy catalog platforms to modern metadata-management solutions.
• Design scalable lineage architecture supporting batch, real-time, and streaming workloads.
• Integrate lineage capabilities with AWS services such as Amazon S3, AWS Glue, Amazon Redshift, Athena, Lambda, and EMR.
• Identify metadata and lineage gaps, improve lineage quality, and provide technical leadership to engineering and governance teams.

Must-Have Qualifications:

• Demonstrated experience in Data Management, Metadata Management, Data Governance, Data Engineering, or a related discipline, with the depth of expertise required to lead enterprise-scale data lineage initiatives.
• Strong hands-on experience with data lineage architecture, metadata engineering, and enterprise-scale implementation.
• Practical expertise with OpenLineage and/or OpenMetadata.
• Experience with enterprise metadata or catalog platforms such as Collibra, Alation, or equivalent solutions.
• Strong understanding of technical, business, and operational metadata models.
• Experience with ETL/ELT technologies, modern data pipelines, data lakes, warehouses, and cloud data architectures.
• Strong SQL skills and the ability to interpret complex data transformations.
• Experience with REST APIs, metadata ingestion frameworks, connector development, and automation.
• Excellent stakeholder communication, problem-solving, and technical leadership skills.

Salary Range - $90,000-$110,000 a year

Location

Cleveland, OH

Function

TECHNOLOGY

Role

Technical Lead

ID

438680

Skills

API Microservices

Salary Range

$90,000 - $110,000

Desired Candidate Profile

Qualifications

BACHELOR OF COMPUTER SCIENCE