Data Lineage Lead Architect

Tata Consultancy Services; Cleveland (OH); Presencial; USD 90 000 - 110 000; Tempo integral

Resumo da oferta

Tata Consultancy Services seeks a Data Lineage Expert/Lead to design and operationalize enterprise-scale lineage across complex data ecosystems. You will enable traceability, impact analysis, and governance by implementing OpenLineage, OpenMetadata, and cloud data pipelines.

The role requires strong metadata engineering skills, hands-on experience with modern data platforms, and collaboration with data governance, engineering, and business teams.

Qualificações

• Experience leading enterprise-scale data lineage initiatives.
• Hands-on with OpenLineage/OpenMetadata.
• Experience with Collibra or Alation.
• Strong SQL and data pipeline experience.
• Experience with ETL/ELT, data lakes, warehouses, cloud data architectures.
• Excellent stakeholder communication and leadership skills.

Responsabilidades

• Design and implement end-to-end enterprise data lineage across source systems, transformation layers, cloud data platforms, and reporting environments.
• Implement automated lineage using OpenLineage, OpenMetadata, or comparable platforms.
• Capture table-level, column-level, pipeline-level, job-level, and transformation-level lineage.
• Develop lineage ingestion and integration patterns using APIs, connectors, and event-driven frameworks.
• Integrate lineage across ETL/ELT, data lakes, warehouses, BI platforms, streaming systems, and cloud services.
• Enable impact analysis, root-cause analysis, data traceability, and change-risk assessment.
• Define technical and business lineage standards, procedures, controls, and coverage metrics.
• Partner with Data Governance, Data Engineering, Architecture, Risk, and business teams to map data elements.
• Support migration of metadata and lineage from legacy catalogs to modern metadata-management solutions.
• Design scalable lineage architecture for batch, real-time, and streaming workloads.
• Integrate lineage with AWS services like S3, Glue, Redshift, Athena, Lambda, and EMR.
• Identify gaps, improve lineage quality, and provide leadership to engineering and governance teams.

Conhecimentos

Data lineage

Metadata engineering

Data governance

OpenLineage

OpenMetadata

Collibra

Alation

SQL

REST APIs

Data pipelines

Formação académica

Bachelor's degree in Computer Science

Ferramentas

AWS S3

AWS Glue

Amazon Redshift

Amazon Athena

AWS Lambda

Amazon EMR

Descrição da oferta de emprego

Tata Consultancy Services seeks a Data Lineage Expert/Lead to design and operationalize enterprise-scale lineage across complex data ecosystems. You will enable traceability, impact analysis, and governance by implementing OpenLineage, OpenMetadata, and cloud data pipelines.

The role requires strong metadata engineering skills, hands-on experience with modern data platforms, and collaboration with data governance, engineering, and business teams.