Lead Data Engineer

Tata Consultancy Services; Dallas (TX); On-site; USD 100,000 - 140,000; Full time

Benefits offered by this job

Discretionary incentive

Comprehensive medical coverage

Parental leave

401K plan

Training reimbursement

Job summary

Tata Consultancy Services Limited in Dallas, TX is seeking a Senior Engineer to lead end-to-end data engineering initiatives in a technology-focused environment. You will own ingestion, transformation and publishing workflows for multimodal datasets, and drive architecture decisions with a focus on quality, scalability and cost efficiency.

The role requires 8+ years in data engineering, strong Python and SQL, and experience with cloud data platforms and orchestration.

Qualifications

• 8+ years of data engineering experience.
• Experience processing multimodal data: video, images, LiDAR, GNSS, IMU, telemetry.
• Experience designing AI training dataset pipelines at scale.
• Advanced Python and SQL with distributed processing and orchestration.
• Experience with cloud data platforms, object storage, lakehouse patterns, metadata, lineage, governance.
• Strong data quality, observability, performance engineering and production support.

Responsibilities

• Own end-to-end architecture for ingestion, transformation, synchronization, validation and publishing of multimodal datasets.
• Define engineering standards, reusable frameworks, data contracts, metadata, lineage and quality controls.
• Lead design reviews and guide engineers on implementation, testing, troubleshooting and performance optimization.
• Partner with AI, perception, annotation, platform and business stakeholders to prioritize requirements.
• Establish monitoring and operational controls for pipeline reliability, throughput, traceability and cost.
• Lead root-cause analysis and remediation for complex data and pipeline defects.
• Maintain architecture documentation, technical roadmaps, delivery risks and knowledge transfer.

Skills

Data engineering

Python

SQL

Distributed processing

AI data pipelines

Education

Bachelors in Computer Science

Tools

Cloud platforms

Cloud storage

Workflow orchestration

Job description

Job Description

Must Have Technical/Functional Skills

• 8+ years of data engineering experience, including technical leadership of complex data platforms or pipelines.
• Demonstrated proficiency processing unstructured and multimodal data, including video, images, LiDAR, GNSS, IMU, and telemetry.
• Proven experience designing architectures and pipelines for AI training dataset creation at scale.
• Advanced Python and SQL skills with hands-on experience in distributed processing and workflow orchestration.
• Experience with cloud data platforms, object storage, lakehouse patterns, metadata, lineage, governance, and dataset versioning.
• Strong understanding of data quality, observability, performance engineering, and production support.

Roles & Responsibilities

• Own the end-to-end architecture for ingestion, transformation, synchronization, validation, and publishing of multimodal sensor datasets.
• Define engineering standards, reusable frameworks, data contracts, metadata, lineage, and quality controls.
• Lead design reviews and guide engineers on implementation, testing, troubleshooting, and performance optimization.
• Partner with AI, perception, annotation, platform, and business stakeholders to prioritize requirements and milestones.
• Establish monitoring and operational controls for pipeline reliability, throughput, traceability, and cost.
• Lead root-cause analysis and remediation for complex data and pipeline defects.
• Maintain architecture documentation, technical roadmaps, delivery risks, and knowledge transfer.

Generic Managerial Skills, If any

Technical leadership, work planning, mentoring, stakeholder communication, design governance, risk management, and cross-functional coordination.

Salary Range: $100,000 - $140,000 per year

TCS Employee Benefits Summary:

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Location

Dallas, TX

Function

TECHNOLOGY

Role

Senior Engineer

ID

435482

Skills

Python

Salary Range

$100,000 - $140,000

Desired Candidate Profile

Qualifications

BACHELOR OF COMPUTER SCIENCE