Annotation Quality Engineer

Tata Consultancy Services Limited; Dallas (TX); On-site; USD 80,000 - 90,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Commuter Benefits

Certification & Training Reimbursement

401K Plan

Job summary

Tata Consultancy Services Limited in Dallas, TX is seeking an Engineer in Technology to drive annotation quality and data operations in AI, ML, and foundation model workflows. The role focuses on establishing standards, metrics, and processes for large-scale annotation programs while collaborating with engineering and AI teams.

Candidates should have a background in quality measurement, data analysis, and hands-on skills in SQL and Python.

Qualifications

• Demonstrated experience in annotation quality, machine learning data operations, quality engineering, or data quality supporting physical AI, robotics, computer vision, or machine learning programs.
• Demonstrated experience developing quality metrics and performance measurement systems.
• Demonstrated experience working with large-scale annotation programs.
• Demonstrated experience evaluating generated captions, reasoning outputs, or foundation model training datasets.
• Experience defining annotation instructions, sampling plans, acceptance criteria, defect taxonomies, and audit processes.
• Ability to analyze quality trends, identify root causes, and coordinate corrective actions.
• Working knowledge of SQL, Python, reporting, or data analysis tools used for quality measurement.

Responsibilities

• Define and maintain annotation quality standards, guidelines, defect categories, and acceptance criteria.
• Develop metrics and reporting for accuracy, consistency, completeness, rework, throughput, and reviewer agreement.
• Design sampling, audit, escalation, and root-cause analysis processes for large-scale annotation programs.
• Evaluate generated captions, reasoning outputs, and foundation model training datasets against defined quality criteria.
• Analyze quality trends and partner with annotation operations, engineering, and AI teams on corrective actions.
• Validate dataset releases and maintain traceable quality records, issue logs, and improvement plans.
• Support calibration sessions, reviewer alignment, and continuous improvement of annotation workflows.

Skills

Python

Education

Bachelor's degree in Computer Science

Job description

Tata Consultancy Services Limited in Dallas, TX is seeking an Engineer in Technology to drive annotation quality and data operations in AI, ML, and foundation model workflows. The role focuses on establishing standards, metrics, and processes for large-scale annotation programs while collaborating with engineering and AI teams.

Candidates should have a background in quality measurement, data analysis, and hands-on skills in SQL and Python.