Data Quality Architect - Scalable AI Validation Pipelines

Carbon Data Solutions; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

Firmable is seeking a Data Engineering Lead - Data Quality Systems to guide a small team of Applied AI Engineers building pipelines that verify, measure, and enforce quality across billions of records in multiple markets.

You will own the quality layer, design scalable validation harnesses, and ship automated checks and gates that ensure only trusted data reaches customers, with ~80% hands-on coding and ~20% leadership.

Qualifications

• 7-10 years building production data systems.
• Experience with billions of rows and scalable quality checks.
• Built data quality systems and frameworks.
• Hands-on harness engineering for eval/validation.
• Led engineers while staying hands-on.
• Strong Python and advanced SQL.
• Operate LLMs as production systems.
• Shipped work with agentic IDEs.

Responsibilities

• Quality systems architecture for verification pipelines.
• Frameworks and SKILL.md specs to accelerate quality checks.
• Harness engineering for LLM-based validation and extraction.
• Release gates and triage tooling for data quality.
• Incident remediation and root-cause analysis at scale.
• Team leadership of 3-5 Applied AI Engineers.

Skills

Production data at scale

Python programming

Advanced SQL

LLM in production

Data quality systems

Team leadership

Validation harnesses

Rules vs. LLMs judgement

Agentic IDEs experience

Tools

Snowflake

Databricks

Redshift

AWS

Airflow

Vector databases

Job description

Firmable is seeking a Data Engineering Lead - Data Quality Systems to guide a small team of Applied AI Engineers building pipelines that verify, measure, and enforce quality across billions of records in multiple markets.

You will own the quality layer, design scalable validation harnesses, and ship automated checks and gates that ensure only trusted data reaches customers, with ~80% hands-on coding and ~20% leadership.