AI Data Engineer: Build Scalable Enterprise Data Pipelines

SupportFinity™

San Francisco (CA)

On-site

USD 150,000 - 280,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical insurance

Vision insurance

Dental insurance

Job summary

Fluency in San Francisco is seeking an AI Data Engineer to design and build data systems that feed process conformance, productivity measurement, and AI impact analysis across Fortune 500 organizations. You’ll handle data from screenshots, OCR text, and behavioral events at scale, building pipelines that are reliable and cost-conscious.

You’ll work directly with founders and engineers, using Dagster/Airflow and Python to ship production data pipelines, feature stores, and serving infrastructure,

Qualifications

Strong Python fundamentals and software engineering discipline.
Experience designing production data pipelines (Dagster, Airflow, Prefect, or similar).
Data modelling for analytical and ML workloads.
Monitoring and observability for data systems (lineage, quality metrics, alerting).
Comfort with ambiguity and novel problem domains.

Responsibilities

Design and build data infrastructure powering conformance, productivity measurement, and AI impact analysis.
Create feature stores and serving infra balancing freshness against compute cost.
Orchestrate DAGs coordinating OCR, LLM enrichment, and downstream aggregations.
Optimize storage and query patterns for time-series behavioral data.

Skills

Python

Production data pipelines

Data modelling

Monitoring & observability

Ambiguity handling

Education

Computer Science background

Tools

Dagster

Airflow

Prefect

dbt

Spark

Job description

You’ll work directly with founders and engineers, using Dagster/Airflow and Python to ship production data pipelines, feature stores, and serving infrastructure,

Get your free, confidential resume review.

or drag and drop your file here.