Remote Data Engineer — AI-Ready Lakehouse Pipelines

7Seventy Recruiting

United States

Remote

USD 160,000 - 190,000

Full time

14 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote working environment
Flexible, unlimited PTO
13 paid holidays (NFL/Super Bowl)**
401(k) with employer match

Job summary

7Seventy Recruiting is hiring a Data Engineer to design, build, and maintain scalable data pipelines supporting deep learning, video processing, and AI-powered analytics. You’ll handle ingestion, transformation, orchestration, and delivery, including real-time feeds and analytics-ready datasets with Python, SQL, Databricks, and Spark.

You’ll collaborate with MLOps, Sports Data, ML/AI, product, and analytics teams to enable model training, retrieval-augmented generation, vector search, and

Qualifications

  • 3–8 years of professional experience as a Data Engineer or ETL Developer.
  • Experience building data pipelines in production environments with reliable data delivery.

Responsibilities

  • Design, build, deploy, and maintain data pipelines for ingestion, cleaning, transformation, and processing.
  • Develop and optimize ETL/ELT workflows for batch and real-time streaming data.
  • Build scalable data infrastructure delivering reliable datasets for DL, video, and AI workloads.
  • Partner with ML/AI teams to make datasets accessible and safe for autonomous AI agents.
  • Develop retrieval pipelines using RAG and vector search across sports data and video assets.
  • Model and maintain structured data assets using Delta, Parquet, and Iceberg.
  • Implement workflow orchestration and monitoring to schedule jobs and recover from failures.
  • Establish data quality and governance controls with validation and auditing.

Skills

Python
SQL
Data modeling
Delta lake
Airflow
Databricks
Spark
Kubernetes
Cloud (AWS/GCP/Azure)
LLM data tooling

Tools

Databricks
Apache Spark
Airflow
Dagster
Luigi
Prefect
Docker
Kubernetes

Job description

7Seventy Recruiting is hiring a Data Engineer to design, build, and maintain scalable data pipelines supporting deep learning, video processing, and AI-powered analytics. You’ll handle ingestion, transformation, orchestration, and delivery, including real-time feeds and analytics-ready datasets with Python, SQL, Databricks, and Spark.

You’ll collaborate with MLOps, Sports Data, ML/AI, product, and analytics teams to enable model training, retrieval-augmented generation, vector search, and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data & AI Engineer II: Lakehouse & Real-Time Pipelines
Data & AI Engineer II: Lakehouse & Real-Time Pipelines

27Global LLC • Leawood (KS)

Hybrid
USD 120,000 - 170,000
Profit sharing
Quarterly bonus potential
Learning, development & certifications
+1
Senior Data Engineer: AI-Ready Data Pipelines & Lakehouse
Senior Data Engineer: AI-Ready Data Pipelines & Lakehouse

National Information Solutions Cooperative, Inc. • Atlanta (GA)

Hybrid
USD 110,000 - 150,000
Health Insurance
HSA with employer contributions
Education assistance program
+1
Data Engineer: AI-Driven Lakehouse & Pipelines Expert
Data Engineer: AI-Driven Lakehouse & Pipelines Expert

TriSearch • Denver (CO)

Hybrid
USD 160,000 - 190,000
Health, dental, vision coverage
Hybrid/Remote work options
401(k) with company match
+5
Lead Data Engineer – Lakehouse & ML Pipelines
Lead Data Engineer – Lakehouse & ML Pipelines

CloudBigD • Lansing (MI)

On-site
USD 87,000 - 114,000
Senior AWS Data Engineer: Lakehouse & AI-Driven Pipelines
Senior AWS Data Engineer: Lakehouse & AI-Driven Pipelines

Global Business Ser. 4u Inc. • New York (NY)

On-site
USD 140,000 - 190,000
Remote Data Engineer — Pipeline & Lakehouse Expert
Remote Data Engineer — Pipeline & Lakehouse Expert

NTT DATA, Inc. • Atlanta (GA)

Remote
USD 138,000 - 152,000
Medical, dental, and vision insurance
401k program
Data Engineer — AI-Powered Data Pipelines & Lakehouses
Data Engineer — AI-Powered Data Pipelines & Lakehouses

Inspired Infotech LLC. • Clearwater (FL)

On-site
USD 100,000 - 140,000
Data Engineer: Real-Time Lakehouse & Pipelines
Data Engineer: Real-Time Lakehouse & Pipelines

Nouvells • United States

Remote
USD 120,000 - 180,000
Remote Senior Data Engineer — Lakehouse & Real-Time Pipelines
Remote Senior Data Engineer — Lakehouse & Real-Time Pipelines

The Modulae • United States

Remote
USD 130,000 - 180,000
Remote work
Remote Data Engineer: Scalable Pipelines & Lakehouse
Remote Data Engineer: Scalable Pipelines & Lakehouse

Virtusa Corporation • United States

Remote
USD 120,000 - 160,000