Data Engineer (Remote)

7Seventy Recruiting

United States

Remote

USD 160,000 - 190,000

Full time

21 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote working environment
Flexible, unlimited PTO
13 paid holidays (NFL/Super Bowl)**
401(k) with employer match

Job summary

7Seventy Recruiting is hiring a Data Engineer to design, build, and maintain scalable data pipelines supporting deep learning, video processing, and AI-powered analytics. You’ll handle ingestion, transformation, orchestration, and delivery, including real-time feeds and analytics-ready datasets with Python, SQL, Databricks, and Spark.

You’ll collaborate with MLOps, Sports Data, ML/AI, product, and analytics teams to enable model training, retrieval-augmented generation, vector search, and

Qualifications

  • 3–8 years of professional experience as a Data Engineer or ETL Developer.
  • Experience building data pipelines in production environments with reliable data delivery.

Responsibilities

  • Design, build, deploy, and maintain data pipelines for ingestion, cleaning, transformation, and processing.
  • Develop and optimize ETL/ELT workflows for batch and real-time streaming data.
  • Build scalable data infrastructure delivering reliable datasets for DL, video, and AI workloads.
  • Partner with ML/AI teams to make datasets accessible and safe for autonomous AI agents.
  • Develop retrieval pipelines using RAG and vector search across sports data and video assets.
  • Model and maintain structured data assets using Delta, Parquet, and Iceberg.
  • Implement workflow orchestration and monitoring to schedule jobs and recover from failures.
  • Establish data quality and governance controls with validation and auditing.

Skills

Python
SQL
Data modeling
Delta lake
Airflow
Databricks
Spark
Kubernetes
Cloud (AWS/GCP/Azure)
LLM data tooling

Tools

Databricks
Apache Spark
Airflow
Dagster
Luigi
Prefect
Docker
Kubernetes

Job description

Experience: 3–8 years in Data Engineering or ETL Development

Core Areas: Data Pipelines, ETL/ELT, Python & SQL, Databricks & Spark, Data Modeling & Lakehouse Architecture, Workflow Orchestration, Data Quality & Governance, AI/ML Data Infrastructure

Compensation: $160,000–$190,000 USD annually

About the Role

This Data Engineer position focuses on designing, building, and maintaining reliable, scalable data pipelines that support deep learning, video processing, large language models (LLMs), analytics, and AI-powered applications. The role spans data ingestion, transformation, orchestration, and delivery, including real-time data feeds, batch processing, and analytics-ready datasets. Responsibilities include ensuring data accuracy, availability, discoverability, and performance across production data systems.

The position involves developing ETL/ELT workflows using Python, SQL, Databricks, Spark, and modern orchestration technologies. Working closely with MLOps, Sports Data, ML/AI, product, and analytics teams, this role supports model training, retrieval-augmented generation (RAG), vector search, and AI-driven products across multiple sports. The work includes structured sports statistics, scouting information, video metadata, and modern lakehouse data architectures.

What You'll Do
  • Design, build, deploy, and maintain reliable data pipelines for ingestion, cleaning, transformation, and processing using Databricks, Airflow, Kubernetes, and related technologies.
  • Develop and optimize ETL/ELT workflows with Python and SQL to support batch and real-time streaming data workloads.
  • Build and maintain scalable data infrastructure that supplies reliable, discoverable datasets for deep learning, video systems, LLM applications, model training, and analytics.
  • Partner with ML/AI teams to make datasets and data tools accessible and safe for autonomous AI agents, including evaluation processes and guardrails for AI-generated queries.
  • Develop retrieval pipelines using retrieval-augmented generation (RAG) and vector search across structured sports statistics and unstructured sources, including scouting notes and video metadata.
  • Design, model, and maintain structured data assets using Delta, Parquet, and Iceberg, supporting data reliability, versioning, and lineage tracking.
  • Implement workflow orchestration and monitoring solutions to schedule data processing jobs, manage dependencies, detect failures, and automate recovery.
  • Establish and maintain data quality and compliance controls through validation frameworks, schema enforcement, and audit logging.
  • Collaborate with MLOps, Sports Data, product, and analytics teams to integrate data pipelines and datasets into AI applications and analytical workflows.
  • Evaluate data engineering tools and technologies, establish platform best practices, and improve the developer experience.
  • Optimize performance, scalability, and infrastructure costs across compute, storage, and workflow orchestration systems.
Qualifications
Required Experience
  • 3–8 years of professional experience as a Data Engineer or ETL Developer working with production data systems.
  • Experience developing, maintaining, and supporting data engineering workflows in a production environment.
Required Skills
  • Strong proficiency in Python and SQL for data engineering, data transformation, and ETL/ELT development.
  • Practical familiarity with Databricks, Apache Spark, or equivalent big-data processing frameworks.
  • Experience with workflow orchestration technologies such as Apache Airflow, Dagster, Luigi, or Prefect.
  • Deep understanding of data modeling, data warehousing, and distributed data processing.
  • Knowledge of modern data lakehouse architectures and associated data engineering practices.
  • Familiarity with CI/CD practices, GitHub Actions, Infrastructure as Code (IaC), and data pipeline testing frameworks.
  • Experience working with cloud infrastructure such as AWS, Google Cloud Platform (GCP), or Microsoft Azure.
  • Familiarity with containerization and orchestration technologies, including Docker and Kubernetes.
  • Exposure to LLM-powered data tools and techniques, including text-to-SQL, retrieval-augmented generation (RAG), agent/tool interfaces such as Model Context Protocol (MCP), or natural-language analytics.
  • Ability to work across functional teams involving machine learning, product development, and analytics.
Preferred Qualifications
  • Previous experience developing data pipelines for sports data, telemetry, or sensor-generated information.
  • Familiarity with streaming frameworks and event-driven data processing technologies such as Apache Kafka, Spark Structured Streaming, or Apache Flink.
  • General knowledge of American football, the NFL, and college football.
  • Background in data governance, data lineage, and observability tools such as Monte Carlo, Great Expectations, Unity Catalog, or OpenLineage.
  • Experience designing semantic layers or defining metrics consumed by artificial intelligence (AI) and business intelligence (BI) tools.
  • Exposure to machine learning model management practices and MLOps methodologies.
  • 401(k) retirement savings plan with company matching contributions.
  • Remote working environment.
  • Flexible, unlimited paid time off policy.
  • 13 paid holidays, including the Monday following the Super Bowl.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

SumerSports LLC • United States

Remote
USD 90,000 - 120,000
Competitive Salary and Bonus Plan
Retirement savings plan (401k) with company match
Remote working environment
+2
Senior Data Engineer
Senior Data Engineer

Opinov8 • United States

Remote
USD 120,000 - 160,000
Remote work
Learning & development
Technical Lead - Data Engineer (Data&AI)
Technical Lead - Data Engineer (Data&AI)

Srijan Technologies • United States

Remote
USD 150,000 - 200,000
Data Engineer
Data Engineer

Resolve Tech Solutions • Irving (TX)

On-site
USD 110,000 - 150,000
Senior Data Engineer: AI Data Platform & Pipelines
Senior Data Engineer: AI Data Platform & Pipelines

V4C.ai • United States

Remote
USD 120,000 - 180,000
Data Platform Engineer
Data Platform Engineer

BrightAI • Palo Alto (CA)

On-site
USD 150,000 - 210,000
Sr Data Engineer
Sr Data Engineer

Recurring Decimal • Dallas (TX)

On-site
USD 130,000 - 190,000
Senior Data Engineer
Senior Data Engineer

penninteractive • United States

Hybrid
USD 110,000 - 160,000
Education & conference reimbursement
Mentoring and career progression
Senior Manager, Data Engineering
Senior Manager, Data Engineering

palmettocleantech • United States

Remote
USD 180,000 - 230,000
Remote position in the United States
Data Engineer
Data Engineer

Trisearch • Denver (CO)

Hybrid
USD 160,000 - 190,000
Health, dental, vision coverage
Hybrid/Remote work options
401(k) with company match
+5