Petabyte-Scale AI Data Engineer (Remote)

Bright Vision Technologies; Overland Park (KS); Remote; USD 150,000 - 165,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Operations Engineer to build and operate the large-scale data systems that power modern AI training and evaluation pipelines.

The role combines deep data engineering expertise with a strong understanding of AI workloads, focusing on ingestion, transformation, quality assurance, lineage, and high-throughput delivery of data to training jobs across diverse modalities.

Qualifications

• Six or more years of data engineering experience, with significant work supporting ML or AI workloads.
• Strong proficiency in Python and at least one JVM or systems language.
• Deep experience with modern data processing frameworks such as Spark, Ray, or Beam.
• Hands-on experience operating petabyte-scale storage and pipeline systems.
• Strong understanding of distributed systems, data modeling, and storage formats.
• Experience with dataset versioning, lineage, and reproducibility for ML workflows.
• Familiarity with high-throughput data loading for accelerator-based training.
• Strong software engineering practices including testing, CI/CD, and code review.
• Excellent communication and cross-functional collaboration skills.

Responsibilities

• Six or more years of data engineering experience, with significant work supporting ML or AI workloads.
• Strong proficiency in Python and at least one JVM or systems language.
• Deep experience with modern data processing frameworks such as Spark, Ray, or Beam.
• Hands-on experience operating petabyte-scale storage and pipeline systems.
• Strong understanding of distributed systems, data modeling, and storage formats.
• Experience with dataset versioning, lineage, and reproducibility for ML workflows.
• Familiarity with high-throughput data loading for accelerator-based training.
• Strong software engineering practices including testing, CI/CD, and code review.
• Excellent communication and cross-functional collaboration skills.

Skills

Data engineering

Python

JVM languages

Spark/Ray/Beam

Petabyte-scale storage

Distributed systems

Data lineage

Dataset versioning

CI/CD

Communication

Tools

Git

Docker

Kubernetes

Airflow

Job description

Bright Vision Technologies is seeking an AI Operations Engineer to build and operate the large-scale data systems that power modern AI training and evaluation pipelines.

The role combines deep data engineering expertise with a strong understanding of AI workloads, focusing on ingestion, transformation, quality assurance, lineage, and high-throughput delivery of data to training jobs across diverse modalities.