Remote AI Data Engineer for Petabyte-Scale Pipelines

Bright Vision Technologies; Naperville (IL); Remote; USD 80,000 - 100,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems supporting AI training and evaluation pipelines. The role combines data engineering with AI workloads, focusing on ingestion, transformation, quality assurance, lineage, and high-throughput delivery across modalities.

The ideal candidate will have experience with petabyte-scale data environments, strong software engineering, and a deep understanding of how infrastructure choices impact model

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• 6+ years of data engineering experience, with significant work supporting ML or AI workloads.
• Strong proficiency in Python and at least one JVM or systems language.
• Deep experience with modern data processing frameworks such as Spark, Ray, or Beam.
• Hands-on experience operating petabyte-scale storage and pipeline systems.
• Strong understanding of distributed systems, data modeling, and storage formats.
• Experience with dataset versioning, lineage, and reproducibility for ML workflows.
• Familiarity with high-throughput data loading for accelerator-based training.
• Strong software engineering practices including testing, CI/CD, and code review.
• Excellent communication and cross-functional collaboration skills.

Responsibilities

• Build and operate large-scale data systems powering AI training and evaluation pipelines.
• Manage ingestion, transformation, quality assurance, and data lineage for ML workflows.
• Ensure high-throughput data delivery to training jobs across modalities.
• Collaborate with ML engineers to optimize data infrastructure and model quality.

Skills

Python

Java

Spark

Ray

Beam

Petabyte storage

Distributed systems

Data modeling

Data formats

Dataset versioning

Data lineage

Reproducibility

CI/CD

Testing

Cross-functional collaboration

Education

Bachelor's or Master's in Computer Science or related field

Job description

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems supporting AI training and evaluation pipelines. The role combines data engineering with AI workloads, focusing on ingestion, transformation, quality assurance, lineage, and high-throughput delivery across modalities.

The ideal candidate will have experience with petabyte-scale data environments, strong software engineering, and a deep understanding of how infrastructure choices impact model