Remote AI Data Engineer: Petabyte-Scale Data Pipelines

Bright Vision Technologies; Schaumburg (IL); Remote; USD 80,000 - 100,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems powering AI training pipelines. You will handle ingestion, transformation, quality, lineage, and high-throughput data delivery to training jobs across multimodal workloads.

The ideal candidate has 6+ years in data engineering, strong Python skills, and experience with Spark/Ray/Beam, plus hands-on petabyte-scale storage and CI/CD practices. This is a fully remote role within the U.S.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• Six or more years of data engineering experience, with significant work supporting ML or AI workloads.
• Strong proficiency in Python and at least one JVM or systems language.
• Deep experience with modern data processing frameworks such as Spark, Ray, or Beam.
• Hands-on experience operating petabyte-scale storage and pipeline systems.
• Strong understanding of distributed systems, data modeling, and storage formats.
• Experience with dataset versioning, lineage, and reproducibility for ML workflows.
• Familiarity with high-throughput data loading for accelerator-based training.
• Strong software engineering practices including testing, CI/CD, and code review.
• Excellent communication and cross-functional collaboration skills.

Responsibilities

• Build and operate large-scale data systems powering AI training/evaluation pipelines.
• Design ingestions, transformations, quality assurance, and lineage for high-throughput data delivery.
• Ensure data infrastructure choices support model quality and training efficiency.
• Collaborate with ML/AI teams to optimize data workflows and reliability.

Skills

Python

Java/Scala

Spark

Ray/Beam

Petabyte storage

Data pipelines

Data lineage

ML data workflows

CI/CD

Testing

Communication

Education

Bachelor’s or Master’s degree in Computer Science

Job description

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems powering AI training pipelines. You will handle ingestion, transformation, quality, lineage, and high-throughput data delivery to training jobs across multimodal workloads.

The ideal candidate has 6+ years in data engineering, strong Python skills, and experience with Spark/Ray/Beam, plus hands-on petabyte-scale storage and CI/CD practices. This is a fully remote role within the U.S.