Remote ML Data Engineer - Petabyte-Scale AI Pipelines

Bright Vision Technologies; Yuba City (CA); Remote; USD 80,000 - 100,000; Full time

Job summary

Bright Vision Technologies is seeking a Machine Learning Data Engineer to design and operate large-scale data systems powering AI training and evaluation pipelines. This 100% remote, full-time role focuses on ingestion, transformation, quality assurance, lineage, and delivering data to training jobs across diverse modalities.

The ideal candidate has 6+ years of data engineering experience, strong Python and JVM language skills, and hands-on work with Spark, Ray, or Beam, plus experience with

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• Six+ years of data engineering experience supporting ML/AI workloads.
• Strong Python and at least one JVM or systems language.
• Deep experience with Spark, Ray, or Beam.
• Hands-on experience operating petabyte-scale storage and pipeline systems.
• Strong understanding of distributed systems, data modeling, and storage formats.
• Experience with dataset versioning, lineage, and reproducibility for ML workflows.
• Familiarity with high-throughput data loading for accelerator-based training.
• Strong software engineering practices including testing, CI/CD, and code review.
• Excellent communication and cross-functional collaboration skills.

Skills

Python

JVM language

Spark

Ray/Beam

Petabyte-scale storage

Distributed systems

Data modeling

Dataset versioning

Reproducibility

CI/CD

Testing

Cross-functional collab

Communication

Education

Bachelor's or Master’s degree in Computer Science or related field

Tools

Apache Spark

Ray

Beam

CI/CD tooling

Python tooling

Data pipelines

Job description

Bright Vision Technologies is seeking a Machine Learning Data Engineer to design and operate large-scale data systems powering AI training and evaluation pipelines. This 100% remote, full-time role focuses on ingestion, transformation, quality assurance, lineage, and delivering data to training jobs across diverse modalities.

The ideal candidate has 6+ years of data engineering experience, strong Python and JVM language skills, and hands-on work with Spark, Ray, or Beam, plus experience with