Remote ML Data Engineer — Scale-Petabyte AI Pipelines

Carbon Data Solutions; United States; Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an ML Data Engineer for a fully remote role serving the United States. The position requires 6+ years of data engineering experience, strong Python skills, and expertise with Spark, Ray, or Beam to manage petabyte-scale data pipelines for AI workloads.

You will build, operate, and optimize data systems powering AI training and evaluation, focusing on ingestion, transformation, quality, lineage, and delivery to training jobs across modalities.

Qualifications

• Bachelors or Masters degree in Computer Science or related field.
• Six or more years of data engineering experience with ML/AI workloads.
• Proficiency in Python and at least one JVM or systems language.
• Deep experience with Spark, Ray, or Beam.
• Hands-on experience with petabyte-scale storage and pipelines.
• Understanding of distributed systems, data modeling, and storage formats.
• Experience with dataset versioning, lineage, and reproducibility for ML workflows.
• Experience with high-throughput data loading for accelerator-based training.
• Strong software engineering practices including testing, CI/CD, and code review.
• Excellent communication and cross-functional collaboration skills.

Skills

Python

JVM language

Distributed systems

Communication

CI/CD

Education

Bachelors or Masters degree in Computer Science

Tools

Spark

Ray

Beam

Petabyte-scale storage

Job description

Bright Vision Technologies is seeking an ML Data Engineer for a fully remote role serving the United States. The position requires 6+ years of data engineering experience, strong Python skills, and expertise with Spark, Ray, or Beam to manage petabyte-scale data pipelines for AI workloads.

You will build, operate, and optimize data systems powering AI training and evaluation, focusing on ingestion, transformation, quality, lineage, and delivery to training jobs across modalities.