Remote AI Data Engineer: Scalable Pipelines & ML Workloads

Bright Vision Technologies; Charlotte (NC); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking a Data Engineering Specialist – AI to build and operate large-scale data systems powering modern AI training and evaluation pipelines. The role emphasizes ingestion, transformation, data quality, lineage, and high-throughput delivery of data to training jobs across modalities.

The ideal candidate has 6+ years of data engineering experience, strong Python skills, and experience with Spark, Ray, or Beam, plus petabyte-scale storage and pipelines.

Qualifications

• 6+ years of data engineering experience, with significant work supporting ML or AI workloads.
• Strong proficiency in Python and at least one JVM or systems language.
• Deep experience with modern data processing frameworks such as Spark, Ray, or Beam.
• Hands-on experience operating petabyte-scale storage and pipeline systems.

Responsibilities

• Build and operate large-scale data systems powering AI training and evaluation pipelines.
• Ingest, transform, quality assure, and manage data lineage for training jobs.
• Contribute to data infrastructure choices impacting model quality and training efficiency.

Skills

Python

Java/Scala

Spark

Ray

Beam

Petabyte-scale storage

Tools

Spark

Ray

Beam

Job description

Bright Vision Technologies is seeking a Data Engineering Specialist – AI to build and operate large-scale data systems powering modern AI training and evaluation pipelines. The role emphasizes ingestion, transformation, data quality, lineage, and high-throughput delivery of data to training jobs across modalities.

The ideal candidate has 6+ years of data engineering experience, strong Python skills, and experience with Spark, Ray, or Beam, plus petabyte-scale storage and pipelines.