Remote AI Data Engineering Specialist - Scalable Pipelines

Bright Vision Technologies; Durham (NC); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking a Data Engineering Specialist – AI to build and operate the large-scale data systems powering AI training pipelines. You will focus on ingestion, transformation, quality assurance, lineage, and high-throughput data delivery to training jobs across multimodal data.

Candidates should have strong Python and JVM experience, plus hands-on work with Spark, Ray, or Beam, and petabyte-scale storage systems.

Qualifications

• 6+ years of data engineering experience with ML or AI workloads.
• Proficient in Python and at least one JVM language.
• Experience with Spark, Ray, or Beam.

Responsibilities

• Build and operate large-scale data systems powering AI training and evaluation pipelines.
• Focus on ingestion, transformation, quality assurance, lineage, and high-throughput delivery of data to training jobs across diverse modalities.
• Experience operating petabyte-scale storage and pipeline systems.

Skills

Python

Java

Spark

Ray

Beam

Petabyte storage

AI workloads

Job description

Bright Vision Technologies is seeking a Data Engineering Specialist – AI to build and operate the large-scale data systems powering AI training pipelines. You will focus on ingestion, transformation, quality assurance, lineage, and high-throughput data delivery to training jobs across multimodal data.

Candidates should have strong Python and JVM experience, plus hands-on work with Spark, Ray, or Beam, and petabyte-scale storage systems.