Senior AI Data Engineer - Remote Data Pipelines Lead

Bright Vision Technologies; East Brunswick Township (NJ); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems powering AI training and evaluation. You will handle ingestion, transformation, quality, lineage, and high-throughput delivery across multimodal data to training jobs.

The ideal candidate has 10+ years in data engineering, strong Python and JVM/system language skills, and experience with Spark, Ray, or Beam, plus petabyte-scale storage experience. Remote US-based role.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 10+ years of data engineering experience, with ML/AI workloads.
• Strong Python proficiency and at least one JVM or systems language.
• Experience with Spark, Ray, or Beam; petabyte-scale storage and pipelines.
• Knowledge of dataset versioning, lineage, and reproducibility; CI/CD.

Responsibilities

• Design and operate large-scale data pipelines for AI training and evaluation.
• Build ingestion systems for text, image, audio, video, and structured data.
• Implement data cleaning, deduplication, and QA at petabyte scale.
• Develop dataset versioning, lineage, and provenance tracking.
• Maximize GPU utilization with high-throughput data loading.
• Implement labeling workflows and active learning pipelines.
• Design cost-efficient storage architectures and caching strategies.
• Document data systems and promote reproducibility across teams.
• Collaborate with ML researchers to align data needs with model development.
• Maintain data privacy, redaction, and consent controls.

Skills

Python

Distributed systems

CI/CD

Cross-functional collaboration

Education

Bachelor’s or Master’s in CS

Tools

Spark

Ray

Beam

Hadoop

Job description

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems powering AI training and evaluation. You will handle ingestion, transformation, quality, lineage, and high-throughput delivery across multimodal data to training jobs.

The ideal candidate has 10+ years in data engineering, strong Python and JVM/system language skills, and experience with Spark, Ray, or Beam, plus petabyte-scale storage experience. Remote US-based role.