Senior AI Data Engineer — Remote, Petabyte-Scale Pipelines

Bright Vision Technologies; Woodbridge Township (NJ); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems powering AI training across modalities, focusing on ingestion, transformation, quality assurance, lineage, and high-throughput delivery of data to training jobs.

The role requires ten+ years in data engineering for ML/AI workloads, strong Python and JVM skills, and experience with Spark, Ray, or Beam. This is a 100% remote US position with direct W2 employment.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.

Responsibilities

• Design and operate large-scale data pipelines for AI training and evaluation.
• Build ingestion systems for text, image, audio, video, and structured signals.
• Implement data cleaning, deduplication, filtering, and quality assurance at petabyte scale.
• Develop dataset versioning, lineage, and provenance tracking systems for reproducible training.
• Build high-throughput data loading systems to maximize GPU utilization during training.
• Implement labeling workflows, active learning pipelines, and human-in-the-loop data improvement systems.
• Design storage architectures balancing cost, throughput, and latency across data tiers.
• Build evaluation dataset construction pipelines with data integrity and contamination controls.
• Implement data privacy, redaction, and consent enforcement throughout the pipeline.
• Collaborate with ML researchers and engineers to align data systems with model needs.
• Drive observability of data quality, drift, and pipeline health across the AI data estate.
• Optimize cost and performance through compression, format selection, and caching strategies.
• Document data systems, schemas, and operational procedures for broad internal use.
• Stay current with AI data infrastructure research and emerging open-source tools.

Skills

Python

Java

Spark

Ray

Beam

Petabyte-storage

Distributed systems

Data provenance

CI/CD

Data quality

Education

Bachelor’s or Master’s in CS or related

Tools

Kafka

Airflow

Kubernetes

SQL

Job description

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems powering AI training across modalities, focusing on ingestion, transformation, quality assurance, lineage, and high-throughput delivery of data to training jobs.

The role requires ten+ years in data engineering for ML/AI workloads, strong Python and JVM skills, and experience with Spark, Ray, or Beam. This is a 100% remote US position with direct W2 employment.