Remote AI Data Engineer - Large-Scale Data Pipelines

Bright Vision Technologies; Piscataway Township (NJ); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems powering AI training and evaluation pipelines in a 100% remote USA role.

The role requires 10+ years in data engineering, strong Python and JVM language skills, and hands-on experience with Spark, Ray, or Beam, plus petabyte-scale storage and data pipelines. Collaborate with ML researchers to ensure data quality and reproducibility.

Qualifications

• Ten+ years of data engineering experience, with ML/AI workload support.
• Proficiency in Python and at least one JVM/systems language.
• Experience with Spark, Ray, or Beam.
• Experience operating petabyte-scale storage and pipelines.
• Strong understanding of distributed systems and data modeling.
• Experience with dataset versioning and reproducibility for ML workflows.
• Experience with CI/CD and testing.

Responsibilities

• Design and operate large-scale data pipelines for AI training and evaluation.
• Build ingestion systems for multimodal data (text, image, audio, video, structured).
• Implement data cleaning, deduplication, filtering, and quality controls at petabyte scale.
• Develop dataset versioning and provenance tracking for reproducible ML workflows.
• Build high-throughput data loading systems to maximize GPU utilization during training.
• Implement labeling workflows, active learning, and human-in-the-loop data improvement systems.
• Design storage architectures balancing cost, throughput, and latency across data tiers.
• Build evaluation dataset construction pipelines with integrity and contamination controls.
• Implement data privacy, redaction, and consent enforcement across pipelines.
• Collaborate with ML researchers and engineers to align data systems with model needs.
• Drive observability of data quality, drift, and pipeline health across the data estate.
• Optimize cost and performance through compression, format selection, and caching.
• Document data systems, schemas, and procedures for broad internal use.
• Stay current with AI data infrastructure research and open-source tools.

Skills

Python

Java/Scala

Distributed systems

Data modeling

CI/CD

Communication

Big data concepts

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Spark

Ray

Beam

Job description

Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems powering AI training and evaluation pipelines in a 100% remote USA role.

The role requires 10+ years in data engineering, strong Python and JVM language skills, and hands-on experience with Spark, Ray, or Beam, plus petabyte-scale storage and data pipelines. Collaborate with ML researchers to ensure data quality and reproducibility.