Senior Remote AI Data Pipeline Engineer

Bright Vision Technologies; United States; Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Pipeline Engineer to design and operate large-scale data pipelines powering AI training and evaluation in a 100% remote role within the United States. The ideal candidate has 6+ years of data engineering experience and strong Python plus JVM language skills, with hands-on work on petabyte-scale storage and modern data processing frameworks.

This full-time W2 position emphasizes data quality, lineage, reproducibility, privacy controls, and collaboration

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• Six or more years of data engineering experience with ML/AI workloads.
• Strong proficiency in Python and at least one JVM or systems language.
• Experience with Spark, Ray, or Beam.
• Hands-on experience operating petabyte-scale storage and pipeline systems.
• Strong understanding of distributed systems, data modeling, and storage formats.
• Experience with dataset versioning, lineage, reproducibility for ML workflows.
• Familiarity with high-throughput data loading for accelerator-based training.
• Strong software engineering practices including testing, CI/CD, and code review.
• Excellent communication and cross-functional collaboration skills.

Responsibilities

• Design and operate large-scale data pipelines supporting AI training, evaluation, and continual improvement workflows.
• Build ingestion systems for diverse modalities including text, image, audio, video, and structured signals.
• Implement data cleaning, deduplication, filtering, and quality assurance at petabyte scale.
• Develop dataset versioning, lineage, and provenance tracking systems suitable for reproducible training.
• Build high-throughput data loading systems that maximize GPU utilization during training.
• Implement labeling workflows, active learning pipelines, and human-in-the-loop data improvement systems.
• Design storage architectures balancing cost, throughput, and latency across data tiers.
• Build evaluation dataset construction pipelines with strict integrity and contamination controls.
• Implement data privacy, redaction, and consent enforcement throughout the pipeline.
• Collaborate with ML researchers and engineers to align data systems with model development needs.
• Drive observability of data quality, drift, and pipeline health across the AI data estate.
• Optimize cost and performance through compression, format selection, and caching strategies.
• Document data systems, schemas, and operational procedures for broad internal use.
• Stay current with AI data infrastructure research and emerging open-source tools.

Skills

Python

JVM language

Distributed systems

CI/CD

Communication skills

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Spark

Ray

Beam

Job description

Bright Vision Technologies is seeking an AI Pipeline Engineer to design and operate large-scale data pipelines powering AI training and evaluation in a 100% remote role within the United States. The ideal candidate has 6+ years of data engineering experience and strong Python plus JVM language skills, with hands-on work on petabyte-scale storage and modern data processing frameworks.

This full-time W2 position emphasizes data quality, lineage, reproducibility, privacy controls, and collaboration