Remote AI Data Pipeline Engineer - Scale ML Workloads

Taswiq4me; United States; Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Pipeline Engineer to build and operate large-scale data systems powering AI training and evaluation. You will design ingestion, transformation, and quality assurance for multimodal data and ensure scalable, high-throughput pipelines.

Ideal candidates bring 6+ years in data engineering, strong Python and distributed systems skills, and experience with Spark, Ray, or Beam, plus dataset versioning and governance for reproducible ML workflows.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• Six+ years of data engineering experience, with ML/AI workloads.
• Proficient in Python and at least one JVM or systems language.
• Experience with Spark, Ray, or Beam.
• Experience with petabyte-scale storage and pipelines.
• Strong understanding of distributed systems and data modeling.
• Experience with dataset versioning and reproducibility for ML workflows.
• Familiarity with CI/CD and testing practices.
• Excellent communication and cross-functional collaboration skills.

Responsibilities

• Design and operate large-scale data pipelines supporting AI training and evaluation.
• Build ingestion systems for multimodal data (text, image, audio, video, structured signals).
• Ensure data quality, deduplication, filtering, and provenance at scale.
• Develop dataset versioning, lineage, and reproducibility for ML workflows.
• Build high-throughput data loading to maximize GPU utilization during training.
• Implement labeling workflows and human-in-the-loop data improvement systems.
• Design storage architectures balancing cost, throughput, and latency.
• Document data systems, schemas, and operational procedures.

Skills

Python

Distributed systems

Data engineering

Data pipelines

CI/CD

Communication

Education

Bachelor’s or Master’s in Computer Science

Tools

Spark

Ray

Beam

Petabyte-scale storage

Job description

Bright Vision Technologies is seeking an AI Pipeline Engineer to build and operate large-scale data systems powering AI training and evaluation. You will design ingestion, transformation, and quality assurance for multimodal data and ensure scalable, high-throughput pipelines.

Ideal candidates bring 6+ years in data engineering, strong Python and distributed systems skills, and experience with Spark, Ray, or Beam, plus dataset versioning and governance for reproducible ML workflows.