Remote ML Data Engineer: AI Pipelines at Scale

United States Digital Space LLC; United States; Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies seeks a Machine Learning Data Engineer to build and operate large-scale data systems powering AI training and evaluation pipelines. You will focus on ingestion, transformation, quality assurance, lineage, and high-throughput data delivery across modalities.

The ideal candidate has 6+ years in data engineering for ML/AI, strong Python and JVM skills, and deep knowledge of Spark, Ray, or Beam and petabyte-scale storage. This role is remote within the United States.

Qualifications

• Six or more years of data engineering experience, with significant ML/AI workload support.
• Proficiency in Python and at least one JVM language.
• Experience with Spark, Ray, or Beam and petabyte-scale storage.
• Strong distributed systems, data modeling, and ML reproducibility knowledge.
• Proficient in software engineering practices including testing and CI/CD.

Responsibilities

• Design and operate large-scale data pipelines powering AI training, evaluation, and continual improvement workflows.
• Build ingestion systems for diverse modalities including text, image, audio, video, and structured signals.
• Implement data cleaning, deduplication, filtering, and quality assurance at petabyte scale.
• Develop dataset versioning, lineage, and provenance tracking systems suitable for reproducible training.
• Build high-throughput data loading systems that maximize GPU utilization during training.
• Implement labeling workflows, active learning pipelines, and human-in-the-loop data improvement systems.
• Design storage architectures balancing cost, throughput, and latency across data tiers.
• Build evaluation dataset construction pipelines with strict integrity and contamination controls.
• Implement data privacy, redaction, and consent enforcement throughout the pipeline.
• Collaborate with ML researchers and engineers to align data systems with model development needs.
• Drive observability of data quality, drift, and pipeline health across the AI data estate.
• Optimize cost and performance through compression, format selection, and caching strategies.
• Document data systems, schemas, and operational procedures for broad internal use.
• Stay current with AI data infrastructure research and emerging open-source tools.

Skills

Python

JVM language

Data engineering

CI/CD

Communication

Tools

Spark

Ray

Beam

Job description

Bright Vision Technologies seeks a Machine Learning Data Engineer to build and operate large-scale data systems powering AI training and evaluation pipelines. You will focus on ingestion, transformation, quality assurance, lineage, and high-throughput data delivery across modalities.

The ideal candidate has 6+ years in data engineering for ML/AI, strong Python and JVM skills, and deep knowledge of Spark, Ray, or Beam and petabyte-scale storage. This role is remote within the United States.