Remote Infra Reliability Engineer - AI Data Pipelines

Bright Vision Technologies; Leander (TX); Remote; USD 125,000 - 170,000; Full time

Job summary

Bright Vision Technologies is seeking an Infrastructure Reliability Engineer to design and operate petabyte-scale data pipelines powering AI training and evaluation across a remote U.S. footprint.

The role blends data engineering and software fundamentals to ensure high-throughput data delivery and quality across diverse modalities. The ideal candidate has 6+ years of experience, deep Python and JVM expertise, and hands-on work with Spark, Ray, or Beam.

Qualifications

• Six or more years of data engineering experience, with significant work supporting ML or AI workloads.
• Strong proficiency in Python and at least one JVM or systems language.
• Deep experience with modern data processing frameworks such as Spark, Ray, or Beam.
• Hands-on experience operating petabyte-scale storage and pipeline systems.
• Strong understanding of distributed systems, data modeling, and storage formats.
• Experience with dataset versioning, lineage, and reproducibility for ML workflows.
• Familiarity with high-throughput data loading for accelerator-based training.
• Strong software engineering practices including testing, CI/CD, and code review.
• Excellent communication and cross-functional collaboration skills.

Responsibilities

• Design and operate large-scale data pipelines supporting AI training, evaluation, and continual improvement workflows.
• Build ingestion systems for diverse modalities including text, image, audio, video, and structured signals.
• Implement data cleaning, deduplication, filtering, and quality assurance at petabyte scale.
• Develop dataset versioning, lineage, and provenance tracking systems suitable for reproducible training.
• Build high-throughput data loading systems that maximize GPU utilization during training.
• Implement labeling workflows, active learning pipelines, and human-in-the-loop data improvement systems.
• Design storage architectures balancing cost, throughput, and latency across data tiers.
• Build evaluation dataset construction pipelines with strict integrity and contamination controls.
• Implement data privacy, redaction, and consent enforcement throughout the pipeline.
• Collaborate with ML researchers and engineers to align data systems with model development needs.
• Drive observability of data quality, drift, and pipeline health across the AI data estate.
• Optimize cost and performance through compression, format selection, and caching strategies.
• Document data systems, schemas, and operational procedures for broad internal use.
• Stay current with AI data infrastructure research and emerging open-source tools.

Skills

Python

JVM language

Distributed systems

ML/AI workloads understanding

Cross-functional collaboration

Testing CI/CD

Education

Bachelor’s or Master’s degree in Computer Science

Tools

Spark

Ray

Beam

Petabyte-scale storage

Data pipelines

Job description

Bright Vision Technologies is seeking an Infrastructure Reliability Engineer to design and operate petabyte-scale data pipelines powering AI training and evaluation across a remote U.S. footprint.

The role blends data engineering and software fundamentals to ensure high-throughput data delivery and quality across diverse modalities. The ideal candidate has 6+ years of experience, deep Python and JVM expertise, and hands-on work with Spark, Ray, or Beam.