Remote AI Data Engineer — Petabyte-Scale Pipelines Expert

Bright Vision Technologies; Monroeville (Allegheny County); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Data Engineer to build and operate the large-scale data systems powering AI training and evaluation pipelines. The role requires deep data engineering expertise and a strong understanding of AI workloads across diverse modalities.

The ideal candidate has experience with petabyte-scale data, modern data processing frameworks, and solid software engineering practices. This is a full-time, direct W2 position with remote work in the U.S.

Qualifications

• Bachelor’s or Master’s degree in CS or related field is required.
• 10+ years of data engineering experience, with ML/AI workload support.
• Strong Python skills and at least one JVM language.

Responsibilities

• Design and operate large-scale data pipelines for AI training and evaluation.
• Build ingestion systems for text, image, audio, video, and structured data.
• Implement data cleaning, deduplication, and quality checks at petabyte scale.
• Develop dataset versioning, lineage, and provenance for reproducible training.
• Build high-throughput data loading to maximize GPU utilization.
• Implement labeling workflows and active learning pipelines.
• Design storage architectures balancing cost, throughput, and latency.
• Ensure data privacy, redaction, and consent enforcement across pipelines.
• Collaborate with ML researchers to align data systems with model needs.
• Drive observability of data quality, drift, and pipeline health.

Skills

Python

JVM languages

Spark

Ray

Beam

Petabyte storage

Distributed systems

Data modeling

Storage formats

Dataset versioning

Data lineage

Reproducibility

High-throughput data loading

CI/CD

Testing

Code review

Communication

Education

Bachelor’s or Master’s degree in Computer Science or related field

Job description

Bright Vision Technologies is seeking an AI Data Engineer to build and operate the large-scale data systems powering AI training and evaluation pipelines. The role requires deep data engineering expertise and a strong understanding of AI workloads across diverse modalities.

The ideal candidate has experience with petabyte-scale data, modern data processing frameworks, and solid software engineering practices. This is a full-time, direct W2 position with remote work in the U.S.