Remote AI Data Engineer for Petabyte-Scale ML Pipelines

Socket.dev; Ann Arbor (MI); On-site; USD 80,000 - 100,000; Full time

Job summary

Bright Vision Technologies seeks an AI Data Engineer to design, build, and operate large-scale data systems powering AI training and evaluation. You will focus on ingestion, transformation, quality, lineage, and high-throughput data delivery to training jobs across modalities.

The ideal candidate has 6+ years in data engineering for ML/AI, with strong Python and JVM language skills and experience with Spark, Ray, or Beam, and petabyte-scale storage.

Qualifications

• Bachelor’s or Master’s in Computer Science or a related field.
• 6+ years of data engineering experience with ML/AI workloads.
• Strong Python and JVM or systems language proficiency.
• Experience with Spark, Ray, or Beam, and petabyte-scale systems.

Responsibilities

• Build and operate large-scale data systems powering AI training and evaluation pipelines.
• Ingest, transform, QA, lineage, and deliver data for training jobs across modalities.
• Apply strong software engineering practices including testing, CI/CD, and code reviews.

Skills

Python

Java/Scala

Distributed systems

Data modeling

High-throughput loading

CI/CD

Testing

Code review

Data provenance

Communication

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Spark

Ray

Beam

Job description

Bright Vision Technologies seeks an AI Data Engineer to design, build, and operate large-scale data systems powering AI training and evaluation. You will focus on ingestion, transformation, quality, lineage, and high-throughput data delivery to training jobs across modalities.

The ideal candidate has 6+ years in data engineering for ML/AI, with strong Python and JVM language skills and experience with Spark, Ray, or Beam, and petabyte-scale storage.