AI Data Engineer: Large-Scale Pipelines (Remote)

Bright Vision Technologies; Franklin, Brentwood, Nashville (TN, TN, TN); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

The Data Engineering Specialist – AI will build and operate large-scale data systems powering AI training and evaluation pipelines.

Qualifications

• 6+ years of data engineering experience with ML/AI workloads.
• Strong Python and at least one JVM language.
• Deep experience with data processing frameworks (Spark, Ray, or Beam).
• Hands-on experience operating petabyte-scale storage and pipelines.

Responsibilities

• Build and operate large-scale data systems powering AI training and evaluation pipelines.
• Ingest, transform, and ensure quality and lineage of data for training jobs across modalities.
• Deliver data efficiently to training jobs with high throughput.
• Assess how data infrastructure choices impact model quality and training efficiency.

Skills

Python

Java/JVM

Spark

Ray

Beam

Petabyte storage

Tools

Spark

Ray

Beam

Job description

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

The Data Engineering Specialist – AI will build and operate large-scale data systems powering AI training and evaluation pipelines.