Senior Data Platform Engineer - Multimodal Pipelines & AI

bareinsights; Los Angeles (CA); On-site; USD 130,000 - 200,000; Full time

Job summary

Bareinsights is seeking a senior software engineer to own the core data platform that ingests, enriches, and delivers large-scale multimodal data for AI labs. You will design end-to-end video processing pipelines, build in-house infrastructure, and develop marketplace features for datasets, with a focus on reliability and performance.

You will work across backend, frontend, and data-heavy systems, using Python, Kafka, Kubernetes, and AWS.

Qualifications

• 5+ years of production software engineering experience spanning backend, frontend, and data-heavy systems.
• Hands-on experience building multimodal data ingestion and orchestration pipelines at scale.
• Production video processing experience: FFmpeg, transcoding, HLS, and streaming formats.
• Strong Python backend skills with FastAPI or Django, and PostgreSQL in production.
• Production experience with Kafka and Kubernetes.
• Microservices architecture, API design, and signal processing at scale.
• Comfortable building custom in-house infrastructure rather than defaulting to managed services.
• Familiarity with Next.js, AWS.
• Background at an AI training data platform is a strong plus.
• Combined ML/AI enrichment and full-stack engineering experience is a plus.
• STEM degree (bachelor’s minimum; master’s preferred — non-CS disciplines such as mathematics, physics, or biology are a positive signal).

Responsibilities

• Build high-throughput video processing pipelines covering transcoding, HLS packaging, depth-map rendering, frame-accurate synchronization, and GPU-accelerated media workflows.
• Own ingestion and processing pipelines for video, 3D assets, depth maps, telemetry, annotations, metadata, and model-generated signals.
• Design and build event-driven workloads on Kafka and Kubernetes spanning capture, processing, enrichment, QA, packaging, and delivery.
• Build AI enrichment systems for scoring, metadata extraction, classification, quality review, redundancy detection, and dataset recommendations.
• Develop internal tools for capture teams, reviewers, operators, and data managers to track, inspect, and assemble datasets.
• Build customer-facing marketplace features enabling AI labs to search, preview, query, purchase, and receive datasets.
• Design data models covering provenance, asset versioning, licensing state, QA state, delivery history, and customer entitlements.
• Instrument monitoring and analytics to understand quality, throughput, bottlenecks, and dataset value.

Skills

Multimodal data ingestion

Backend & full-stack engineering

Python development

API design

Microservices architecture

Signal processing

In-house infrastructure

Data-heavy systems

Education

Bachelor’s degree in STEM

Master’s preferred (non-CS disciplines welcomed)

Tools

FFmpeg

Kafka

Kubernetes

Next.js

AWS

PostgreSQL

FastAPI

Django

Job description

Bareinsights is seeking a senior software engineer to own the core data platform that ingests, enriches, and delivers large-scale multimodal data for AI labs. You will design end-to-end video processing pipelines, build in-house infrastructure, and develop marketplace features for datasets, with a focus on reliability and performance.

You will work across backend, frontend, and data-heavy systems, using Python, Kafka, Kubernetes, and AWS.