Lead Data Engineer for Multimodal AI Pipelines (Remote)

Pika; United States; Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive salary

Equity

Health benefits

401k matching

Flexible hybrid work

Job summary

Pika is hiring a staff or lead Research Engineer, Data to architect and scale data pipelines for multimodal foundation models. You will collaborate with research and engineering to curate diverse datasets and build robust ML data infrastructure.

Responsibilities include end-to-end data ingestion, labeling tools, and privacy considerations, with a strong emphasis on production-ready systems. This remote-friendly role supports US-based applicants from a company focused on real-time multimodal

Qualifications

• 5+ years of experience building and scaling data pipelines for ML applications at staff or lead level.
• Strong background in data engineering and ML data curation for LLMs/VLMs.
• Expertise in distributed data systems (e.g., Spark, Hadoop, Ray).
• Proven ability to build robust, scalable data infrastructure for ML pipelines.
• Experience developing tools for data labeling, filtering, deduplication, QA, and dataset management.
• Strong programming skills (Python, SQL, PySpark).
• Knowledge of privacy, compliance, ethics in data collection and management.
• Excellent cross-functional collaboration and communication skills.
• Passion for enabling cutting-edge generative AI through data excellence.

Responsibilities

• Take ownership of large-scale data pipeline architecture and implementation supporting model training and research workflows for multimodal datasets.
• Partner with research and engineering teams to curate and manage diverse datasets for pre-training and mid-training.
• Develop strategies and tools for scalable data ingestion, labeling, filtering, augmentation, and storage.
• Ensure data quality, reliability, and privacy/compliance across the data lifecycle.
• Optimize data processing and delivery for large-scale distributed training pipelines.
• Prototype and productionize new methods for dataset creation and management.
• Integrate research-driven data advancements into production-ready systems.
• Stay updated on emerging data engineering and ML data management developments.

Skills

Data pipelines for ML

ML data curation

Distributed data systems

Data infrastructure

Data labeling tools

Python/SQL/PySpark

Data privacy/ethics

Collaboration

Generative AI data

Tools

Spark

Hadoop

Ray

PySpark

AWS

GCP

Azure

Python

SQL

Job description

Pika is hiring a staff or lead Research Engineer, Data to architect and scale data pipelines for multimodal foundation models. You will collaborate with research and engineering to curate diverse datasets and build robust ML data infrastructure.

Responsibilities include end-to-end data ingestion, labeling tools, and privacy considerations, with a strong emphasis on production-ready systems. This remote-friendly role supports US-based applicants from a company focused on real-time multimodal