Lead Data Architect for Multimodal ML Pipelines — Remote

Pika; Palo Alto (CA); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive salary

Full health benefits

401k matching

Flexible on-site/remote hybrid

Job summary

Pika in Palo Alto is searching for a staff or lead-level Research Engineer, Data to architect and scale data engineering systems crucial for model training. The successful candidate will own the design of large-scale data pipelines while ensuring high-quality and diverse datasets access.

With a commitment to innovative research-engineering, Pika offers a collaborative environment, competitive salary, equity in a growing startup, and great health benefits.

Qualifications

• 5+ years of experience in data pipeline architecture and implementation.
• Strong knowledge of privacy, compliance, and ethics in data management.
• Ability to collaborate across functions and solve problems effectively.

Responsibilities

• Take ownership of data pipeline architecture for multi-modal model training.
• Manage diverse datasets for pre- and mid-training of models.
• Ensure compliance and quality of data throughout its lifecycle.
• Optimize data processing for distributed training pipelines.

Skills

Building and scaling data pipelines for machine learning applications

Data engineering and ML data curation for LLMs

Distributed data systems expertise (e.g., Spark, Hadoop)

Strong programming skills (Python, SQL, PySpark)

Data quality assurance and dataset management

Collaboration and communication skills

Tools

AWS

GCP

Azure

Job description

Pika in Palo Alto is searching for a staff or lead-level Research Engineer, Data to architect and scale data engineering systems crucial for model training. The successful candidate will own the design of large-scale data pipelines while ensuring high-quality and diverse datasets access.

With a commitment to innovative research-engineering, Pika offers a collaborative environment, competitive salary, equity in a growing startup, and great health benefits.