Staff Data Engineer: Multimodal AI Platform

Jobgether; United States; Vor Ort; USD 176.000 - 230.000; Vollzeit

Benefits dieser Stelle

Annual base salary

Equity

Health insurance

HSA and FSA

Life insurance

Disability coverage

401(k) match

Parental leave

Flexible time off

Work equipment

Transparent compensation

Zusammenfassung

Jobgether is seeking a Staff Software Engineer, Data in the United States to own and evolve a scalable data platform supporting operations and AI research. You will design and operate data infrastructure, connect business systems, and transform complex data into reliable insights.

You will build large pipelines converting raw and synthetic media into high‑quality training data across audio, video, image, and 3D modalities.

Qualifikationen

• 6+ years building and operating production data platforms.
• Experience integrating SaaS systems (Stripe, HubSpot, ERP) into a data warehouse.
• Experience with multimodal training datasets and batch workloads on HPC or cloud schedulers.
• Expert SQL and Python with automated testing and CI/CD.
• Hands-on with data lakes and warehouses (Iceberg/Delta Lake on S3, Athena/Trino, Snowflake/BigQuery, dbt).
• Experience with dbt, Airflow, Argo, Spark, and distributed processing tech.
• Strong knowledge of AWS, Kubernetes, EKS, Terraform; autonomous in small teams.

Aufgaben

• Own data platform end-to-end: cloud infra, integrations, warehouse modeling, and pipelines.
• Build integrations across billing, CRM, ERP, identity, and telemetry systems.
• Develop warehouse models, data contracts, quality tests, lineage, and catalog docs.
• Implement PII access controls and data classification with Security and Legal teams.
• Process billions of telemetry records and terabytes of logs; optimize Iceberg tables and costs.
• Manage orchestration on Kubernetes/EKS with Helm, Terraform, CI/CD, monitoring, alerts.
• Participate in on-call rotation and troubleshoot production data pipelines.
• Deliver finance leadership reports on revenue, credits, and cloud spend.
• Support research teams in sourcing and versioning large training datasets.
• Build pipelines for media generation and captioning; create data shards for SLURM and cloud storage.
• Maintain dataset lineage, quality metrics, and documentation for reproducibility.
• Lead design reviews, mentor teammates, and develop runbooks for resilience.

Kenntnisse

SQL

Python

Data modeling

Airflow

Spark

Kubernetes

AWS

dbt

ETL pipelines

SQL tuning

Tools

dbt

Airflow

Argo

Spark

Iceberg/Delta Lake

S3

HPC/Cloud schedulers

Jobbeschreibung

Jobgether is seeking a Staff Software Engineer, Data in the United States to own and evolve a scalable data platform supporting operations and AI research. You will design and operate data infrastructure, connect business systems, and transform complex data into reliable insights.

You will build large pipelines converting raw and synthetic media into high‑quality training data across audio, video, image, and 3D modalities.