Staff Data Platform Engineer - Multimodal Data, AWS & DBT

Jobgether; United States; Remote; USD 176,000 - 230,000; Full time

Benefits offered by this job

Equity program

Health insurance (medical)

HSA/FSA

Retirement plan

Paid parental leave

Flexible time off

Work equipment provided

Open salary discussions

Job summary

Jobgether is seeking a senior data platform engineer to own our data platform end to end, from cloud infrastructure to data models and research pipelines. You will implement lakehouse architectures on AWS, maintain data quality, and build scalable pipelines for multimodal datasets.

Ideal candidates have 6+ years of production data platform experience, strong SQL/Python, and familiarity with Spark, dbt, and Kubernetes-based orchestration.

Qualifications

• At least 6 years building and operating production data platforms.
• Experience integrating SaaS business systems (Stripe, HubSpot, ERP, identity) into a centralized data warehouse.
• Experience with large-scale multimodal datasets and HPC/cloud schedulers (SLURM, Kubernetes).
• Expert-level SQL and Python with strong CI/CD practices.
• Knowledge of AWS, Kubernetes, EKS, Helm, Terraform for production deployments.
• Ability to work autonomously in a small team and own end-to-end production systems.
• Ability to interpret data, communicate limitations, and explain metrics clearly.

Responsibilities

• Own and maintain the data platform end to end, including cloud infrastructure, data lake, and warehouse models.
• Build integrations across billing, CRM, ERP, identity, and telemetry systems to reconcile revenue and usage data.
• Develop data contracts, quality tests, lineage tracking, and data catalog documentation.
• Enforce PII access controls and data classification with Security and Legal teams.
• Process billions of telemetry records and optimize Iceberg tables and partitioning for cost and speed.
• Manage orchestration on Kubernetes/EKS with Helm, Terraform, and CI/CD pipelines.
• Participate in on-call rotations and troubleshoot production data pipelines.
• Deliver operational reporting for Finance and leadership on revenue, credits, and cloud spend.
• Support research teams with sourcing and versioning large training datasets across modalities.
• Build scalable pipelines for media generation and captioning for training data shards.
• Maintain dataset lineage and documentation for reproducibility.
• Lead design reviews, mentor teammates, and develop runbooks for resilience.
• Collaborate with Finance, Marketing, SRE, Security, Product, and Research.

Skills

SQL

Python

Automated testing

CI/CD

Data modeling

Production infrastructure

Kubernetes

AWS

Data governance

Analytical thinking

Tools

Iceberg/Delta Lake on S3

Athena/Trino

dbt

Snowflake/BigQuery

Spark

Airflow/Argo

Kubernetes/EKS

Terraform

Helm

Job description

Jobgether is seeking a senior data platform engineer to own our data platform end to end, from cloud infrastructure to data models and research pipelines. You will implement lakehouse architectures on AWS, maintain data quality, and build scalable pipelines for multimodal datasets.

Ideal candidates have 6+ years of production data platform experience, strong SQL/Python, and familiarity with Spark, dbt, and Kubernetes-based orchestration.