Senior Data Platform Engineer - Lakehouse & AI Pipelines

Gallatin AI, Inc.; San Francisco (CA); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Stock options

401k plan

Unlimited PTO

Free lunches and snacks

Job summary

Gallatin AI, Inc. is hiring a Senior Data Engineer to design and ship containerized data services and an open lakehouse for mission-critical defense logistics data. You will build transformations and tools that empower SMEs to map sources, test changes, and preview effects in disconnected environments.

You will work across cloud, on-prem, and air-gapped deployments, with a strong emphasis on data quality, lineage, and real-time decision support within Navigator and AI agents.

Qualifications

• Eight plus years of professional data engineering experience with production pipelines.
• Experience with open table formats (Iceberg preferred) and distributed query engines (Trino/Presto/Spark SQL).
• Proven experience with streaming and batch pipelines (Kafka, NiFi, Debezium, Spark).
• Strong Python and SQL, integrating heterogeneous data sources.

Responsibilities

• Design, build, and operate containerized data services and external connections.
• Own an open lakehouse and data catalog; enable federated queries.
• Build transformation pipelines turning raw data into curated semantic entities.
• Develop fullstack tools (TypeScript, Vue, Python) for SMEs to map and test pipelines.

Skills

Python

SQL

Data modeling

Entity resolution

Airflow

Kafka

Kubernetes

Distributed systems

Front-end (Vue/React)

Tools

Apache Iceberg

Trino

Nessie

Docker

Kubernetes

Job description

Gallatin AI, Inc. is hiring a Senior Data Engineer to design and ship containerized data services and an open lakehouse for mission-critical defense logistics data. You will build transformations and tools that empower SMEs to map sources, test changes, and preview effects in disconnected environments.

You will work across cloud, on-prem, and air-gapped deployments, with a strong emphasis on data quality, lineage, and real-time decision support within Navigator and AI agents.