Data Platform Tech Lead and Manager - Spark, Iceberg

FloQast; San Jose (CA); On-site; USD 188,000 - 282,000; Full time

Benefits offered by this job

Medical

Dental

Vision

Family Forming benefits

Life & Disability Insurance

Unlimited Vacation

Job summary

FloQast is seeking an Engineering Manager for the Data Platform team to lead a high‑performing group of engineers responsible for data ingestion, governance, storage, processing, and access across FloQast’s product and analytics systems.

This deeply technical role blends hands‑on coding and architecture decisions with people leadership—from hiring to roadmapping—ensuring scalable, reliable data platforms for thousands of tenants.

Qualifications

• 12+ years of software engineering experience in data infrastructure, distributed systems, or backend platform engineering.
• Hands‑on production experience with Spark and tuning PySpark vs Scala Spark.
• Familiarity with lakehouse stack: Iceberg, Kafka/MSK, Airflow/MWAA, Trino or Athena; cloud‑native AWS services
• Experience with Snowflake, dbt, and building data access APIs or platform tooling
• 2+ years of engineering management or formal tech lead experience
• Strong communicator who can explain trade-offs to product and business stakeholders
• Experience in a startup or high‑growth SaaS environment
• Exposure to AI/ML data pipelines or real‑time analytics is a plus

Responsibilities

• Write production code and lead architectural design on the data platform — pipelines, storage layers, access APIs, and observability infrastructure.
• Own technical decisions on Spark job structure, Iceberg table management, and streaming architecture on MSK/Kafka.
• Review code and shape how the team thinks about distributed systems.
• Drive modernization and tooling choices with a bias toward operational simplicity and long‑term maintainability.
• Contribute to data governance: quality frameworks, lineage, access control, and compliance (GDPR, SOC2).
• Work shoulder‑to‑shoulder with engineers on the hardest problems — design docs, code reviews, incident calls.

Job description

FloQast is seeking an Engineering Manager for the Data Platform team to lead a high‑performing group of engineers responsible for data ingestion, governance, storage, processing, and access across FloQast’s product and analytics systems.

This deeply technical role blends hands‑on coding and architecture decisions with people leadership—from hiring to roadmapping—ensuring scalable, reliable data platforms for thousands of tenants.