Principal Data Platform Architect — Iceberg/Trino Lakehouse

Innovaccer Inc.; Northern (KY); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Generous paid time off

Parental leave

Recognition & rewards

Comprehensive insurance coverage

Job summary

Innovaccer Inc. is seeking a Principal Software Engineer to own the lakehouse architecture for an on-premise data platform. You will design Iceberg table layouts, Trino topology, and a REST catalog service, with Spark-based transforms and S3 storage.

The role requires deep distributed SQL knowledge and a track record of large-scale data systems. You will guide on-premise replacements for cloud-equivalent features, run PoC validations, and set platform standards.

Qualifications

• 12+ years of experience building and operating large-scale data platforms or distributed systems.
• Deep hands-on expertise with distributed SQL engines (Trino/Presto or Spark SQL internals).
• Production experience with Apache Iceberg and table maintenance at scale.
• Experience with Iceberg catalog services and S3-compatible storage.
• Proficiency in Java and/or Python.

Responsibilities

• Own the lakehouse reference architecture: Iceberg table design, Trino topology, catalog service, Spark transform compute, storage layout.
• Design on-premise replacements for cloud warehouse capabilities and develop operational stores.
• Run PoC validation of catalog and query engine at expected data volumes and define placement decisions.
• Set platform-wide standards for table layout, partitioning, file sizing, and Iceberg maintenance tasks.
• Lead SQL dialect strategy for porting workloads to Trino and Spark SQL.
• Mentor senior engineers and review designs to raise engineering quality.
• Partner with platform engineering on storage sizing, resource isolation, and capacity planning.

Skills

Distributed SQL engines

Java

Python

Data platform design

Mentoring/leadership

Education

B.E./B.Tech./M.Sc. in Computer Science

Tools

Apache Iceberg

Trino/Presto

Spark SQL

Iceberg catalog services (Polaris/Nessie/Hive Metastore)

S3 object storage

Job description

Innovaccer Inc. is seeking a Principal Software Engineer to own the lakehouse architecture for an on-premise data platform. You will design Iceberg table layouts, Trino topology, and a REST catalog service, with Spark-based transforms and S3 storage.

The role requires deep distributed SQL knowledge and a track record of large-scale data systems. You will guide on-premise replacements for cloud-equivalent features, run PoC validations, and set platform standards.