Lakehouse Data Platform Engineer on Kubernetes (Azure)

United Software Group Inc; San Jose (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

United Software Group Inc is seeking a Senior Data Platform Engineer to design, deploy, and operate a lakehouse data platform on Kubernetes in Microsoft Azure. You’ll own the infrastructure behind Apache Iceberg, Trino and Spark, partnering with data engineers and analysts to maintain performance, reliability, and cost efficiency.

Key responsibilities include deploying services on AKS/Azure, managing Iceberg on ADLS, tuning Trino/Spark, building DBT pipelines, and enforcing data governance with

Qualifications

• Must design and operate scalable data platform infrastructure.
• Experience with lakehouse architectures and query optimization.
• Strong hands-on with Kubernetes in cloud environments.

Responsibilities

• Deploy and operate data platform services on Kubernetes in Azure.
• Build and manage Iceberg lakehouse infrastructure on ADLS (catalog, table maintenance, schema evolution, partitioning).
• Operate and tune Trino and Spark clusters; build DBT transformation pipelines.

Skills

Cloud architecture

Data governance

SQL performance tuning

Distributed systems

Infra as code

Tools

Kubernetes

Apache Iceberg

Trino

Spark

DBT

Azure Data Lake Storage

Job description

United Software Group Inc is seeking a Senior Data Platform Engineer to design, deploy, and operate a lakehouse data platform on Kubernetes in Microsoft Azure. You’ll own the infrastructure behind Apache Iceberg, Trino and Spark, partnering with data engineers and analysts to maintain performance, reliability, and cost efficiency.

Key responsibilities include deploying services on AKS/Azure, managing Iceberg on ADLS, tuning Trino/Spark, building DBT pipelines, and enforcing data governance with