Azure Data Platform Engineer: Kubernetes, Iceberg & Trino

Artifintech; Sunnyvale (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

Artifintech in Sunnyvale, CA, seeks a data platform engineer to design, deploy, and operate scalable data services on Kubernetes in Azure. You will build lakehouse infrastructure on Apache Iceberg backed by ADLS and optimize queries with Trino and Spark.

You will implement DBT pipelines, enforce data governance, and establish observability, security, and cost controls while collaborating with platform teams to onboard workloads and automate deployments via IaC and CI/CD.

Qualifications

• Hands-on experience with Kubernetes deployments and operations.
• Hands-on experience with Microsoft Azure Cloud, including ADLS.
• Experience with Apache Iceberg and Iceberg catalogs REST.
• Expertise with Trino and Spark for distributed query/compute.
• Hands-on with DBT for data transformation and analytics engineering.
• Solid understanding of data lake and lakehouse architectures and file formats.

Responsibilities

• Design, deploy, and operate data platform services on Kubernetes in Azure.
• Build and manage lakehouse infrastructure on Iceberg backed by ADLS.
• Operate and tune Trino and Spark clusters for performance and cost.
• Develop data transformation pipelines using DBT with testing and docs.
• Define data access, security, governance, and multi-tenant resource mgmt.
• Implement observability: monitoring, alerting, capacity planning, incident response.
• Collaborate with data engineers, analysts, and platform teams to onboard workloads.
• Automate infrastructure and deployments using IaC and CI/CD.

Skills

Kubernetes

Azure Cloud

Data lake concepts

Tools

Apache Iceberg

Trino

Spark

DBT

ADLS

Parquet/ORC formats

Job description

Artifintech in Sunnyvale, CA, seeks a data platform engineer to design, deploy, and operate scalable data services on Kubernetes in Azure. You will build lakehouse infrastructure on Apache Iceberg backed by ADLS and optimize queries with Trino and Spark.

You will implement DBT pipelines, enforce data governance, and establish observability, security, and cost controls while collaborating with platform teams to onboard workloads and automate deployments via IaC and CI/CD.