Data Platform Reliability Engineer - Spark & Flink

AppLab Systems, Inc; Sunnyvale (CA); On-site; USD 140,000 - 180,000; Full time

Job summary

AppLab Systems, Inc. in Sunnyvale, CA, seeks a Data Platform Reliability Software Engineer to design, implement and optimize batch Spark and streaming Flink pipelines, leveraging Kafka, Iceberg and Cassandra for scalable data processing.

You will also manage data platform infra including Airflow, EKS, Superset and Trino, ensuring reliability, observability and performance across the data stack.

Qualifications

• Experience building batch data pipelines with Spark.
• Experience designing streaming pipelines with Flink.
• Knowledge of Kafka-based data streams and Iceberg tables.

Responsibilities

• Create/maintain batch (Spark) and stream (Flink) jobs.
• Manage data platform infrastructure including Airflow, EKS, Superset, and Trino.

Skills

Spark

Flink

Kafka

Iceberg

Cassandra

Airflow

EKS

Superset

Trino

Job description

AppLab Systems, Inc. in Sunnyvale, CA, seeks a Data Platform Reliability Software Engineer to design, implement and optimize batch Spark and streaming Flink pipelines, leveraging Kafka, Iceberg and Cassandra for scalable data processing.

You will also manage data platform infra including Airflow, EKS, Superset and Trino, ensuring reliability, observability and performance across the data stack.