Lakehouse Data Platform Engineer – Spark & ClickHouse

Cato Networks; United States; On-site; USD 130,000 - 170,000; Full time

Job summary

Cato Networks is seeking an experienced Software Engineer to join the Data Platform Group, building a cloud-based data platform with microservices and data pipelines processing about 1M records/sec at low latency.

You will own the lakehouse data layer, batch processing over the data lake with Spark on EMR, and APIs for customers and internal teams. Collaboration with product, DevOps, and security is essential.

Qualifications

• 5+ years designing and building large-scale distributed data systems with emphasis on performance.
• Expert in at least one: ClickHouse, Spark, Iceberg/Delta/Hudi, or Parquet/S3 with SQL engines.
• Strong Java and OO design skills; experience with microservices on Kubernetes.
• Hands-on AWS experience, especially EMR, S3, and Glue.
• Excellent collaboration and communication; fast learner; team player.

Responsibilities

• Own end-to-end analytical storage layer design, partitioning, and performance.
• Design and develop batch processing over data lake using Spark on EMR (Java/PySpark).
• Build Java/Spring Boot services exposing data via APIs.
• Optimize queries, file layout, and storage cost at scale.
• Research lakehouse tech and adapt for product use.
• Collaborate with product, DevOps, and security teams.

Job description

Cato Networks is seeking an experienced Software Engineer to join the Data Platform Group, building a cloud-based data platform with microservices and data pipelines processing about 1M records/sec at low latency.

You will own the lakehouse data layer, batch processing over the data lake with Spark on EMR, and APIs for customers and internal teams. Collaboration with product, DevOps, and security is essential.