Data Lakehouse Engineer: PB-Scale Open-Source Pipelines

Cylake, Inc; Sunnyvale (CA); On-site; USD 150,000 - 250,000; Full time

Benefits offered by this job

Comprehensive benefits package

Competitive compensation

Job summary

A cybersecurity startup in Sunnyvale is seeking a professional to design, build, and maintain a scalable data lakehouse architecture for analytics workloads. You will architect data pipelines ensuring high performance and quality. Ideal candidates will have a solid background in large-scale data systems, experience with open-source data components, and programming in Python. A competitive compensation package is offered, with a salary range of $150,000 to $250,000 per year.

Qualifications

• Proven track record architecting, building, and running large-scale data systems.
• Experience in batch and real-time processing architectures.
• Experience with open source Data Lakehouse components.

Responsibilities

• Design, build, and maintain scalable data lakehouse architecture.
• Architect end-to-end data pipelines ensuring performance and reliability.

Skills

Large-scale data systems architecture

Batch processing

Real-time processing

Apache Iceberg

PostgreSQL

Neo4j

Apache Parquet

Apache Kafka

Apache Spark

Flink

Python programming

Strong communication skills

Job description

A cybersecurity startup in Sunnyvale is seeking a professional to design, build, and maintain a scalable data lakehouse architecture for analytics workloads. You will architect data pipelines ensuring high performance and quality. Ideal candidates will have a solid background in large-scale data systems, experience with open-source data components, and programming in Python. A competitive compensation package is offered, with a salary range of $150,000 to $250,000 per year.