Data Pipeline Engineer

Cylake, Inc; Sunnyvale (CA); On-site; USD 150,000 - 250,000; Full time

Benefits offered by this job

Comprehensive benefits package

Competitive compensation

Job summary

A cybersecurity startup in Sunnyvale is seeking a professional to design, build, and maintain a scalable data lakehouse architecture for analytics workloads. You will architect data pipelines ensuring high performance and quality. Ideal candidates will have a solid background in large-scale data systems, experience with open-source data components, and programming in Python. A competitive compensation package is offered, with a salary range of $150,000 to $250,000 per year.

Qualifications

• Proven track record architecting, building, and running large-scale data systems.
• Experience in batch and real-time processing architectures.
• Experience with open source Data Lakehouse components.

Responsibilities

• Design, build, and maintain scalable data lakehouse architecture.
• Architect end-to-end data pipelines ensuring performance and reliability.

Skills

Large-scale data systems architecture

Batch processing

Real-time processing

Apache Iceberg

PostgreSQL

Neo4j

Apache Parquet

Apache Kafka

Apache Spark

Flink

Python programming

Strong communication skills

Job description

Your Impact

Join a small team building the next generation of cybersecurity products from the ground up. Led by industry veterans with a proven track record of success - you will get to architect, build, and deliver hugely impactful products with this world-class team. You will have the opportunity to grow your career and skills along with the company from the very start.

Role Overview

Design, build, and maintain a scalable, open-source data lakehouse architecture supporting petabyte-scale analytics workloads. Responsible for architecting end-to-end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality.

Required Experience

• A proven track record of success architecting, building, and running large-scale data systems (PB scale)

• Experience with both batch and real-time processing architectures

• Experience with open source Data Lakehouse components, including Apache Iceberg, PostgreSQL, Neo4j, Apache Parquet, etc.

• Experience with tools for stream processing and data analytics - Apache Kafka, Spark, Flink, etc.

• Understanding and experience with data transformation solutions

• Excellent programming experience with Python

• Strong communication and documentation skills

• Experience with CSP data platforms is a plus

• Understanding of data lineage, quality, and governance tooling is a plus

We offer competitive compensation and a comprehensive benefits package designed to support our employees’ health, well-being, and long-term success. The expected salary range for this position is $150,000 – $250,000 per year. Within this range, individual pay is determined based on job-related factors including skills, experience, qualifications, and internal equity. Most candidates can expect an offer within the range listed above. Your recruiter will provide additional details on compensation and benefits to qualified candidates during the hiring process.

We’re committed to building a diverse, inclusive workplace where everyone can do their best work. We are proud to be an equal opportunity employer and do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. If you require a reasonable accommodation during the application or interview process, please let us know — we’re happy to support you.