Senior Data Infra Engineer: Scale Streaming Pipelines

NewsBreak; Mountain View (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health, dental, and vision care

401(K) plan with company matching

Paid time off and paid holidays

FSA, HSA and commuter benefits

Team activity budget

Job summary

NewsBreak in Mountain View, California is seeking a Senior Engineer to build and scale data pipelines crucial for our platform's performance. Your role will involve designing Kafka pipelines and optimizing Spark jobs, ensuring high data quality and performance standards.

With over 5 years of data engineering experience preferred, you should be proficient in Spark, Kafka, and AWS. Competitive benefits including health coverage and a top-tier 401(K) plan are offered.

Qualifications

• 5+ years of data engineering experience, preferably with production pipelines.
• Strong hands-on experience with Spark and Kafka in a production setting.
• Experience with big-data technologies and AWS services.

Responsibilities

• Design and operate Kafka pipelines for user events.
• Author and optimize Spark jobs for data processing.
• Drive data quality checks and monitor pipeline performance.

Skills

Data engineering experience

Spark

Kafka

Python

SQL

Education

BS or MS in Computer Science or equivalent

Tools

AWS

Hadoop

Presto/Trino

Flink

Job description

NewsBreak in Mountain View, California is seeking a Senior Engineer to build and scale data pipelines crucial for our platform's performance. Your role will involve designing Kafka pipelines and optimizing Spark jobs, ensuring high data quality and performance standards.

With over 5 years of data engineering experience preferred, you should be proficient in Spark, Kafka, and AWS. Competitive benefits including health coverage and a top-tier 401(K) plan are offered.