Data Engineer, Kafka & Big Data Infrastructure

Applied Intuition; Sunnyvale (CA); On-site; USD 153,000 - 222,000; Full time

Benefits offered by this job

Comprehensive health insurance

401k retirement benefits

Learning and wellness stipends

Paid time off

Job summary

Applied Intuition in Sunnyvale, California is looking for generalist engineers to join their data engine team. You will design and build large-scale data platforms to support AI research and work on data processing systems handling petabytes of data.

The ideal candidate has a Bachelor’s degree in Computer Science, at least 2 years of experience in backend engineering, and is proficient in technologies like Apache Spark and Kafka. The compensation for this role ranges from $153,000 to $222,000 annually.

Qualifications

• 2+ years of professional experience.
• Strong backend engineering experience.
• Experience working in fast-paced environments.

Responsibilities

• Design and build large-scale data platforms for AI research.
• Work on data curation and tagging platforms.
• Build high-performance data processing systems.

Skills

Backend engineering

Problem-solving skills

Cross-functional teamwork

Education

Bachelor's degree in Computer Science or Software Engineering

Tools

Apache Spark

Apache Hudi

Trino

Apache Kafka

Flyte

Kubernetes

Python

Golang

Java

Job description

Applied Intuition in Sunnyvale, California is looking for generalist engineers to join their data engine team. You will design and build large-scale data platforms to support AI research and work on data processing systems handling petabytes of data.

The ideal candidate has a Bachelor’s degree in Computer Science, at least 2 years of experience in backend engineering, and is proficient in technologies like Apache Spark and Kafka. The compensation for this role ranges from $153,000 to $222,000 annually.