Senior Data Engineer - Real-Time Pipelines & RTB

Aarki; San Francisco (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

An innovative AI-driven mobile advertising company in San Francisco is seeking a Data Engineer to join its engineering team. This role involves designing, developing, and maintaining data infrastructure for a programmatic Demand-Side Platform. Candidates should have over 6 years of experience in data engineering, a strong background in building scalable data pipelines, and proficiency in technologies such as Kafka and Spark. This position offers an opportunity to drive performance and collaborate with cross-functional teams.

Qualifications

• 6+ years of experience in data engineering or distributed systems development.
• Strong proficiency in building large-scale data pipelines.
• Solid understanding of distributed systems concepts.

Responsibilities

• Architect and design scalable, fault-tolerant data pipelines.
• Lead development of data processing systems using Kafka, Spark, etc.
• Partner with teams to define data models and end-to-end data flows.

Skills

Building and operating large-scale data pipelines

Kafka

Spark

ClickHouse

HDFS

Fluentd

Problem-solving skills

Education

Bachelor’s or Master’s degree in Computer Science

Job description

An innovative AI-driven mobile advertising company in San Francisco is seeking a Data Engineer to join its engineering team. This role involves designing, developing, and maintaining data infrastructure for a programmatic Demand-Side Platform. Candidates should have over 6 years of experience in data engineering, a strong background in building scalable data pipelines, and proficiency in technologies such as Kafka and Spark. This position offers an opportunity to drive performance and collaborate with cross-functional teams.