Senior Data Platform Engineer — Real-Time Pipelines

Cloud Analytics Technologies, LLC; Sunnyvale (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

A data analytics technology firm is seeking a skilled Back-End Engineer to design and maintain data pipelines. Key responsibilities include developing robust ETL processes using Spark, Python, and SQL while leveraging cloud technologies like AWS and GCP. Ideal candidates have over 5 years of data engineering experience and technical proficiency in leading tools. This role offers opportunities for collaboration within a dynamic team. Candidates will find a diverse and equal-opportunity workplace.

Qualifications

• 5+ years of experience in back-end development focused on data engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Excellent communication and collaboration skills.

Responsibilities

• Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
• Write efficient SQL queries for ETL processes.
• Build real-time data streaming pipelines using MSK/Kafka.

Skills

Spark

Python

Scala

Java

SQL

DataFrames

AWS

GCP

MSK

Kafka

S3

Iceberg

Education

Bachelor’s degree in computer science or related field

Job description

A data analytics technology firm is seeking a skilled Back-End Engineer to design and maintain data pipelines. Key responsibilities include developing robust ETL processes using Spark, Python, and SQL while leveraging cloud technologies like AWS and GCP. Ideal candidates have over 5 years of data engineering experience and technical proficiency in leading tools. This role offers opportunities for collaboration within a dynamic team. Candidates will find a diverse and equal-opportunity workplace.