Principal Data Platform Engineer

Robotics Prcocess Automation, LLC; Sunnyvale (CA); Hybrid; USD 100,000 - 130,000; Full time

Job summary

A technology solutions company seeks a skilled Back-End Engineer in Sunnyvale, California. You will design and maintain scalable data pipelines and back-end systems using Spark, Python, and Java. The role demands collaboration with data scientists and knowledge of cloud technologies, particularly AWS or GCP. Ideal candidates possess a Bachelor's in Computer Science and over 5 years of back-end development experience. Join our dynamic team to deliver impactful data-driven solutions.

Qualifications

• 5+ years of experience in back-end development with a focus on data engineering.

Responsibilities

• Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
• Write efficient SQL queries for ETL processes.
• Work with DataFrames to manipulate large datasets.
• Implement solutions using AWS or GCP.
• Build real-time data streaming pipelines using MSK/Kafka.
• Utilize S3 for data storage.
• Ensure data quality and security.

Skills

Spark

Python

Scala

Java

SQL

DataFrames

AWS

GCP

MSK/Kafka

S3

Iceberg

Data Warehousing

Communication

Collaboration

Education

Bachelor’s degree in computer science or a related field

Job description

A technology solutions company seeks a skilled Back-End Engineer in Sunnyvale, California. You will design and maintain scalable data pipelines and back-end systems using Spark, Python, and Java. The role demands collaboration with data scientists and knowledge of cloud technologies, particularly AWS or GCP. Ideal candidates possess a Bachelor's in Computer Science and over 5 years of back-end development experience. Join our dynamic team to deliver impactful data-driven solutions.