Senior Data Engineer – Real-Time Big Data Platform

SupportFinity™; Redwood City (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

Poshmark is seeking a data engineer to scale its Datalake and ensure real-time access to quality data for stakeholders. You will design and maintain large-scale batch and streaming pipelines using Spark, Flink, and AWS, collaborating with Data Science and Platform Engineering teams.

Ideal candidates have 3+ years in software engineering with 2+ years in data engineering, strong problem solving, and hands-on experience with Hadoop, Spark, Kafka, and Redshift. On-site in Redwood City, CA.

Qualifications

• 3+ years of software engineering, with 2+ years in data engineering.
• Experience building scalable batch and real-time data pipelines.
• Strong problem solving and code quality focus.
• Experience with Hadoop, Spark, Kafka, Flink, and Redshift.

Responsibilities

• Build scalable data processing pipelines for large-scale data.
• Collaborate with Data Science and Analytics teams.
• Own critical data pipelines and improve reliability.

Skills

Data engineering

Scala/Java/Python

SQL

Distributed systems

AWS

Education

Bachelor's degree in Computer Science or related field

Tools

Hadoop

Spark

Kafka

Flink

Hive

Redshift

AWS S3

Airflow

Jenkins

EMR

Job description

Poshmark is seeking a data engineer to scale its Datalake and ensure real-time access to quality data for stakeholders. You will design and maintain large-scale batch and streaming pipelines using Spark, Flink, and AWS, collaborating with Data Science and Platform Engineering teams.

Ideal candidates have 3+ years in software engineering with 2+ years in data engineering, strong problem solving, and hands-on experience with Hadoop, Spark, Kafka, and Redshift. On-site in Redwood City, CA.