Senior Big Data Platform Engineer – Real-Time Spark

Adobe; San Jose (CA); On-site; USD 150,000 - 180,000; Full time

Job summary

Adobe in San Jose is looking for an experienced software developer to enhance their Adobe Experience Platform. The role requires a Bachelor’s Degree and over 10 years of experience in software development, with a focus on Big Data technologies like Spark and Kafka.

The ideal candidate should have proven experience in delivering optimized code and should thrive in a collaborative, Agile environment. Adobe champions diversity and inclusion in their workforce.

Qualifications

• 10+ years of industry software development experience.
• Hands-on experience with open-source technologies such as Spark, Hadoop Stack, and Kafka.
• Proven record of delivering highly optimized code in Scala/Java.
• Deep understanding of modern cloud technologies and design patterns.

Responsibilities

• Integrate and improve Big Data tools and frameworks to provide requested capabilities.
• Develop and deploy critical parts of the services and deliver them to production.
• Lead sophisticated, large-scale projects in an Agile environment using Java, Jenkins, and Spark.

Skills

Java

Scala

Spark

Hadoop Stack

Kafka

CI/CD systems

Containers

Data structures and algorithms

Design patterns

Problem-solving skills

Education

Bachelor’s Degree or equivalent experience

Tools

Apache Parquet

Databricks Delta

Apache Iceberg

Apache Hudi

Job description

Adobe in San Jose is looking for an experienced software developer to enhance their Adobe Experience Platform. The role requires a Bachelor’s Degree and over 10 years of experience in software development, with a focus on Big Data technologies like Spark and Kafka.

The ideal candidate should have proven experience in delivering optimized code and should thrive in a collaborative, Agile environment. Adobe champions diversity and inclusion in their workforce.