Senior Software Engineer, Scalable Segmentation Engine

Adobe; California (PA); On-site; USD 139,000 - 258,000; Full time

Job summary

Adobe Experience Platform is hiring engineers to build a scalable segmentation service that defines customer segments and generates target audiences in real time. You will own design and implementation of core components, develop query compilation and optimization techniques, and work with Apache Spark to handle large-scale data processing.

You will contribute to architecture reviews and deploy production services in an Agile environment.

Qualifications

• B.S. in Computer Science or a related field is required.
• M.S. in Computer Science or a related field or equivalent practical experience is preferred.
• Experience building a scalable query engine or equivalent practical experience is required. Language design is a plus.
• Strong grasp of algorithms and data structures.
• Proficiency in Databases or compilers is preferred.
• Strong programming skills with extensive experience in Java or Scala.
• Proficiency in Apache Spark is preferred.
• Leadership skills to collaborate and drive cross-team efforts.
• Excellent communication skills.
• Adaptable to evolving priorities, learning new technologies, and delivering viable solutions within defined time frames.

Responsibilities

• Collaborate with a team of engineers and product managers to build a high-performance segmentation engine.
• Develop query compilation algorithms that transform and rewrite segment definition queries.
• Develop query optimization and evaluation algorithms including multi-query optimization and streaming evaluation.
• Work on cross-functional themes involving advanced data pipelines using Apache Spark.
• Build tools to monitor query performance and debug potential semantic errors.
• Deploy production services and iterate based on customer feedback.
• Follow Agile methodologies using CI/CD pipelines.
• Participate in architecture, design, and code reviews.

Skills

Java

Scala

Algorithms & DS

Apache Spark

Leadership

Communication Skills

Databases

Compilers

Education

B.S. in Computer Science or related field

M.S. in Computer Science or related field or equivalent

Tools

Apache Spark

Job description

Adobe Experience Platform is hiring engineers to build a scalable segmentation service that defines customer segments and generates target audiences in real time. You will own design and implementation of core components, develop query compilation and optimization techniques, and work with Apache Spark to handle large-scale data processing.

You will contribute to architecture reviews and deploy production services in an Agile environment.