Senior Spark & Data Platform Engineer

United States Digital Space LLC; Greater London; On-site; GBP 100,000 - 112,000; Full time

Job summary

Zeta Global is seeking a Senior Compute Platform Engineer to join the Data Platform team to build and run the data infrastructure powering Zeta's platform. You will contribute to a lakehouse-style architecture, enabling scalable data processing and cost efficiency.

You will mentor engineers, review code, and collaborate with global teams to improve Spark and Scala-based services, while prioritizing reliability and performance in a dynamic environment.

Qualifications

• Minimum 7 years of software engineering experience.
• A degree in Computer Science, Software Engineering, Physics, Math, or a related field.
• 2+ years of experience and proficiency in Scala or other JVM-based languages.
• Experience with Spark and/or other large-scale data-processing frameworks.
• Experience with Kubernetes is a plus.
• Basic knowledge of Amazon Web Services (EC2, S3, Athena, etc.)
• Interest in back-end technologies, architecture, and learning new things.
• Analytical approach to problems and pragmatic solutions.

Responsibilities

• Operating and implementing new features in the framework and the services managed by the team.
• Engaging with data scientists and identifying ways of improving their experience and productivity when using our framework and services.
• Identifying and implementing computational improvements.
• Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others.
• Acting as an expert on Spark and Scala.
• Mentoring engineers (including pairing, design discussions, and knowledge-sharing sessions).

Skills

Software engineering

Scala programming

Mentoring

Analytical thinking

Back-end development

Communication skills

Education

Bachelor's degree in Computer Science / Software Engineering / Physics / Math

Tools

Spark

Iceberg

Hadoop

Airflow

Kubernetes

AWS

Job description

Zeta Global is seeking a Senior Compute Platform Engineer to join the Data Platform team to build and run the data infrastructure powering Zeta's platform. You will contribute to a lakehouse-style architecture, enabling scalable data processing and cost efficiency.

You will mentor engineers, review code, and collaborate with global teams to improve Spark and Scala-based services, while prioritizing reliability and performance in a dynamic environment.