Lead Compute Platform Engineer

United States Digital Space LLC; Greater London; On-site; GBP 100,000 - 112,000; Full time

Job summary

Zeta Global is seeking a Senior Compute Platform Engineer to join the Data Platform team to build and run the data infrastructure powering Zeta's platform. You will contribute to a lakehouse-style architecture, enabling scalable data processing and cost efficiency.

You will mentor engineers, review code, and collaborate with global teams to improve Spark and Scala-based services, while prioritizing reliability and performance in a dynamic environment.

Qualifications

• Minimum 7 years of software engineering experience.
• A degree in Computer Science, Software Engineering, Physics, Math, or a related field.
• 2+ years of experience and proficiency in Scala or other JVM-based languages.
• Experience with Spark and/or other large-scale data-processing frameworks.
• Experience with Kubernetes is a plus.
• Basic knowledge of Amazon Web Services (EC2, S3, Athena, etc.)
• Interest in back-end technologies, architecture, and learning new things.
• Analytical approach to problems and pragmatic solutions.

Responsibilities

• Operating and implementing new features in the framework and the services managed by the team.
• Engaging with data scientists and identifying ways of improving their experience and productivity when using our framework and services.
• Identifying and implementing computational improvements.
• Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others.
• Acting as an expert on Spark and Scala.
• Mentoring engineers (including pairing, design discussions, and knowledge-sharing sessions).

Skills

Software engineering

Scala programming

Mentoring

Analytical thinking

Back-end development

Communication skills

Education

Bachelor's degree in Computer Science / Software Engineering / Physics / Math

Tools

Spark

Iceberg

Hadoop

Airflow

Kubernetes

AWS

Job description

WHO WE ARE

Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI. Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.the company.com.

The Role

As a Senior Compute Platform Engineer on the Data Platform team, you will be part of the group responsible for building and running the data infrastructure that powers Zeta's platform, including Zeta’slakehouseplatform. The Data Platform team delivers reliable, cost-efficient data processing that scales with growth — so engineers and analysts can focus on business problems instead of wrestling with infrastructure.

The Data Platform teamempowers data scientists and data engineers through a Scala data warehouse framework designed for data modeling and the creation of type-safe and easily testable batch jobs. The team also orchestrates a compute environment that simplifies the execution of Spark jobs,facilitatingthe analysis of terabytes of data with ease and cost-effectiveness. The runtime environment is based on Hadoop clusters on EC2 spot instances, dynamically scaling up asrequired, ensuring high resourceutilizationand stability.

Our teamis responsible forthe development and deployment of the company's next-generation technology, closely collaborating with the company's other branches inSan Franciscoand Berlin.You will help grow the team through mentoring, code reviews, and knowledge sharing so others can work effectively with our stack.

Essential Responsibilities:

As a Senior Compute Platform Engineer, your responsibilitieswill include:

• Operating and implementing new features in the framework and the services managed by the team

• Engaging with data scientists andidentifyingways of improving their experience and productivity when using our framework and services

• Identifyingand implementing computational improvements

• Making improvements and/or fixing bugs bysubmittingpatches toopen-sourceprojects in our stack, such as Spark,Iceberg,Hadoop, Airflow, and many others

• Acting as anexpert on Spark and Scala

• Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping raise the bar on quality, reliability, and good practices across the team

Desired Characteristics:

• Minimum7years of software engineering experience

• A degree in Computer Science, Software Engineering, Physics, Math, or a related field

• 2+ years of experience andproficiencyin Scala or other JVM-based languages

• Experience with Spark and/or other large-scale data-processing frameworks

• Experience with Kubernetes is a plus

• Basic knowledge of Amazon Web Services (EC2, S3, Athena, etc.)

• Interest in back-end technologies, architecture, and passion for learning new things

• Interest in math, statistics, oradtechtechnology is a plus

• Analytical approach to problems and pragmatic approach to solutions

• Ability to work independently and enterprising in a dynamic environment where work priorities can change

• Excellent interpersonal and communication skills, with the ability to discuss ideas in a distanced and constructive manner

SALARY RANGE

The salary range for this role is £100,000 - £112,000, depending on location and experience.

PEOPLE & CULTURE AT ZETA

Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.

We’re committed to building a workplace culture of trust and belonging, so everyone feels invited to bring their whole selves to work. We provide a forum for employees to celebrate, support and advocate for one another. Learn more about our commitment to diversity, equity and inclusion here: https://the company.com/blog/a-look-into-zetas-ergs/

ZETA IN THE NEWS!

https://the company.com/press/?cat=press-releases

#LI-DD1Find more English Speaking Jobs in United Kingdom on Arbeitnow