Lead Software Engineer

Publicis Groupe Holdings B.V; Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

A global technology company is seeking a Lead Software Engineer to join its Epsilon Product Development team. The successful candidate will play a key role in designing and implementing scalable data processing solutions using Scala and Spark. Responsibilities include mentoring engineers, leading technical discussions, and optimizing data workflows. Ideal candidates should have significant experience in Scala and Spark, strong communication skills, and the ability to work under pressure. The role is based in Bengaluru, Karnataka.

Qualifications

• 8-10 years of experience in Scala programming and Apache Spark for Big Data.
• Experience in designing scalable data pipelines.
• Hands-on experience in AWS or similar cloud environments for 2+ years.
• Strong communication skills required for collaboration across time zones.
• Ability to mentor engineers and contribute to team standards.

Responsibilities

• Design and implement scalable data processing solutions using Scala and Spark.
• Drive development and optimization of data workflows.
• Lead technical discussions and mentor engineers.
• Ensure high-performance system design and promote best practices.

Skills

Scala programming

Apache Spark

AWS

Python

SQL

Big Data processing

Agile Methodologies

GIT

Tools

Databricks

ELK stack

Tableau

Docker

Kubernetes

Job description

Overview

About BU

The Product team forms the crux of our powerful platforms and connects millions of customers to the product magic. This team of innovative thinkers develop and build products that help Epsilon be a market differentiator. They map the future and set new standards for our products, empowered with industry best practices, ML and AI capabilities. The team passionately delivers intelligent end-to-end solutions and plays a key role in Epsilon’s success story.

Why we are looking for you?

At Epsilon, we run on our people’s ideas. It’s how we solve problems and exceed expectations. Our team is now growing, and we are on the lookout for dedicated individuals who always set the standard by constantly challenging themselves and are experts in building customized solutions in the digital marketing space.

What will you enjoy in this Role?

So, are you someone who wants to work with innovative technology and enable marketers to create data-driven, omnichannel consumer experiences through data platforms? Then you could be exactly who we are looking for.

Apply today and be part of a creative, innovative, and dedicated team that’s not afraid to push boundaries or take risks.

Responsibilities

What will you do?

As a Lead Software Engineer in the Epsilon Product Development team, you will design and implement scalable data processing solutions using Scala and Spark, working on cloud infrastructure. You will drive the development and optimization of data workflows.

In this role, you will lead technical discussions, mentor engineers, ensure high-performance system design, and promote engineering standard methodologies across the team.

Strong written and verbal communication skills (in English) are required to facilitate work across multiple countries and time zones. Good understanding of Agile Methodologies – SCRUM.

Qualifications

• Strong experience (8-10 years) in Scala programming language and extensive experience with Apache Spark for Big Data processing for design, developing and maintaining scalable on-prem and cloud environments experience.
• Proficiency in performance tuning of Spark jobs, optimizing resource usage, shuffling, partitioning, and caching for maximum efficiency in Big Data environments.
• Experience in designing and implementing scalable, fault-tolerant data pipelines with end-to-end monitoring and alerting.
• Hands on experience in AWS (or any other cloud environment) for 2+ years. However, AWS EMR experience is preferred.
• Hands‑on experience with Python.
• Solid grasp of database systems and SQLs for writing efficient SQL’s (RDBMS/Warehouse) to handle TBS of data.
• Familiarity with design patterns and standard processes for efficient data modelling, partitioning strategies, and sharding for distributed systems.
• Experience in working on GIT (or equivalent source control) and solid understanding of Unit and integration test frameworks.
• Must have the ability to collaborate with partners/Product Owners/teams to understand requirements and develop a working solution, and the ability to work within tight deadlines and optimally prioritize and complete tasks in a high‑pressure environment.
• Able to mentor engineers, review code, and contribute to setting engineering standard methodologies.

Advantageous to have experience on below:

• Databricks experience including Databricks Notebooks, Delta Lake, and Catalogues.
• Proficiency in using the ELK (Elasticsearch, Logstash, Kibana) stack for real-time search, log analysis, and visualization.
• Strong background in analytics, including the ability to derive actionable insights from large datasets and support data‑driven decision‑making.
• Experience with data visualization tools like Tableau, Power BI, or Grafana.
• Familiarity with Docker for containerization and Kubernetes for orchestration.
• It's good to have AWS or any other cloud certifications.

Additional Information

Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we’ve provided marketers from the world’s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice.

Epsilon’s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real‑time modeling languages and consumer privacy advancements.

Our pillars aren't just words. They're how we show up every day.

• People centricity: We focus on employee well‑being in an environment where colleagues truly care about each other.
• Collaboration: We work together, support one another, and collectively achieve goals.
• Growth: There are endless opportunities for growth through learning, development and career advancement.
• Innovation: We drive progress through cutting‑edge solutions and forward‑thinking approaches.
• Flexibility: We’ve created a balance between work and personal life, and we encourage adaptability to solve problems creatively.

Our values guide us to create value for our clients, our people and consumers.

• Act with integrity
• Work together to win together
• Innovate with purpose
• Respect all voices
• Empower with accountability

Epsilon is an Equal Opportunity Employer.

Epsilon is committed to promoting diversity, inclusion, and equal employment opportunities by using reasonable efforts to attract, recruit, engage and retain qualified individuals of all ethnicities and backgrounds, including, but not limited to, women, people of color, LGBTQ individuals, people with disabilities and any other underrepresented groups, traits or characteristics.