Senior Big Data Administrator

Publicis Groupe ANZ; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Epsilon is seeking a skilled DevOps & Microservices Engineer in Bengaluru to design, implement and manage CI/CD pipelines for microservices and data workloads. You will build cloud-native infrastructure (AWS/Azure/GCP) with IaC, deploy and orchestrate Docker-based apps, and optimize Databricks environments for data engineering tasks.

You will collaborate with cross-functional teams to ensure security, cost efficiency, and high availability, while improving monitoring and incident response across

Qualifications

• 5+ years of experience in DevOps & Microservices
• Proficiency in backup and recovery methodologies and techniques
• Ability to diagnose problems and resolve issues across various tiers (application, database, network and appliance)
• Adherence to SDLC, Change Management, troubleshooting and development methodologies
• Strong Unix/Linux and shell scripting
• Ability to perform work with minimal supervisory direction
• Excellent written and verbal communication skills
• Strong hands-on expertise with: CI/CD tools: Azure DevOps, Jenkins, GitHub Actions; Containerization: Docker; Orchestration: Kubernetes (EKS/AKS/GKE)
• Experience with microservices architecture and distributed systems
• Solid experience with Databricks (cluster management, job orchestration, integrations)
• Strong scripting skills (Python / Bash / PowerShell)
• Experience with Infrastructure as Code (Terraform / ARM / CloudFormation)
• Knowledge of monitoring tools (Prometheus, Grafana, CloudWatch, Azure Monitor)

Responsibilities

• Design, implement, and manage CI/CD pipelines for microservices and data workloads
• Build and maintain cloud-native infrastructure (AWS/Azure/GCP) using Infrastructure as Code.
• Support deployment and orchestration of microservices-based applications (Docker, Kubernetes)
• Manage and optimize Databricks environments for data engineering and analytics workloads
• Automate operational workflows, monitoring, and alerting for high availability systems
• Collaborate with development, data engineering, and platform teams to ensure seamless delivery
• Ensure security, compliance, and cost optimization across cloud resources
• Troubleshoot deployment, performance, and infrastructure issues

Skills

DevOps & Microservices

CI/CD

Cloud native infra

Databricks

Docker

Kubernetes

Python / Bash / PowerShell

Terraform / IaC

Monitoring (Prometheus/Grafana)

Unix/Linux

Education

Bachelor's degree in Computer Science

Tools

Azure DevOps

Jenkins

GitHub Actions

Docker

Kubernetes

Terraform

CloudFormation

ARM Templates

Databricks

Prometheus

Grafana

Job description

Overview

At the core of all that Epsilon does is a team that sets the foundation of our IT infrastructure. The team drives innovation and efficiency through pioneering technology across Epsilon's platforms and business verticals. From being the first point of contact for infrastructure needs to final deployment, the team provides end-to-end solutions for our client-facing platforms. ETS supports all aspects of revenue-generating platforms for Epsilon and sets the architectural direction for our enterprise deployments. By adopting the newest technologies, such as Cloud, Automation, and Artificial Intelligence, the team is at the front of redefining our digital business and capturing new opportunities.

Click here to view how Epsilon transforms marketing with 1 View, 1 Vision and 1 Voice.

Responsibilities

• Design, implement, and manage CI/CD pipelines for microservices and data workloads
• Build and maintain cloud-native infrastructure (AWS/Azure/GCP) using Infrastructure as Code.
• Support deployment and orchestration of microservices-based applications (Docker, Kubernetes)
• Manage and optimize Databricks environments for data engineering and analytics workloads
• Automate operational workflows, monitoring, and alerting for high availability systems
• Collaborate with development, data engineering, and platform teams to ensure seamless delivery
• Ensure security, compliance, and cost optimization across cloud resources
• Troubleshoot deployment, performance, and infrastructure issues

Qualifications

• 5+ years of experience in DevOps & Microservices
• Proficiency in backup and recovery methodologies and techniques
• Ability to diagnose problems and resolve issues across various tiers (application, database , network and appliance)
• Adherence to SDLC, Change Management, troubleshooting and development methodologies
• Strong Unix/Linux and shell scripting
• Ability to perform work with minimal supervisory direction
• Excellent written and verbal communication skills
• Strong hands-on expertise with:
  • CI/CD tools: Azure DevOps, Jenkins, GitHub Actions
  • Containerization: Docker
  • Orchestration: Kubernetes (EKS/AKS/GKE)
• Experience with microservices architecture and distributed systems
• Solid experience with Databricks (cluster management, job orchestration, integrations)
• Strong scripting skills (Python / Bash / PowerShell)
• Experience with Infrastructure as Code (Terraform / ARM / CloudFormation)
• Knowledge of monitoring tools (Prometheus, Grafana, CloudWatch, Azure Monitor)

Preferred Skills

• Experience with data engineering pipelines (Spark, Delta Lake)
• Exposure to streaming architectures (Kafka, Event Hubs)
• Understanding of data lake / lakehouse architectures
• Experience with multi-region / high-availability setups
• Cloud certifications (AWS / Azure DevOps / Databricks)

Education/Certification

B.S. in Computer Science or related field or equivalent work experience required. AWS certification is a plus.

Additional Information

Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we’ve provided marketers from the world’s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels.

Epsilon’s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world.

Our pillars aren't just words. They're how we show up every day.

• People centricity: We focus on employee well-being in an environment where colleagues truly care about each other.
• Collaboration: We work together, support one another, and collectively achieve goals.
• Growth: There are endless opportunities for growth through learning, development and career advancement.
• Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches.
• Flexibility: We’ve created a balance between work and personal life, and we encourage adaptability to solve problems creatively.

Our values guide us to create value for our clients, our people and consumers.

• Act with integrity
• Work together to win together
• Innovate with purpose
• Respect all voices
• Empower with accountability

These pillars and values are our foundation—shaping our culture, guiding our decisions, and uniting us in common purpose.

Epsilon is an Equal Opportunity Employer. Epsilon is committed to promoting diversity, inclusion, and equal employment opportunities by using reasonable efforts to attract, recruit, engage and retain qualified individuals of all ethnicities and backgrounds, including, but not limited to, women, people of color, LGBTQ individuals, people with disabilities and any other underrepresented groups, traits or characteristics.