Data engineering Manager

Publicis Sapient; Bengaluru; On-site; INR 4,500,000 - 7,500,000; Full time

Benefits offered by this job

18 paid holidays

Parental leave & transition program

Employee Assistance Programs

Job summary

Publicis Sapient in Bengaluru seeks a Senior Data Architect to lead end-to-end big data solutions on Azure. You will guide ingestion, modeling and processing, and set governance and security standards for client data platforms.

You will have 8+ years in IT with 5+ years in data tech, expertise in Spark and Hadoop ecosystems, and hands-on Azure cloud architecture. Team mentorship and agile delivery are key components of the role.

Qualifications

• 8+ years IT with 5+ years in data technologies and 1+ year Azure data services architecture.
• Big Data patterns and end-to-end Azure-based delivery expertise.
• Java/Scala expert; Python a plus.
• Distributed processing: Spark, Storm, Flink experience.
• Hadoop ecosystem on Azure with data ingestion and messaging tools (Sqoop/Flume/NiFi, Kafka/Pub/Sub).
• NoSQL experience (MongoDB/Cassandra/HBase) and cloud offerings (DynamoDB/BigTable).
• CI/CD exposure; containerization and Kubernetes knowledge.

Responsibilities

• Provide technical leadership and hands-on implementation in data engineering areas.
• Lead a team delivering big data solutions on Azure Cloud with quality scope.
• Establish data governance, security, privacy, and quality practices.
• Lead data program delivery using Agile methods and client workshops.
• Mentor peers, contribute to hiring and capability building.

Skills

Big Data Architecture

Azure Cloud

Java/Scala

Python

Spark

Hadoop ecosystem

Kafka/Pulsar

NoSQL

CI/CD

Kubernetes

Tools

Sqoop

Flume

NiFi

Informatica

Talend

Kafka

Pulsar

Pub/Sub

MongoDB

Cassandra

HBase

Job description

Your Impact:

• Provide technical leadership and hands-on implementation role in the areas of data engineering including data ingestion, data access, modeling, data processing, visualization, design, and implementation.
• Lead a team to deliver high quality big data technologies-based solutions on Azure Cloud. Manage functional & nonfunctional scope and quality.
• Help establish standard data practices like governance and address other non-functional issues like data security, privacy, and quality.
• Manage and provide technical leadership to a data program implementation based on the requirement using agile technologies.
• Participate in workshops with clients and align client stakeholders to optimal solutions.
• Consulting, Soft Skills, Thought Leadership, Mentorship etc.
• People management, contributing to hiring and capability building.

Your Skills & Experience:

• Overall 8+ years of IT experience with 5+ years in Data related technologies, and expertise of 1+years in data related Azure Cloud services and delivered at least 1 project as an architect.
• Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of end to end Big data solutions on Azure Cloud.
• Expert in programming languages like Java/ Scala and good to have Python
• Expert in at least one distributed data processing frameworks: like Spark (Core, Streaming , SQL), Storm or Flink etc.
• Expert in Hadoop eco-system with Azure cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI etc), distributed messaging and ingestion frameworks (Kafka,Pulsar, Pub/Sub etc) and good to know traditional tools like Informatica, Talend etc.
• Should have worked on any of NoSQL solutions like Mongo DB, Cassandra, HBase etc or Cloud based NoSQL offerings like DynamoDB , Big Table etc.
• Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration and kubernetes engine would be an added advantage.

Set Yourself Apart With:

• Certification on Azure cloud platform or big data technologies.
• Strong analytical and problem-solving skills.
• Excellent understanding of data technologies landscape / ecosystem.

Benefits of Working Here:

• 18 paid holidays throughout the year.
• Generous parental leave and new parent transition program
• Employee Assistance Programs to help you in wellness and well being

A Tip from the Hiring Manager:

Join theteamtosharpenyourskillsandexpandyourcollaborative methods. Makeanimpacton our clients and their businesses directly through your work.

Company Description

Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting, and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.