Senior Data Engineer

Publicis Production; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Publicis Production in Bengaluru is seeking a Senior Data Engineer to design and maintain scalable cloud-based data solutions. The role focuses on building data pipelines across multiple clouds, starting with GCP, while also leveraging Snowflake and Databricks.

You will work with Python, SQL, and modern data engineering practices to ensure data availability and quality for production technology. The ideal candidate has 7+ years of data engineering experience, strong leadership, and hands-on

Qualifications

• 7+ years of data engineering and solution delivery experience with leadership.
• Strong data modeling, warehousing concepts, and distributed systems knowledge.
• Hands-on with Python, SQL, and cloud-based data tools (Snowflake, Databricks).
• Experience across AWS, GCP, or Azure and managing cloud data infrastructure.

Responsibilities

• Architect and maintain scalable batch and streaming data pipelines.
• Collaborate with analysts, scientists, and engineers to meet data needs.
• Implement data quality checks, governance, and monitoring for reliability.
• Optimize ETL/ELT performance and infrastructure scalability.

Skills

Python/PySpark

SQL

Distributed systems

Data modeling

Tools

Git

CI/CD

Airflow

Databricks

Snowflake

GCP

AWS

Azure

Job description

Job Summary:

We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with Snowflake and Databricks also.As a senior member within the data engineering space, you will play a pivotal role in designing scalable data pipelines, optimizing data workflows, and ensuring data availability and quality for production technology.The ideal candidate brings deep technical expertise in AWS, GCP and/or Databricks alongside essential hands-on experience building pipelines in Python, analysing data requirements with SQL, and modern data engineering practices. Your ability to work across business and technology functions, drive strategic initiatives, and independently problem solve will be key to success in this role.

Qualifications:

Experience:

• 7+ years of experience in data engineering and solution delivery, with a strong track record of technical leadership.
• Deep understanding of data modeling, data warehousing concepts, and distributed systems.
• Excellent problem-solving skills and ability to progress with design, build and validate output data independently.
• Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools.
• Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure.
• Strong background in database technologies (SQL Server, Redshift, PostgreSQL, Oracle).

Desirable Skills:

• Familiarity with machine learning pipelines and MLOps practices.
• Additional experience with Databricks and specific AWS such as Glue, S3, Lambda
• Proficient in Git, CI/CD pipelines, and DevOps tools (e.g., Azure DevOps)
• Hands-on experience with web scraping, REST API integrations, and streaming data pipelines.
• Knowledge of JavaScript and front-end frameworks (e.g., React)

Key Responsibilities:

• Architect and maintain robust data pipelines (batch and streaming) integrating internal and external data sources (APIs, structured streaming, message queues etc.).
• Collaborate with data analysts, scientists, and software engineers to understand data needs and develop solutions.
• Understand requirements from operations and product to ensure data and reporting needs are met
• Implement data quality checks, data governance practices, and monitoring systems to ensure reliable and trustworthy data.
• Optimize performance of ETL/ELT workflows and improve infrastructure scalability.

Working Conditions:

• Full-time.
• Limited travel may be required depending on team needs.
• Flexibility to operate in a global organization.