Senior Developer - Data Engineering

Annalect, Omnicom Media Group India Private Limited.

Bengaluru

Presencial

INR 1 200 000 - 1 800 000

Tempo integral

Há 2 dias
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Omnicom Global Solutions in Bengaluru seeks a seasoned Data Engineer to lead Azure Databricks data engineering initiatives. You will design, migrate, and optimize data pipelines, working with large-scale datasets and modern lakehouse architectures.

Responsibilities include cross-functional collaboration, ensuring data quality, and mentoring junior engineers. Strong communication and cloud data skills are essential for delivering enterprise-grade solutions.

Qualificações

  • 4+ years hands-on experience with Azure Databricks in enterprise environments.
  • Proven experience delivering large-scale data migration and modernization projects.
  • Experience migrating ETL processes to cloud-native architectures.
  • Strong understanding of Lakehouse architecture and modern data engineering principles.
  • Extensive experience in Data Modelling, Data Warehousing, and Data Lake design.
  • Experience working with large-scale enterprise data platforms.
  • Strong analytical and problem-solving abilities.
  • Experience working with Agile delivery methodologies.
  • Ability to communicate complex technical concepts to both technical and non-technical stakeholders.
  • Experience working in client-facing environments and collaborating with business stakeholders.
  • Strong understanding of software development lifecycle and engineering best practices.

Responsabilidades

  • Lead the analysis, design, development, testing, and deployment of data engineering solutions on Azure Databricks.
  • Participate in the migration of existing ETL/ELT workloads from Informatica to Azure Databricks.
  • Analyse Informatica mappings, workflows, and dependencies and translate them into scalable Databricks solutions.
  • Design and develop performant batch and streaming data pipelines using PySpark and SQL.
  • Build and maintain data ingestion frameworks for structured and semi-structured data sources.
  • Develop, optimize, and maintain Delta Lake-based data architectures using Medallion Architecture principles.
  • Work closely with Solution Architects and Business Analysts to translate requirements into technical solutions.
  • Implement data quality, reconciliation, validation, and monitoring processes throughout the migration lifecycle.
  • Create technical specifications, design documents, and operational support documentation.
  • Participate in code reviews and enforce engineering best practices and development standards.
  • Support deployment activities through CI/CD pipelines and Infrastructure-as-Code frameworks.
  • Collaborate with stakeholders, project managers, and delivery teams to ensure successful project outcomes.
  • Mentor junior engineers and provide technical leadership across the project team.
  • Support production releases and troubleshoot complex data issues when required.

Conhecimentos

Databricks
PySpark
SQL
Azure
ETL/ELT
Agile
Data Modeling
Communication

Ferramentas

Azure Databricks
PySpark
Spark SQL
Delta Lake
Unity Catalog
Databricks Workflows
Lakehouse Architecture
Medallion Architecture
CI/CD
Terraform

Descrição da oferta de emprego

Overview

Omnicom Global Solutions (OGS) is an integral part of Omnicom Group, a leading global marketing and corporate communications company. Omnicom’s branded networks and specialty firms deliver advertising, strategic media planning and buying, digital and interactive marketing, direct and promotional marketing, public relations, and other specialized communication solutions to over 5,000 clients across more than 70 countries.

OGS India serves as a key global capability center for Omnicom, enabling its agencies and group companies with scaled delivery, specialized expertise, and integrated solutions. Our capabilities span Media, Data & Analytics, Technology, MarTech, Commerce, Business Support Solutions, Creative Production, Healthcare, and Strategy & Insights.

With a workforce of over 7,000 professionals in India, OGS continues to expand its capabilities and global impact, supporting the evolving needs of clients and agencies. We are committed to building future-ready talent and delivering high-quality, outcome-driven solutions.

Responsibilities
  • Lead the analysis, design, development, testing, and deployment of data engineering solutions on Azure Databricks.
  • Participate in the migration of existing ETL/ELT workloads from Informatica to Azure Databricks.
  • Analyse Informatica mappings, workflows, and dependencies and translate them into scalable Databricks solutions.
  • Design and develop performant batch and streaming data pipelines using PySpark and SQL.
  • Build and maintain data ingestion frameworks for structured and semi-structured data sources.
  • Develop, optimize, and maintain Delta Lake-based data architectures using Medallion Architecture principles (Bronze, Silver, Gold).
  • Work closely with Solution Architects and Business Analysts to understand business requirements and translate them into technical solutions.
  • Implement data quality, reconciliation, validation, and monitoring processes throughout the migration lifecycle.
  • Create technical specifications, design documents, and operational support documentation.
  • Participate in code reviews and enforce engineering best practices and development standards.
  • Support deployment activities through CI/CD pipelines and Infrastructure-as-Code frameworks.
  • Collaborate with stakeholders, project managers, and delivery teams to ensure successful project outcomes.
  • Mentor junior engineers and provide technical leadership across the project team.
  • Support production releases and troubleshoot complex data issues when required.
Qualifications
  • Minimum 4 years of hands‑on experience with Azure Databricks in enterprise environments.
  • Proven experience delivering large‑scale data migration and modernization projects.
  • Strong experience migrating ETL processes from Informatica or similar ETL platforms to cloud‑native architectures.
  • Strong understanding of Lakehouse architecture and modern data engineering principles.
  • Extensive experience in Data Modelling, Data Warehousing, and Data Lake design.
  • Experience working with large‑scale enterprise data platforms.
  • Strong analytical and problem‑solving abilities.
  • Experience working with Agile delivery methodologies.
  • Ability to communicate complex technical concepts to both technical and non‑technical stakeholders.
  • Experience working in client‑facing environments and collaborating with business stakeholders.
  • Strong understanding of software development lifecycle and engineering best practices.
ESSENTIAL SKILLS

Databricks & Data Engineering

Azure Databricks, Databricks Genie AI, PySpark, Spark SQL, Delta Lake, Unity Catalog, Databricks Workflows, Databricks Asset Bundles, Lakehouse Architecture, Medallion Architecture, Advanced Data Engineering patterns and best practices

Azure Services

  • Azure Data Lake Storage Gen2 (ADLS Gen2), Azure Data Factory, Azure Synapse Analytics, Azure Key Vault, Azure Entra ID, Azure Monitor, Azure DevOps, Azure Functions

Database Technologies

  • Oracle Database (Must Have), Oracle SQL, Oracle Stored Procedures, Oracle Data Modelling, Oracle Data Warehouse Concepts and Ms SQL server

Migration & Integration

  • Informatica PowerCenter or Informatica Intelligent Cloud Services (IICS)
  • ETL to ELT migration methodologies
  • Data Validation and Reconciliation
  • Data Quality Frameworks
  • Source-to-Target Mapping Analysis
  • Data Integration Design

Engineering Practices

  • Git
  • CI/CD
  • Terraform
  • Infrastructure as Code
  • Unit Testing and Automated Testing
  • Performance Optimization
DESIRABLE / BENEFICIAL SKILLS / CERTIFICATIONS
  • Experience with Databricks LakeBridge, GPT, Claude AI.
  • Databricks certification(s).
  • Microsoft Azure certification(s).
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Senior Software Engineer_Data
Senior Software Engineer_Data

Giant Eagle GCC • Bengaluru

Presencial
INR 1 200 000 - 1 900 000
Azure Data Engineer
Azure Data Engineer

InfoBeans • Indore District, Pune District

Presencial
INR 3 000 000 - 5 400 000
Sr. Databricks Engineer
Sr. Databricks Engineer

ExlService Holdings, Inc. • Bengaluru

Híbrido
INR 4 500 000 - 7 500 000
Sr. Databricks Engineer
Sr. Databricks Engineer

Fa Ewjt Saasfaprod1 • Pune District

Híbrido
INR 3 500 000 - 6 000 000
Azure Databricks Data Engineer
Azure Databricks Data Engineer

Infosys • Bengaluru

Presencial
INR 1 800 000 - 3 200 000
Databricks Architect / Senior Architect | Azure | GenAI | PySpark | Da
Databricks Architect / Senior Architect | Azure | GenAI | PySpark | Da

Tiger Analytics • Hyderabad, Chennai, Bengaluru

Híbrido
INR 4 200 000 - 6 500 000
Sr. Databricks Engineer
Sr. Databricks Engineer

ExlService Holdings, Inc. • Pune District

Híbrido
INR 3 500 000 - 6 500 000
Databricks - Azure Data engineer
Databricks - Azure Data engineer

Pwc India • Índia

Híbrido
INR 1 400 000 - 2 200 000
Data Engineer (Azure & Databricks)
Data Engineer (Azure & Databricks)

Lufthansa Technik Services India Pvt Ltd • Bengaluru

Presencial
INR 1 000 000 - 1 500 000
Senior Data Engineer
Senior Data Engineer

CoffeeBeans • Bengaluru

Presencial
INR 1 800 000 - 2 400 000