Azure DataOps Engineer

Mployee.me

Mumbai

Presencial

INR 4.000.000 - 7.000.000

Jornada completa

hace 32 horas
Sé de los primeros/as/es en solicitar esta vacante

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Mployee.me in Mumbai is looking for a senior data engineer to design and build cloud-based analytics pipelines on Azure Databricks, using Python and SQL. You will drive migrations from on-prem systems, implement CI/CD, and govern data with scalable data processing pipelines.

You will collaborate with data scientists and business teams to optimize ingestion, quality, and governance, delivering low-latency data stores and APIs for analytics and visualization tools.

Formación

  • 5+ years hands-on experience with Python, PySpark and SQL.
  • Experience with Azure Data Factory, Azure Functions, Data Lake and Databricks.
  • Experience in data migration projects.
  • ETL/ELT pipelines and data orchestration.
  • CI/CD (Azure DevOps or GitHub Actions) and automation.
  • Exposure to AI/ML or GenAI data pipelines (preferred).
  • Strong debugging and problem-solving skills.
  • Excellent communication and collaboration abilities.

Responsabilidades

  • Design and develop cloud and big data solutions, including modern analytics lakes on Azure Databricks.
  • Drive data migration from legacy and on-premises systems to Azure Databricks, including data validation and reconciliation.
  • Build scalable batch and streaming data pipelines using modern cloud and open-source ETL tools.
  • Work with business teams to gather requirements, identify data sources, and resolve data quality issues.
  • Implement CI/CD pipelines and automate deployments in line with DevOps best practices.
  • Create and maintain data governance, documentation, and lineage.
  • Build high-performance, low-latency distributed data systems.
  • Support data discovery, create DataMarts and APIs, and integrate with analytics and visualization tools.
  • Work with data scientists and analytics teams on data ingestion, pipeline optimization, and AI/ML use cases.

Conocimientos

Python, PySpark, SQL
Data migrations
ETL/ELT pipelines
CI/CD
AI/ML data pipelines
Debugging
Communication

Herramientas

Azure Data Factory
Azure Functions
Data Lake
Databricks

Descripción del empleo

Key Responsibilities

  • Design and develop cloud and big data solutions, including modern analytics lakes on Azure Databricks.
  • Drive data migration from legacy and on-premises systems to Azure Databricks, including data validation and reconciliation.
  • Build scalable batch and streaming data pipelines using modern cloud and open-source ETL tools.
  • Work with business teams to gather requirements, identify data sources, and resolve data quality issues.
  • Implement CI/CD pipelines and automate deployments in line with DevOps best practices.
  • Create and maintain data governance, documentation, and lineage.
  • Build high-performance, low-latency distributed data systems.
  • Support data discovery, create DataMarts and APIs, and integrate with analytics and visualization tools.
  • Work with data scientists and analytics teams on data ingestion, pipeline optimization, and AI/ML use cases.

Required Skills

  • Strong hands-on experience (minimum 5 years) with Python, PySpark, and SQL
  • Azure Data Factory, Azure Functions, Data Lake, and Databricks
  • Experience in data migration projects
  • ETL/ELT pipelines and data orchestration
  • CI/CD (Azure DevOps or GitHub Actions) and automation
  • Exposure to AI/ML or GenAI data pipelines (preferred)
  • Strong debugging and problem-solving skills
  • Excellent communication and collaboration abilities
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Azure Databricks Data Engineer
Azure Databricks Data Engineer

WTW Global Delivery And Solutions • Kolkata District

Híbrido
INR 1.200.000 - 2.600.000
Data Engineering Consultant - Azure Databricks
Data Engineering Consultant - Azure Databricks

Optum • Hyderabad

Presencial
INR 4.000.000 - 7.000.000
Azure Data Engineer - S
Azure Data Engineer - S

Tata Consultancy Services Limited • Mumbai, Pune District, Delhi, Gurugram District

Presencial
INR 2.000.000 - 3.400.000
Azure Data Engineer
Azure Data Engineer

Orangebits Software Technologies • Pune District, Mumbai

Híbrido
INR 900.000 - 1.300.000
Azure Databricks Data Engineer
Azure Databricks Data Engineer

WTW group • Kolkata District

Presencial
INR 1.800.000 - 3.400.000
Azure Data Engineer
Azure Data Engineer

InfoBeans Inc. • Indore District, Pune District

Presencial
INR 3.000.000 - 5.400.000
Azure Data Engineer
Azure Data Engineer

Hexaware Technologies Limited • Hyderabad

Híbrido
INR 1.200.000 - 1.800.000
Azure Data Engineer - Data Migration / SQL
Azure Data Engineer - Data Migration / SQL

Orion Systems • Ernakulam, Chennai, Coimbatore District

Presencial
INR 1.200.000 - 3.000.000
Azure Databricks Engineer
Azure Databricks Engineer

Turnkeylearning • Hyderabad

Presencial
INR 1.000.000 - 2.000.000
Data Engineer-Azure Databricks
Data Engineer-Azure Databricks

Qloron • Mumbai

Presencial
INR 1.200.000 - 1.800.000