Area Manager-Data Engineering-Cloud Data Engineering

Fa Ewjt Saasfaprod1; Dadri; Presencial; INR 1.200.000 - 2.500.000; Jornada completa

Descripción de la vacante

Fa Ewjt Saasfaprod1 is seeking an Azure Data Engineer in the Healthcare Analytics BU. You will design robust data pipelines using Azure Databricks, PySpark, and Spark SQL to process large volumes of data, both structured and unstructured.

You will implement orchestration via Data Factory and Databricks Workflows to automate ETL/ELT processes and build enterprise BI architectures. You will also develop healthcare data models, data warehouses, and dashboards, working with stakeholders to translate

Formación

• 6+ years of experience as a Data Engineer with cloud data pipelines preferred.
• Hands-on with Azure Databricks, Azure Data Factory, and Databricks Workflows.
• Proficient in Python and SQL with data warehousing concepts.

Responsabilidades

• Design, develop, test, and deploy scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.
• Implement workflow orchestration with Azure Data Factory and Databricks Workflows to automate ETL/ELT.
• Maintain CI/CD pipelines for notebooks, scripts, and configs using Azure DevOps or GitHub Actions.
• Develop and maintain healthcare data models and data flows for analytics and decision-making.
• Design and implement enterprise BI architectures, data warehouses, and data marts.
• Create reports, dashboards, and visualizations and collaborate with stakeholders.

Conocimientos

Python

SQL

Databricks

Spark

ETL/ELT design

CI/CD awareness

Herramientas

Azure Databricks

Azure Data Factory

Databricks Workflows

GitHub Actions

Azure DevOps

PySpark

Spark SQL

Git

Azure Data Lake Storage Gen 2

Descripción del empleo

Role Title: Azure Data Engineer

BU/Segment:Healthcare Analytics

Responsibilities

• Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark, and Spark SQL for processing large volumes of structured and unstructured data.
• Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes.
• Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test, and prod environments.
• Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making.
• Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts.
• Develop and maintain reports, dashboards, and data visualizations. Collaborate with stakeholders to understand business needs and provide data-driven insights

Person attributes

• 6+ years of experience as a Data Engineer with a proven track record of building data pipelines in the cloud.
• 3+ years of hands-on experience withAzure Databricks
• Strong experience with core Azure data services – Azure Data Lake Storage (Gen 2), Azure data factory.
• Proficiency inPythonand expert-level skills inSQL
• Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data architecture principles
• Experience with CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions) and version control systems (Git).
• Demonstrated experience and knowledge of strategic problem solving and frameworks, and project management skills
• Excellent written and verbal communication with the ability to establish credibility and strong relationships with stakeholders

Role Title: Azure Data Engineer

BU/Segment:Healthcare Analytics

Responsibilities

• Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark, and Spark SQL for processing large volumes of structured and unstructured data.
• Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes.
• Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test, and prod environments.
• Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making.
• Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts.
• Develop and maintain reports, dashboards, and data visualizations. Collaborate with stakeholders to understand business needs and provide data-driven insights

Person attributes

• 6+ years of experience as a Data Engineer with a proven track record of building data pipelines in the cloud.
• 3+ years of hands-on experience withAzure Databricks
• Strong experience with core Azure data services – Azure Data Lake Storage (Gen 2), Azure data factory.
• Proficiency inPythonand expert-level skills inSQL
• Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data architecture principles
• Experience with CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions) and version control systems (Git).
• Demonstrated experience and knowledge of strategic problem solving and frameworks, and project management skills
• Excellent written and verbal communication with the ability to establish credibility and strong relationships with stakeholders

Role Title: Azure Data Engineer

BU/Segment:Healthcare Analytics

Responsibilities

• Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark, and Spark SQL for processing large volumes of structured and unstructured data.
• Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes.
• Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test, and prod environments.
• Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making.
• Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts.
• Develop and maintain reports, dashboards, and data visualizations. Collaborate with stakeholders to understand business needs and provide data-driven insights

Person attributes

• 6+ years of experience as a Data Engineer with a proven track record of building data pipelines in the cloud.
• 3+ years of hands-on experience withAzure Databricks
• Strong experience with core Azure data services – Azure Data Lake Storage (Gen 2), Azure data factory.
• Proficiency inPythonand expert-level skills inSQL
• Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data architecture principles
• Experience with CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions) and version control systems (Git).
• Demonstrated experience and knowledge of strategic problem solving and frameworks, and project management skills
• Excellent written and verbal communication with the ability to establish credibility and strong relationships with stakeholders