Senior Data Engineer: Azure & Databricks Lead

P G; United States; Remote; USD 19,000 - 32,000; Full time

Job summary

P&G is seeking a Senior Data Engineer in Hyderabad IT Hub to lead design and development of data and analytics platforms. You will craft integrated ELT/ETL pipelines, perform data orchestration and modeling, and work with product teams to drive business value and transformation.

You will apply strong Azure Databricks and Azure Data Factory skills, build data warehouses or lakes, ensure data governance, and deliver scalable BI solutions with Power BI.

Qualifications

• Bachelor's or master's degree in computer science, data engineering, or a related field.
• Azure and Databricks: strong proficiency in Azure services and Databricks.
• ETL tools: experience with ETL frameworks like Apache Spark, Databricks Delta, or Azure Data Factory.
• Programming: PySpark, Python, SQL, or Scala for data manipulation.
• Data Modeling: knowledge of data modeling techniques and tools.
• Database Technologies: familiarity with relational databases (e.g., SQL Server).
• Data Warehousing: understanding of warehousing concepts; experience with Azure Synapse or Azure SQL Data Warehouse or DeltaLake.
• Data Governance: knowledge of data governance principles, security, privacy, and compliance.
• Data Visualization: experience with Power BI for semantic models and dashboards.
• Cloud Computing: familiarity with Azure and cloud concepts.
• Problem-Solving: strong analytical and problem-solving skills to resolve data issues.
• DevOps/CICD: experience with Azure DevOps, Chef, Puppet, or GitHub.

Responsibilities

• Lead design and development of data and analytics cloud-based platform.
• Craft integrated systems and ELT/ETL jobs to fulfill business deliverables.
• Perform data orchestration, transformation, and visualization with large datasets.
• Collaborate with product managers to ensure value and transformation.
• Follow standard coding practices for delivery excellence and reusability.
• Develop and maintain data pipelines in Azure and Databricks environments.
• Design data transformations, cleansing, normalization, and aggregation.
• Develop data models and schemas for efficient storage and retrieval.
• Design and build data warehouses or data lakes using Azure services.
• Integrate data from multiple sources (on-premises and cloud).
• Implement data governance for security, privacy, and compliance.
• Optimize pipelines and queries for performance and scalability.
• Monitor pipelines, troubleshoot issues with cross-team collaboration.
• Build BI reports to enable faster decision making.
• Document data engineering processes and configurations.

Skills

Data engineering

Python

SQL

PySpark

Problem-Solving

Education

Bachelor's or master's degree in computer science, data engineering, or related field

Tools

Azure Data Factory

Azure Databricks

Azure SQL Database

Azure Data Lake Storage

Azure Synapse Analytics

Job description

P&G is seeking a Senior Data Engineer in Hyderabad IT Hub to lead design and development of data and analytics platforms. You will craft integrated ELT/ETL pipelines, perform data orchestration and modeling, and work with product teams to drive business value and transformation.

You will apply strong Azure Databricks and Azure Data Factory skills, build data warehouses or lakes, ensure data governance, and deliver scalable BI solutions with Power BI.