Data Engineer - Offshore(3)(DP)

techcarrot; Hyderabad; In loco; INR 800.000 - 1.200.000; Tempo pieno

Descrizione del lavoro

A leading tech firm in Hyderabad is seeking a Data Engineer to assess and integrate new data sources into their Azure Data platform. The ideal candidate has 5-7 years of experience in building data pipelines and strong analytical skills. Your role will involve designing robust data pipelines and effectively communicating insights to business stakeholders. This is a full-time position.

Competenze

• Minimum 5-7 years of practical experience as a Data Engineer.
• Hands-on experience in Azure Databricks utilizing Spark.
• Experience building and optimizing Big Data pipelines.

Mansioni

• Review and analyze data sources for quality and completeness.
• Implement data pipelines using Microsoft Databricks and Azure services.
• Communicate complex data insights to non-technical stakeholders.

Conoscenze

Data analysis

Statistical modeling

Python

Spark

SQL

Formazione

Bachelor’s degree in computer science or related field

Strumenti

Azure Databricks

Azure Data Lake Storage Gen2

Azure Data Factory

Azure Synapse

Event Hub

Docker

Azure Kubernetes Service

Power BI

Descrizione del lavoro

Data Engineer - Offshore

Join techcarrot as a Data Engineer to assess complex new data sources and turn them into business insights. You will support implementation and integration of these data sources into our Azure Data platform.

Responsibilities

• Review and analyze structured, semi‑structured, and unstructured data sources for quality, completeness, and business value.
• Design, architect, implement, and test rapid prototypes that demonstrate data value and present them to diverse audiences.
• Participate in early state design and feature definition activities.
• Implement robust data pipelines using Microsoft Databricks, Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse.
• Create reusable and scalable data pipelines.
• Collaborate with engineering teams across multiple functions to support the integration of proven prototypes into core intelligence products.
• Communicate complex data insights effectively to non‑technical stakeholders.

Requirements

• Advanced working knowledge of relational and non‑relational databases.
• Experience building and optimizing Big Data pipelines, architectures, and datasets.
• Hands‑on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
• Strong proficiency in data analysis, manipulation, and statistical modeling using Spark, Python, Scala, SQL, or similar languages.
• Experience with Azure Data Lake Storage Gen2, Azure Data Factory, Azure Databricks, Event Hub, Azure Synapse.
• Familiarity with Event Hub, Docker, Azure Kubernetes Service, Azure Data Warehouse, Azure Function, Power BI, Azure Cognitive Services.
• Azure DevOps experience to deploy the data pipelines through CI/CD.

Qualifications and Experience

• Minimum 5-7 years of practical experience as a Data Engineer.
• Bachelor’s degree in computer science, software engineering, information technology, or a related field.
• Azure cloud stack production experience.

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

IT Services and IT Consulting