Data Engineer

RapidBrains; Hyderabad; On-site; INR 900,000 - 1,300,000; Full time

Job summary

A leading IT consulting firm is looking for a mid-senior level data analytics expert in Hyderabad, India. The role involves designing and optimizing large-scale data analytics solutions using Azure technologies, building data lake architectures, and collaborating in Agile environments. Candidates should be experienced in tools like Azure Data Factory, Spark, and ETL tools such as Informatica or Talend. Immediate joiners are preferred, making this an exciting opportunity for skilled professionals.

Qualifications

• Experience in designing and optimizing data analytics and data warehouse solutions.
• Familiarity with cloud platforms, particularly Azure.
• Ability to implement ETL workflows.
• Familiarity with Azure storage, pipelines, and DevOps practices.

Responsibilities

• Design and optimize data warehousing solutions using Azure.
• Build and maintain data lake architectures.
• Develop high-performance data pipelines.
• Manage distributed data processing workflows and integrate with service-oriented architectures.
• Work with Azure Storage Gen2, DevOps pipelines, and analytics services.
• Develop high-performance data pipelines using Spark and T-SQL.
• Implement ETL workflows using Informatica, SSIS, or Talend.
• Collaborate in Agile SDLC environments and ensure cloud deployments follow best practices.
• Experience with streaming (Kafka) for real-time data ingestion is a plus.

Skills

Azure Data Factory

Azure Databricks

Spark (Scala/Python)

T-SQL

Informatica

SSIS

Talend

Kafka

Azure DevOps

Agile SDLC

Data Lake

Tools

Informatica

SSIS

Talend

Job description

Responsibilities

• Design, develop, and optimize large‑scale data analytics and data warehouse solutions using Azure Data Factory and Azure Databricks.
• Build and maintain data lake architectures to process multi‑format, high‑volume datasets.
• Translate solution designs into fully functional implementation packages on the Azure platform.
• Manage distributed data processing workflows and integrate solutions with service‑oriented architectures.
• Work extensively on Azure Storage Gen2, Azure DevOps pipelines, and Azure analytics services.
• Develop high‑performance data pipelines using Spark (Scala/Python) and T‑SQL.
• Implement ETL workflows using tools such as Informatica, SSIS, or Talend.
• Collaborate in Agile SDLC environments, ensuring cloud deployments follow best practices.
• Work with streaming technologies (Kafka) for real‑time data ingestion (good to have).
• Ensure adherence to best practices around cloud, DevOps, testing, and modern CI/CD processes.

Notice period: Immediate joiners to 20 days

Seniority Level

Mid‑Senior level

Employment Type

Full‑time

Job Function

Design

Industries

IT Services and IT Consulting