Data Engineer

Hiringhood; Hyderabad; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Hiringhood in Hyderabad is seeking a data engineer to design and optimize data platforms, including databases, data warehouses, pipelines, and BI reports. You will collaborate with data analysts and software engineers to deliver curated datasets necessary for analytics and decision-making.

The role requires 3+ years in data management with Microsoft Fabric, Snowflake, and Databricks, plus strong SQL and Python skills and a solid understanding of data modelling and warehousing.

Qualifications

• Minimum 3 years of experience in data management projects with technologies like Microsoft Fabric, Snowflake, and Databricks with related tools and technologies
• Excellent skills in SQL & Python
• Basic understanding of database management systems, data warehouse and data modelling
• Strong analytical abilities to interpret trends and patterns in complex datasets
• Excellent verbal and written communication skills for collaborating with team members.

Responsibilities

• Design and develop databases/data warehouses and craft efficient SQL queries
• Assist in building data pipelines for ETL using Azure tools, Databricks, and Snowflake environments
• Develop data lake components and medallion framework and manage data ingestion approaches
• Build dashboards and reports in Power BI or Tableau or other BI tools
• Document data processes and workflows for knowledge sharing
• Collaborate with data analysts and software engineers to deliver relevant datasets.

Skills

SQL

Python

Analytical skills

Communication skills

Tools

Microsoft Fabric

Snowflake

Databricks

Job description

Roles & Responsibilities

• Database/Data Warehouse Development: Strong understanding of SQL and designing efficient queries, conceptual understanding of tabular data model and its development etc.
• Data Pipeline Development: Assist in building and maintaining data pipelines for ETL (Extract, Transform, Load) processes using various tools and techniques in Azure (Data Factory, Databricks (incl. Data Lakehouse), DevOps, and Storage Accounts) & Snowflake environments.
• Data Lake Development: Assist in developing the medallion framework for persisting, transforming and creating data models. Depending on the data extraction frequency, design appropriate approaches for data ingestion i.e., full versus incremental data loads
• Data Visualization: Build powerful dashboard and reports in Power BI or Tableau or any other BI tool
• Documentation: Document data processes and workflows for knowledge sharing.
• Collaboration: Work with data analysts and software engineers to understand data requirements and deliver relevant datasets.

Must have

• Experience: Minimum 3 years of experience is mandatory in data management projects with technologies like Microsoft Fabric, Snowflake, and Databricks with related tools and technologies
• Programming Skills: Excellent skills in SQL & Python are essential for this role
• Data Management: Basic understanding of database management systems, data warehouse and data modelling is essential for this role
• Analytical Skills: Strong analytical abilities to interpret trends and patterns in complex datasets.
• Communication Skills: Excellent verbal and written communication skills for collaborating with team members.