Data Engineer

Nisum; Hyderabad; Híbrido; INR 1 500 000 - 3 000 000; Tempo integral

Resumo da oferta

Nisum in Hyderabad is seeking an experienced Data Engineer to design and maintain scalable data infrastructure, including data warehouses, data lakes, OneLake, and data pipelines using Microsoft Fabric, Synapse, and ADF.

You will collaborate with data engineers and stakeholders, implement data quality processes, automate CI/CD for Fabric deployments, and help deliver new data products and services.

Qualificações

• 5+ years in data engineering.
• Data modelling and data warehousing experience.
• Data quality assurance experience.
• Scripting in Python and SQL.
• Strong problem-solving and analytical skills.
• Experience with MSSQL, Fabric, Power BI and ADF desirable.
• Core platform: Microsoft Fabric, OneLake, Synapse Data Engineering.
• Languages: Python (PySpark, pandas, NumPy, Scikit-Learn), SQL, Delta Lake.

Responsabilidades

• Develop and maintain data infrastructure including data warehouses and data lakes.
• Build pipelines and workflows with Fabric, Synapse Data Engineering, and ADF.
• Collaborate with stakeholders to translate data needs into solutions.
• Implement data quality assurance to ensure accuracy and reliability of data.
• Automate data processing tasks and CI/CD for Fabric deployments.
• Work with the team to deliver new data products and services.

Conhecimentos

Data modelling

Data warehousing

Data quality

Python

SQL

MSSQL

Microsoft Fabric

OneLake

Power BI

Azure Data Factory

PySpark

Pandas

NumPy

Scikit-Learn

Delta Lake

Ferramentas

Azure Data Factory

Power BI

MSSQL

Delta Lake

Synapse Data Engineering

OneLake

Fabric

Descrição da oferta de emprego

What You'll Do:

• Develop and maintain our data infrastructure, including data warehouses, data lakes, OneLake, and data pipelines.
• Design, build, and maintain data pipelines and workflows using Microsoft Fabric, Synapse Data Engineering, and Azure Data Factory (ADF).
• Work with other Data Engineers and stakeholders to understand their data needs and develop solutions to meet those needs.
• Develop and implement data quality assurance processes to ensure the accuracy and reliability of our data.
• Automate data processing tasks to improve efficiency, including CI/CD for Fabric deployments.
• Work with other Data Engineers to implement new data products and services.

What you know

• 5+ years of experience in data engineering.
• Experience with data modelling and data warehousing.
• Experience with data quality assurance.
• Experience with scripting languages, such as Python and SQL.
• Strong problem-solving and analytical skills.
• Experience with MSSQL, Fabric, Power BI, and Azure Data Factory (ADF) is highly desirable.
• Core Platform: Microsoft Fabric, OneLake, Synapse Data Engineering, Synapse Data Science
• Languages: Python (PySpark, pandas, NumPy, Scikit-Learn), SQL, Delta Lake

Workflows: Fabric Notebooks, Data Factory Pipelines, CI/CD for Fabric (fabric-cicd)