Azure Data Engineer

MyCareernet; Hyderabad; On-site; INR 1,000,000 - 2,000,000; Full time

Job summary

A data solutions company in Hyderabad is seeking a Mid-Senior Data Engineer to develop and maintain data pipelines using Azure Synapse and Data Factory. The ideal candidate will have hands-on experience with PySpark, SQL, and SAP BW. Responsibilities include designing data models, optimizing queries, and collaborating with teams in an Agile environment. This full-time position offers opportunities in a dynamic manufacturing industry.

Qualifications

• Hands-on experience in PySpark, Azure Synapse, and Azure Data Factory.
• Strong knowledge of SAP BW and data integration techniques.
• Proficiency in SQL and performance optimization for large datasets.

Responsibilities

• Develop and maintain data pipelines using Azure Synapse Analytics.
• Design and implement data models and ETL/ELT processes.
• Collaborate with cross-functional teams to gather requirements.

Skills

PySpark

Azure Synapse

SQL

SAP BW

Data Engineering

Data Visualization

Data Governance

Data Security

Education

Any Graduation

Job description

Key Skills: Pyspark, Azure Synapse, SQL, SAP BW, Design and Development, Data Engineering, Data Visualization, Data Governance, Data Security

Roles and Responsibilities:

• Develop and maintain data pipelines using Azure Synapse Analytics and Azure Data Factory.
• Design and implement data models and ETL/ELT processes to support business intelligence initiatives.
• Collaborate with cross-functional teams to gather requirements and deliver data solutions.
• Optimize SQL queries and perform performance tuning for large-scale data environments.
• Work with SAP BW data models and extraction methods to integrate data into Azure.
• Utilize PySpark for data processing and orchestration within Azure Databricks.
• Apply Agile methodologies (SCRUM) in project execution and team collaboration.
• Document processes and maintain clear communication with stakeholders.

Skills Required:

• Hands-on experience in PySpark, Azure Synapse, and Azure Data Factory.
• Strong knowledge of SAP BW and data integration techniques.
• Proficiency in SQL and performance optimization for large datasets.
• Experience in data modeling, ETL/ELT processes, and data engineering best practices.
• Understanding of data governance, security, and visualization (nice-to-have).
• Strong problem-solving, analytical, and communication skills.
• Ability to collaborate effectively in cross-functional teams and Agile environments.

Education: Any Graduation

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Industries: Manufacturing