Azure Data Engineer

Intellics Global Services; Hyderabad; Hybrid; INR 1,500,000 - 2,100,000; Full time

Job summary

Intellics Global Services in Hyderabad is seeking a skilled Data Engineer to design and maintain scalable data pipelines using Azure Databricks, ADF, and PySpark. You will develop data processing solutions with SQL, build APIs with FastAPI, and manage CI/CD pipelines with Azure DevOps.

The role requires hands-on experience with cloud data platforms, performance optimization, and technical leadership to drive Azure data engineering initiatives in a fast-paced environment.

Qualifications

• Experience with Azure Databricks, Azure Data Factory and PySpark.
• Strong SQL skills and data modeling experience.
• Proficiency in building APIs with FastAPI.
• Experience managing CI/CD with Azure DevOps.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks.
• Build and optimize data processing using PySpark and SQL.
• Create and integrate APIs using FastAPI.
• Manage CI/CD and deployment processes with Azure DevOps.
• Provide technical leadership for Azure data initiatives.
• Troubleshoot performance issues and ensure data quality.

Skills

Azure Databricks

Azure Data Factory

PySpark

SQL

FastAPI

Azure DevOps

Job description

Required Skills:

• Azure Databricks (ADB)
• Azure Data Factory (ADF)
• PySpark
• SQL
• FastAPI
• Azure DevOps

Primary Skills:

• Azure Databricks (ADB)
• Azure Data Factory (ADF)
• PySpark
• SQL
• FastAPI
• Azure DevOps

Secondary Skills:

• FastAPI
• Azure DevOps

Role Responsibilities:

• Design, develop, and maintain scalable data engineering solutions using Azure Databricks.
• Build and optimize data pipelines using Azure Data Factory.
• Develop data processing solutions using PySpark and SQL.
• Create and integrate APIs using FastAPI.
• Manage CI/CD pipelines and deployment processes using Azure DevOps.
• Provide technical leadership for Azure data engineering initiatives.
• Troubleshoot performance issues and ensure high-quality data solutions.