Data Engineer

ADROITENT; Pune District, Bengaluru, Hyderabad; On-site; INR 700,000 - 1,100,000; Full time

Job summary

ADROITENT is seeking an experienced Azure Data Engineer to design and implement scalable data solutions on the Azure platform. The role involves building PySpark pipelines, managing data warehousing, and enabling enterprise reporting.

You will work with Azure OpenAI, LLM-based applications, and API integrations to support compliant analytics and data discovery. Collaboration with business users is essential to understand reporting needs and ensure data quality and security.

Responsibilities

• 5+ years of experience in Azure Data Engineering
• Expertise in ADF, PySpark, Databricks, SQL, Power BI
• Experience with data warehousing and enterprise reporting
• Hands-on exposure to Azure OpenAI, LLM-based applications, RAG frameworks, API integration
• Strong problem-solving and analytical skills
• Design and develop enterprise data solutions on Azure
• Build and maintain reusable PySpark frameworks and pipelines
• Create curated datasets for analytics and compliance reporting
• Support AI-powered data discovery and compliance use cases using LLMs
• Work with business users to understand reporting and analytics requirements
• Ensure data quality, performance, and security compliance

Job description

Role & responsibilities

• 5+ years of experience in Azure Data Engineering
• Expertise in ADF, PySpark, Databricks, SQL, Power BI
• Experience with data warehousing and enterprise reporting
• Hands-on exposure to Azure OpenAI, LLM-based applications, RAG frameworks, API integration
• Strong problem-solving and analytical skills
• Design and develop enterprise data solutions on Azure
• Build and maintain reusable PySpark frameworks and pipelines
• Create curated datasets for analytics and compliance reporting
• Support AI-powered data discovery and compliance use cases using LLMs
• Work with business users to understand reporting and analytics requirements
• Ensure data quality, performance, and security compliance