Data Specialist - R01569363

Brillio 2; Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Brillio 2 is seeking a Data Specialist in Pune, India to design and implement scalable Azure-based data pipelines. You will work with Azure Synapse, Data Factory, Data Explorer, Spark, Delta Lake, and Power BI to deliver real-time and batch analytics.

You will collaborate with cross-functional teams, optimize SQL performance, maintain data quality, and document data architectures. A 4–6 year hands-on data engineering background with Azure analytics is required.

Qualifications

• 4–6 years of hands-on data engineering experience with Azure analytics and pipeline development
• Experience designing scalable ETL using Azure Data Factory, Synapse Analytics, and Spark
• Proficiency in integrating data sources like Azure Data Explorer (Kusto) and Delta Lake for analytics and reporting
• Experience configuring cloud-hosted data architectures using Azure services for secure, efficient operations

Responsibilities

• Design and implement scalable ETL processes using Azure Data Factory, Synapse Analytics, and Spark
• Develop and optimize data pipelines and models for lakehouse and warehouse analytics
• Integrate data sources from Azure Data Explorer, Kusto, and Delta Lake formats
• Configure and maintain cloud-hosted data architectures leveraging Azure services
• Collaborate with cross-functional teams to capture data requirements and drive data-driven development
• Monitor and optimize SQL performance and data quality across systems
• Develop and maintain Power BI reports focusing on data modeling and DAX
• Document technical data processes and architectures to support knowledge sharing and compliance

Skills

Azure Synapse Analytics

Azure Data Factory

Azure Data Explorer (Kusto)

Pyspark

Delta Lake

SQL performance tuning

Power BI (Data Modeling and DAX)

Azure Data Lake

Education

Bachelor's degree in Computer Science/IT/Data Engineering

Microsoft Certified: Azure Data Engineer Associate

Microsoft Certified: Azure Solutions Architect Expert

Tools

AKS (Azure Kubernetes Service)

Event Hub

Azure DevOps for CI/CD

Azure Sentinel

Job description

Data Specialist

AKS, Event Hub, Azure DevOps, Azure sentinel, Cosmos DB, Azure Functions

Azure Data Engineering Advanced: Senior Lead Data Engineer

Experience Range: with at least 4 to 6 years of hands-on experience in data engineering, including substantial expertise in Azure analytics and pipeline development

Key Responsibilities

• 1. Design and implement scalable ETL processes using Azure Data Factory, Synapse Analytics, and Spark, delivering robust real-time and batch data feeds
• 2. Develop and optimize data pipelines and models for large-scale lakehouse and warehouse analytics systems, achieving high performance and reliability targets
• 3. Integrate and manage data sources from Azure Data Explorer, Kusto, and Delta Lake formats to enable advanced analytics and reporting capabilities
• 4. Configure and maintain cloud-hosted data architectures, leveraging Azure services to ensure secure, efficient, and resilient data operations
• 5. Collaborate with cross-functional teams to capture data requirements and drive test-driven, data-driven development methodologies
• 6. Monitor, troubleshoot, and enhance SQL performance, ensuring efficient query execution and maintaining data quality across all systems
• 7. Develop and maintain Power BI reports, focusing on data modeling and DAX to deliver actionable insights to stakeholders
• 8. Document technical business processes and data architecture, supporting organizational knowledge sharing and compliance

Required Skills

• 1. Azure Synapse Analytics
• 2. Azure Data Factory
• 3. Azure Data Explorer (Kusto)
• 4. Pyspark
• 5. Delta Lake
• 6. SQL performance tuning
• 7. Power BI (Data Modeling and DAX)
• 8. Azure Data Lake

Preferred Skills

• 1. Azure DevOps for CI/CD
• 2. AKS (Azure Kubernetes Service)
• 3. Event Hub
• 4. Azure Sentinel
• 5. Experience with large-scale streaming analytics

Desired Qualifications

• 1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline
• 2. Microsoft Certified: Azure Data Engineer Associate
• 3. Microsoft Certified: Azure Solutions Architect Expert

Additional Information

Location: Bangalore