Azure Databricks

Orcapod Consulting Services; Navi Mumbai, Pune District, Mumbai; In loco; INR 2.400.000 - 3.600.000; Tempo pieno

Descrizione del lavoro

Orcapod Consulting Services in Navi Mumbai is seeking a Senior Data Engineer / Azure Databricks Engineer with 8+ years of experience to design and optimize scalable data solutions on Microsoft Azure.

You will develop robust data pipelines using Databricks, manage Azure Storage and Data Lake, and implement automation with Ansible and YAML, while collaborating with stakeholders to translate business needs into technical specifications.

Competenze

• 8+ years of experience in Data Engineering / Data Analysis.
• Strong hands-on experience with Microsoft Azure.
• Hands-on experience with Azure Databricks for data processing and analytics.
• Strong understanding of Azure Storage and Azure Data Lake.
• Knowledge of Microsoft Fabric concepts and best practices.
• Experience designing and implementing Azure Data Lakes.

Mansioni

• Design, implement, and manage scalable data solutions on Microsoft Azure.
• Develop and maintain robust data pipelines using Databricks.
• Implement efficient data storage and retrieval using Azure Storage and Azure Data Lake.
• Automate infrastructure and application deployments using Ansible and YAML.
• Develop clean, scalable, and maintainable code using Python.
• Use Git and GitLab for version control and CI/CD.
• Gather and document business requirements through stakeholder discussions and workshops.
• Analyze business requirements and translate them into technical specifications.
• Apply data analytics to interpret data and support data-driven business decisions.
• Collaborate effectively with stakeholders and provide regular project updates.
• Identify opportunities for process improvement and automation.
• Support and mentor junior team members and contribute to wider engineering initiatives.

Conoscenze

Databricks

Azure

Data Engineering

Python

Azure Databricks

Azure Storage

Azure Data Lake

Microsoft Fabric

Ansible

GitLab CI/CD

Git

Stakeholder communication

Analytical skills

Descrizione del lavoro

Dear Candidate,

Greetings from the Recruitment Team!

We are currently hiring for a Senior Data Engineer / Azure Databricks opportunity. Please find the requirement details below:

Role: Senior Data Engineer / Azure Databricks Engineer

Experience: 8+ Years

Primary Skills: Databricks, Azure, Data Engineering, Python

Technology: Microsoft Azure / Databricks / Azure Data Lake / Microsoft Fabric

Key Responsibilities

• Design, implement, and manage scalable data solutions on Microsoft Azure.
• Develop and maintain robust data pipelines using Databricks.
• Implement efficient data storage and retrieval using Azure Storage and Azure Data Lake.
• Automate infrastructure and application deployments using Ansible and YAML.
• Develop clean, scalable, and maintainable code using Python.
• Use Git and GitLab for version control and CI/CD.
• Gather and document business requirements through stakeholder discussions and workshops.
• Analyze business requirements and translate them into technical specifications.
• Apply data analytics to interpret data and support data-driven business decisions.
• Collaborate effectively with stakeholders and provide regular project updates.
• Identify opportunities for process improvement and automation.
• Support and mentor junior team members and contribute to wider engineering initiatives.

Essential Skills

• 8+ years of experience in Data Engineering / Data Analysis.
• Strong hands-on experience with Microsoft Azure.
• Hands-on experience with Azure Databricks for data processing and analytics.
• Strong understanding of Azure Storage and Azure Data Lake.
• Knowledge of Microsoft Fabric concepts and best practices.
• Experience designing and implementing Azure Data Lakes.
• Hands-on experience with Ansible and YAML for automation/configuration management.
• Strong programming skills in Python.
• Strong experience with Git and GitLab CI/CD.
• Excellent stakeholder communication and analytical skills.