Commercial Senior Data Engineer

Honeybee Tech Solutions; Pune District; In loco; INR 1.800.000 - 3.000.000; Tempo pieno

Descrizione del lavoro

Honeybee Tech Solutions seeks senior-level data engineers with strong hands-on Azure experience to design, build and maintain production-grade data pipelines and data platforms. The role focuses on Azure Data Factory, Databricks, Snowflake and related tools to deliver scalable, secure data solutions for AI/ML workloads.

You will translate business requirements into robust data architectures, optimize performance, and mentor peers in CI/CD practices and data governance.

Competenze

• Hands-on experience with Azure Data Platform and data engineering.
• Expertise in Azure Data Factory (ADF) and Databricks.
• Knowledge of Delta Lake and Snowflake architectures.
• Proficiency in Python, SQL and PySpark.
• Experience with Azure DevOps, Jenkins and CI/CD pipelines.
• Strong data pipeline design, development, testing and deployment.
• Security, cost optimization and performance tuning for data platforms.
• Production data platforms experience and architectural decision-making.
• Knowledge of AI/ML workloads and Azure AI services.
• Familiarity with Agile/Scrum/Kanban environments.

Mansioni

• Design, develop, test and release end-to-end Azure-based data solutions.
• Own and manage complex data pipelines and data platforms.
• Design and implement data engineering solutions using Azure Data Factory, Databricks, Snowflake.
• Translate business requirements into scalable, secure data solutions.
• Handle incidents, defects and production escalations.
• Ensure data solutions meet security, governance and reliability standards.
• Identify and resolve technical debt while driving continuous improvement.
• Establish data engineering standards and CI/CD processes.
• Mentor other engineers through design reviews and knowledge sharing.
• Support AI/ML and Generative AI use cases from a data engineering view.

Conoscenze

Azure Data Platform

Azure Data Factory (ADF)

Databricks

Delta Lake

Snowflake

Python

SQL

PySpark

Azure DevOps Jenkins

CI/CD & DataOps

Infrastructure as Code

Git-based workflows

Data pipeline design

Performance optimization

Security & cost optimization

Production data platforms

AI/ML & Generative AI workloads

Azure Machine Learning

Azure OpenAI & Cognitive Services

Agile/Scrum/Kanban

Strumenti

Azure Data Factory (ADF)

Databricks

Delta Lake

Snowflake

Azure DevOps

Jenkins

Git

PySpark

Descrizione del lavoro

Key Skills Required

• Strong hands-on experience with Azure Data Platform
• Azure Data Factory (ADF)
• Databricks
• Delta Lake
• Snowflake
• Python, SQL, PySpark
• Azure DevOps Jenkins
• CI/CD, DevOps & DataOps practices
• Infrastructure as Code and Git-based workflows
• Data pipeline design, development, testing and deployment
• Performance optimization, scalability, security and cost optimization
• Strong experience in production data platforms and architectural decision-making
• Knowledge of Azure Machine Learning, Azure OpenAI and Cognitive Services
• Understanding of data engineering for AI/ML and Generative AI workloads
• Experience with Agile/Scrum/Kanban environments

Key Responsibilities

• Design, develop, test and release end-to-end Azure-based data solutions.
• Own and manage complex data pipelines and data platforms.
• Design and implement data engineering solutions using Azure Data Factory, Databricks, Snowflake and related technologies.
• Translate business requirements into scalable, secure and maintainable data solutions.
• Handle complex incidents, defects and production escalations.
• Ensure data solutions meet security, governance, performance and reliability standards.
• Identify and resolve technical debt while driving continuous improvement.
• Establish data engineering standards, coding practices, CI/CD processes and monitoring.
• Mentor other engineers through technical guidance, design reviews and knowledge sharing.
• Support AI/ML and Generative AI use cases from a data engineering and Azure platform perspective.

Candidate Profile

We are looking for candidates with strong senior-level data engineering expertise, hands-on Azure experience, excellent problem-solving abilities and experience owning production-grade data solutions end to end.