Azure Data Engineer

Orangebits Software Technologies; Pune District, Mumbai; Ibrido; INR 900.000 - 1.300.000; Tempo pieno

Descrizione del lavoro

Orangebits Software Technologies in Pune, India seeks a data engineer to design, build, and optimize data pipelines and workflows across various data sources and platforms.

You will architect and implement new data solutions using Azure technologies such as Azure Databricks, Azure Data Factory, and Azure DevOps, collaborating with stakeholders to translate business needs into scalable data models. The role involves Python, PySpark, and SQL development for analytics, reporting, and ML initiatives.

Competenze

• Proficiency in Python, PySpark, and SQL with a solid understanding of ML libraries.
• Strong expertise in Azure cloud ecosystem - particularly Databricks, Data Factory, and DevOps.
• Hands-on experience implementing CI/CD principles for data workflows.
• Good understanding of API/web service and data security practices.
• Experience working with relational databases (SQL Server, Oracle, MySQL, etc.).
• Excellent communication, collaboration, and problem-solving skills.
• Passion for innovation, automation, and continuous learning in the data domain.

Mansioni

• Design, build, and optimize data pipelines and workflows across various data sources and platforms.
• Architect and implement new data solutions using Azure technologies such as Azure Databricks, Azure Data Factory, and Azure DevOps.
• Collaborate with stakeholders to translate business and analytical requirements into scalable technical data models.
• Develop data integration strategies using Python, PySpark, and SQL to support analytics, reporting, and ML initiatives.
• Contribute to data architecture design, including ingestion, transformation, and delivery layers.
• Participate in CI/CD pipeline development and deployment for data engineering projects.
• Work independently and collaboratively in agile environments to deliver high-quality, production-ready data solutions.
• Stay updated with emerging tools, frameworks, and methodologies in the data engineering ecosystem.

Conoscenze

Python

PySpark

SQL

ML libraries

Azure Databricks

Azure Data Factory

Azure DevOps

CI/CD

API/web services

Relational databases

Communication

Automation

Strumenti

Azure Databricks

Azure Data Factory

Azure DevOps

Descrizione del lavoro

• Design, build, and optimize data pipelines and workflows across various data sources and platforms.
• Architect and implement new data solutions using Azure technologies such as Azure Databricks, Azure Data Factory, and Azure DevOps.
• Collaborate with stakeholders to translate business and analytical requirements into scalable technical data models.
• Develop data integration strategies using Python, PySpark, and SQL to support analytics, reporting, and ML initiatives.
• Contribute to data architecture design, including ingestion, transformation, and delivery layers.
• Participate in CI/CD pipeline development and deployment for data engineering projects.
• Work independently and collaboratively in agile environments to deliver high-quality, production-ready data solutions.
• Stay updated with emerging tools, frameworks, and methodologies in the data engineering ecosystem.

Skills:

• Proficiency in Python, PySpark, and SQL with a solid understanding of ML libraries.
• Strong expertise in Azure cloud ecosystem - particularly Databricks, Data Factory, and DevOps.
• Hands-on experience implementing CI/CD principles for data workflows.
• Good understanding of API/web service and data security practices.
• Experience working with relational databases (SQL Server, Oracle, MySQL, etc.).
• Excellent communication, collaboration, and problem-solving skills.
• Passion for innovation, automation, and continuous learning in the data domain.