We are looking for an experienced Azure Data Engineer to join our team and work on large-scale data engineering, cloud data platforms, data warehousing, analytics, and big-data initiatives.
The ideal candidate will have strong hands‑on experience with the Microsoft Azure Data Engineering ecosystem, including Azure Data Factory, Azure Databricks, Azure Blob Storage, Apache Spark, SQL, Snowflake, ETL/ELT, Data Warehousing, DataOps, and CI/CD.
- Develop prototypes, proof-of-concepts, and technical solutions using multiple data sources, AI/ML methods, and big-data technologies.
- Design, develop, implement, and deploy scalable data platforms and databases across cloud infrastructures.
- Build and optimize data pipelines for structured and unstructured data.
- Port and migrate data across different data sources, databases, and platforms to improve performance, scalability, accessibility, and analytics capabilities.
- Develop technical solutions that combine disparate data sources to generate meaningful business insights.
- Work closely with Data Architects, Data Scientists, BI teams, and business stakeholders to deliver enterprise data solutions.
- Design and implement robust ETL/ELT pipelines and data processing workflows.
- Process and manage large-scale datasets, including multi-terabyte data environments.
- Develop data processing solutions using Azure Databricks and Apache Spark.
- Implement data warehousing solutions using Snowflake and apply appropriate data modelling techniques.
- Implement and maintain data quality, data governance, and data transformation processes.
- Monitor data pipelines, identify bottlenecks, troubleshoot failures, and continuously improve pipeline performance.
- Contribute to DataOps, workflow orchestration, monitoring, automation, and CI/CD initiatives.
- Support analytics and machine-learning applications by developing reliable and scalable data processing workflows.
- Collaborate with globally distributed teams and stakeholders to understand requirements and deliver technical solutions.
- Stay current with emerging cloud, big-data, analytics, and data engineering technologies and identify opportunities for innovation.
- 4+ years of professional experience in Data Engineering / Data Platform development.
- Strong hands‑on experience with the Azure Data Engineering ecosystem.
- Excellent knowledge of:
- Azure-based data storage and processing services
- Experience designing and implementing scalable cloud-based data architectures.
SQL & Databases
- Strong expertise in SQL and relational database technologies.
- Experience with T‑SQL, Microsoft SQL Server, Oracle, or equivalent technologies.
- Strong understanding of relational database design.
- Experience processing and managing large-scale datasets, including multi‑TB environments.
- Experience with database migration, optimization, performance tuning, and data integration.
Data Warehousing
- Strong experience with Snowflake.
- Data Warehousing
- Snowflake Schema
- Fact and Dimension Tables
- Slowly Changing Dimensions
- Data Warehouse Design Principles
ETL / Data Transformation
- Strong understanding of Extract, Transform & Load (ETL/ELT) concepts.
- Experience integrating data from multiple heterogeneous sources.
- Ability to optimize data pipelines for performance, reliability, and scalability.
- Strong interest and hands‑on experience in Big Data technologies.
- Experience with Apache Spark and Azure Databricks.
- Ability to design and implement distributed data processing workflows.
- Experience working with large volumes of structured and unstructured data.
DataOps / DevOps
- Good understanding of DataOps and data orchestration.
- Experience with workflow management, pipeline monitoring, logging, and alerting.
- Understanding of CI/CD practices for data engineering solutions.
- Ability to identify opportunities for automation and process improvements.
BI / Analytics
- Experience with at least one BI or reporting platform such as:
- Power BI
- Tableau
- Qlik
- SAS Visual Analytics
- Other enterprise BI/reporting platforms
- Bachelor's or Master's degree in Computer Science, Computer Engineering, Information Technology, Data Engineering, or an equivalent discipline.
- Professional certification/degree in Data Science, Data Engineering, Cloud Computing, or related fields will be an advantage.
- Strong analytical and problem-solving abilities.
- Excellent attention to detail and commitment to data quality.
- Strong planning and organizational skills.
- Excellent written and verbal communication skills.
- Ability to collaborate effectively with global teams and stakeholders.
- Comfortable working independently as well as in a team environment.
- Strong ownership and accountability.
- Curious mindset with an interest in learning and adopting emerging technologies.
- Ability to translate complex technical requirements into practical data engineering solutions.