An innovative company is seeking a skilled Data Engineer to design and develop data solutions using the Azure Data stack. This role involves creating data models for enterprise-scale applications, optimizing SQL queries, and implementing ETL processes in the Azure cloud platform. The ideal candidate will possess strong communication skills and the ability to work both independently and collaboratively. Join a dynamic team where your expertise in data engineering and analytical services will drive impactful solutions in a fast-paced environment. If you are passionate about data and eager to tackle complex challenges, this opportunity is perfect for you.
Qualifications
Experience in Azure Data services and strong SQL skills are essential.
Ability to design and troubleshoot ETL processes and data pipelines.
Responsibilities
Design and develop Data Engineering solutions using Azure Data stack.
Troubleshoot ETL issues and perform root cause analysis.
Skills
ADF
Synapse
SQL
Cosmos DB
Azure Data Architecture
Data Engineering
Communication Skills
ETL Processes
Python
Statistics
Tools
Azure SQL
Power BI
Azure Databricks
Spark
Kusto
Azure Data Lake
Azure Data Explorer
Job description
Mandatory Skills: ADF, Synapse, SQL, Cosmos DB
Responsibilities:
Design and development of Data Engineering solutions, Data models using Azure Data stack for enterprise scale applications
Communicate and defend design, requirements, feature set, functionality, usability and limitations of subsystem to team and/or development lead or manager.
Design and exhibit strong coding skills with high quality database solutions within a fast paced monthly release cycle
Design ETL process, data migrations within/to Azure cloud platform.
Strong knowledge in Vector Databases like COSMOS DB
Troubleshooting of data pipelines ETL issues, performing root cause analysis and ability to resolve issues
Mandatory Skills:
Must have experience with Azure Data /Analytical services- Azure SQL, COSMOS DB, Synapse, ADF, Azure Analytical Services (AAS), Azure Data Explorer (ADX), Azure Data Lake (ADLS), Power BI
Good to have implementing experience in big data processing tools - COSMOS, Kusto, Azure Databricks, Spark
Expertise in writing and optimizing the best quality SQL queries, complex stored procedures
In depth understanding of Azure Data architecture and hands on experience with various tools.
Strong communication skills
Ability to work effectively both individually and on a team.
Preferred Skills:
Python and Statistics
Experience with other AI and machine learning algorithms.