Lead Data Engineer ( Snowflake + ADF + SQL)

Shashwath Solution; EUA; Teletrabalho; USD 140 000 - 190 000; Tempo integral

Resumo da oferta

Shashwath Solution is seeking a Lead Data Engineer to design, implement, and optimize data pipelines using Snowflake, ADF, and SQL Server. You will lead ETL efforts and collaborate with cross-functional teams to drive data initiatives.

The role emphasizes mentoring junior engineers, ensuring data integrity, and applying industry best practices in data management and BI workflows.

Qualificações

• Experience with Snowflake, ADF and SQL Server in design and development of data pipelines.
• Ability to lead ETL development and data integration from diverse sources.
• Strong understanding of Cloud Data Solutions, especially Azure-based tools.
• Mentor junior data engineers and guide skills development.
• Collaborate with cross-functional teams to deliver data initiatives.

Responsabilidades

• Design, implement, and maintain data solutions using Snowflake, ADF, and SQL Server to ensure data integrity, scalability, and high performance
• Lead and contribute to data pipelines, ETL processes, and data integration solutions for diverse sources
• Work with MSBI, SSIS, and Azure Data Lake Storage to optimize data flows and storage solutions
• Collaborate with business and technical teams to identify project needs, estimate tasks, and set milestones
• Implement BI and Data Management best practices ensuring usability and development standards
• Perform in-depth data analysis to resolve data issues and improve quality
• Mentor and guide junior data engineers and support skill development
• Collaborate with distributed teams to meet project goals in a timely manner

Conhecimentos

Data pipeline design

ETL development

Cloud data solutions

Mentoring juniors

Cross-functional collaboration

Ferramentas

Snowflake

Azure Data Factory (ADF)

SQL Server

MSBI (SSIS, SSRS)

Azure Data Lake Storage

Power BI

Azure Databricks

Descrição da oferta de emprego

We are seeking a skilled Lead Data Engineer with extensive experience in Snowflake, ADF, SQL, and other relevant data technologies to join our team. As a key member of our data engineering team, you will play an instrumental role in designing, developing, and managing data pipelines, working closely with cross-functional teams to drive the success of our data initiatives.

Key Responsibilities:

• Design, implement, and maintain data solutions using Snowflake, ADF, and SQL Server to ensure data integrity, scalability, and high performance
• Lead and contribute to the development of data pipelines, ETL processes, and data integration solutions, ensuring the smooth extraction, transformation, and loading of data from diverse sources
• Work with MSBI, SSIS, and Azure Data Lake Storage to optimize data flows and storage solutions
• Collaborate with business and technical teams to identify project needs, estimate tasks, and set intermediate milestones to achieve final outcomes
• Implement industry best practices related to Business Intelligence and Data Management, ensuring adherence to usability, design, and development standards
• Perform in-depth data analysis to resolve data issues and improve overall data quality
• Mentor and guide junior data engineers, providing technical expertise and supporting the development of their skills
• Effectively collaborate with geographically distributed teams to ensure project goals are met in a timely manner

Required Technical Skills:

• T-SQL, SQL Server, MSBI (SQL Server Integration Services, Reporting Services), Snowflake, Azure Data Factory (ADF), SSIS, Azure Data Lake Storage
• Proficient in designing and developing data pipelines, data integration, and data management workflows
• Strong understanding of Cloud Data Solutions, with a focus on Azure-based tools and technologies

Nice to Have:

• Experience with Power BI for data visualization and reporting
• Familiarity with Azure Databricks for data processing and advanced analytics